How to set the number of mappers and reducers of Hadoop in command line?

How to set the number of mappers and reducers of Hadoop in command line? Number of mappers and reducers can be set like (5 mappers, 2 reducers): -D mapred.map.tasks=5 -D mapred.reduce.tasks=2 in the command line. In the code, one can configure JobConf variables. job.setNumMapTasks(5); // 5 mappers job.setNumReduceTasks(2); // 2 reducers Note that on Hadoop…

How to import a googlecode git project to github project

I wanna migrate leveldb (code.google.com/p/leveldb) to my github repository. Create a new repo on github.com with this link https://help.github.com/articles/creating-a-new-repository git clone https://code.google.com/p/ project-name.git Set the remote origin url as follows: git remote set-url origin https://github.com/ username/ repo-name.git git pull to pull the latest. git push origin master after making local changes. This is the original…

Fix the Grub issue with Windows 8 UEFI after installing Fedora 20

Grub fails to boot with Windows 8 UEFI after installing Fedora 20. The Grub entry for Windows 8 is: menuentry ‘Windows Boot Manager’ { chainloader /EFI/Microsoft/Boot/bootmgfw.efi boot } How to fix it? The set root= is missing. You probably can fix this by specifying the root manually: menuentry ‘Windows Boot Manager’ { insmod part_gpt set…

How to download a youtube video to my computer?

How to download a youtube video to my computer? You may use the ClipConverter.cc for downloading Youtube videos: http://www.clipconverter.cc/ How to download a YouTube video: Paste your YouTube URL at ‘Media URL’ and press Continue. Select the format and the options for the conversion. The default options are for most videos a good setting. Press…

Setting up a VPN over SSH

SSH tunnel and port forwarding is great and convenient to use. But is it possible to set up a VPN like connection over SSH? If you are on Linux or Mac, you can use sshuttle: https://github.com/apenwarr/sshuttle If you are on Windows, you can use ProxyCap: http://www.proxycap.com/index.html Both are great software.

Filter away non-printable ASCII characters on Linux?

Sometimes the commands’ output have some non-printable ASCII characters. How to filter away these non-printable ASCII characters on Linux? You can consider the problem as “how to leave only printable ascii characters?”. The printable characters in ASCII table are: Octal 011: Tab Octal 012: Line Feed Octal 015: Carriage Return Octal 040 to 176: printable…

How to calculate the average of value in lines of a text file on Linux by a script?

How to calculate the average of value in lines of a text file on Linux by a script? The file.txt is like: Run 0: Time used: 22.235331711 seconds. Run 1: Time used: 20.784491219 seconds. Run 2: Time used: 21.851638876 seconds. What I want it to calculate the average time. awk is handy for this purpose:…

Patching with git

Tutorials on how to create patches and apply patches with git. A nice tutorial: https://ariejan.net/2009/10/26/how-to-create-and-apply-a-patch-with-git/ Manuals: git format-patch: https://www.systutorials.com/docs/linux/man/1-git-format-patch/git apply: https://www.systutorials.com/docs/linux/man/1-git-apply/