| | |

Setting Up Linux Network Gateway Using iptables and route

Sharing the networking is important and setting up a gateway is a good solution to it. Building up the gateway on a Linux box is easy, cost efficient and reliable. With a Linux box, you can share the internet connection or the only cable connected to the network. The Linux box network configuration The Linux…

How to Control or Disable SELinux in Fedora and CentOS Linux

For most of cases, you should not disable SELinux. However, for some users, SELinux may cause problems or is not needed. We may just make it not block operations or totally disable it. Making SELinux log warnings instead of blocking For many cases, people find SELinux blocks operations. For tests or some other situations, you…

How to Duplicate Xen DomU Virtual Machines

Assumption: There are VBD based Xen DomU virtual machines stored under /home/xen/vm-f11-sample/. There are two files under vm-f11-sample: vm0-f11.run (The configuration file) and vmdisk0 (The virtual disk). Now we want to duplicate the virtual machine vm0 stored under vm-f11-sample to vm-10.0.0.213 which is stored under vm-10.0.0.213. And vm-10.0.0.213’s ip will be 10.0.0.213. The steps to…

How to Speed Up Firefox DNS Lookup in Linux

How to speed Up Firefox DNS Lookup in Linux: 1. Close IPV6 support # echo “alias net-pf-10 off” >> /etc/modprobe.conf # echo “alias ipv6 off” >> /etc/modprobe.conf Type “about:config” into the address line and enter. Set “network.dns.disableIPv6” to “true” 2. Some other tweaks Type “about:config” into the address line and enter. Set “network.http.pipelining” to “true”…

Configure sMobileNet of HKUST on Linux

How to configure NetworkManager to connect to sMobileNet in HKUST is introduced in this post. The wireless network connection configuration for sMobileNet in NetworkManager The SSID is “sMobileNet” Wireless security is “WPA & WPA2 Enterprise” Authentication is “Protected EAP (PEAP)” Anonymous identity is “” (empty) CA certificate is “(None)” (there will be a warning appear,…

|

How to Compress/Uncompress Files in Linux Using gzip, bzip2, 7z, rar and zip

Compress/uncompress files are frequent operations. The normal tools for compressing/uncompressing in Linux is gzip, bzip2, 7z, rar and zip. This post introduces how to compress and uncompress file in Linux using these tools. We use best compressing rate with all these tools and mark the options for “best rate” in bold fonts. We can delete…

Hadoop TeraSort Benchmark

TeraSort is one of Hadoop’s widely used benchmarks. Hadoop’s distribution contains both the input generator and sorting implementations: the TeraGen generates the input and TeraSort conducts the sorting. Here, we provide a short tutorial for using the Hadoop TeraSort benchmark. TeraGen generates random data that can be used as input data for a subsequent running…

|

Large-scale Data Storage and Processing System in Datacenters

Research on Cloud Computing has made big progresses and many excellent large-scale systems have been designed in recent years. I compiled a list of some large-scale data storage and processing systems in datacenters as follows. Storage systems Google File System (GFS): http://research.google.com/archive/gfs.html HDFS implementation: https://hadoop.apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/HdfsDesign.html Colossus (GFS2): Colossus: Successor to the Google File System (GFS)…

| |

Hadoop Installation Tutorial (Hadoop 1.x)

Update: If you are new to Hadoop and trying to install one. Please check the newer version: Hadoop Installation Tutorial (Hadoop 2.x). Hadoop mainly consists of two parts: Hadoop MapReduce and HDFS. Hadoop MapReduce is a programming model and software framework for writing applications, which is an open-source variant of MapReduce that is initially designed…