Tag: shell

A Simple Makefile for Latex

Posted on by Eric Ma

Compiling a latex documents may take several steps when bibtex is used with latex. However, this latex compilation process is the same for most documents. We can make it a template with Makefile so that simply running make will generate the dvi/ps/pdf files for us. A simple Makefile for using latex with bibtex enabled is
Read more

Mounting Remote Folder Through SSH

Posted on by Eric Ma

SSH is a very convenient tool on Linux that can be used to [[port-forwarding-using-ssh-tunnel]], [[proxy-using-ssh-tunnel]] and others besides its basic functions (remote shell). We can also use SSH to mount a remote folder to a local directory. We can use `sshfs` to mount remote folder through SSH tunnel securely over network. Install sshfs Install `sshfs`
Read more

How to Set Up Socks Proxy Using SSH Tunnel

Posted on by Eric Ma

We can set up a socks proxy on top of a SSH tunnel. Besides the common proxy functions, such as web browsing, the proxy on top of SSH tunnel also ensures the security between the browser and the proxy server (the SSH server). In this post, we introduce and explain how to set up a
Read more

Automatically Backing Up Xen File-backed DomU

Posted on by Eric Ma

A script for backing up file-backed Xen DomU is introduced in this post. This script can be changed to similar platform. In our cluster, virtual machines are stored under /lhome/xen/. Virtual machine with id vmid is stored in directory vmvmid. The raw image disk file name can also be derived from vmid. Some more details
Read more

Howto: Git Server over SSH

Posted on by Eric Ma

Git and SSH are both powerful tools, and git/ssh work well together. We introduce how to set up git server via ssh in this post. Git server through SSH is easy and fast to set up, although every user will have access to all repositories in the git server over SSH and every user is
Read more

How to Create, Mount, and Burn ISO Images on Linux

Posted on by Eric Ma

Linux has many tools for mounting, creating and burning iso image files. In this posts, I will introduce how to use the iso files on Linux. The tools we used in this post are mount, genisoimage and wodim. 1. Mount an iso image file Mounting an iso on Linux is straightforward. We mount the iso
Read more

How to Run a cron Job Every Two Weeks / Months / Days

Posted on by Eric Ma

We may want to run some jobs for every two weeks/months/days… under some situation such as backing up for every other week. In addition, we may add more complex rules for running jobs, e.g. run a command when the load of the server is higher than a certain level. With the help of the shell
Read more

Hadoop Installation Tutorial (Hadoop 1.x)

Posted on by Eric Ma

Update: If you are new to Hadoop and trying to install one. Please check the newer version: Hadoop Installation Tutorial (Hadoop 2.x). Hadoop mainly consists of two parts: Hadoop MapReduce and HDFS. Hadoop MapReduce is a programming model and software framework for writing applications, which is an open-source variant of MapReduce that is initially designed
Read more

Setting Up a Git Server Using Gitosis

Posted on by Eric Ma

Update: Since gitosis is not maintained and supported, please check out gitolite for setting up a new git server. (see the comment from Sitaram Chamarty, the gitolite author, the author of gitolite.) Gitosis is a piece of software writen by Tommi Virtanen for hosting git repositories. It manages multiple repositories under the same user account.
Read more

mrcc – A Distributed C Compiler System on MapReduce

Posted on by Eric Ma

The mrcc project’s homepage is here: mrcc project. Abstract mrcc is an open source compilation system that uses MapReduce to distribute C code compilation across the servers of the cloud computing platform. mrcc is built to use Hadoop by default, but it is easy to port it to other could computing platforms, such as MRlite,
Read more