Converting text to lowercase is a common task in shell scripts and command-line workflows. Linux offers multiple approaches, each with different trade-offs in performance, portability, and Unicode handling. Using tr for simple conversions The tr command translates characters and is widely portable across Unix-like systems: echo “HELLO WORLD” | tr ‘[:upper:]’ ‘[:lower:]’ Output: hello world…
Connecting your application to a MySQL database is fundamental to most backend systems. Rather than shelling out to the mysql command-line client, you’ll use language-specific connectors that provide proper connection pooling, error handling, and prepared statements. Language-Specific MySQL Drivers The best approach depends on your tech stack: Python Use mysql-connector-python for straightforward connections or PyMySQL…
The core problem here is legitimate: if you’re running multiple jobs on the same dataset where the mapper phase produces identical intermediate results, recomputing those results is wasteful. However, skipping the mapper phase entirely breaks MapReduce’s processing model. There are better approaches. Why You Can’t Just Skip the Mapper MapReduce assumes data flows through map…
HDFS doesn’t natively support directory-level replication factor inheritance. Even if you set a specific replication factor on a directory and its files, new files created in that directory will default to the cluster’s global dfs.replication setting (typically 3). This limitation can complicate multi-tier storage strategies where you want temporary or low-priority data on fewer replicas…
Finding files that match a pattern is straightforward with ls *string* or find . -name ‘*string*’. But excluding files with a certain string in their filename requires a different approach. Using find with negation The most reliable method is find with the ! (or -not) operator: find . -type f ! -name ‘*string*’ This finds…
The sed stream editor is the go-to tool for deleting lines from files in Linux. It’s fast, works on large files without loading everything into memory, and handles complex patterns easily. Delete a Single Line by Line Number To delete the 4th line from a file: sed -i ‘4d’ ./file The -i flag edits the…
Converting PPTX presentations to image files on Linux requires a two-step process: first convert to PDF, then rasterize to your target image format. This approach preserves slide layout and fonts better than direct conversion tools. Convert PPTX to PDF Start by converting your PowerPoint file to PDF using LibreOffice: libreoffice –headless –convert-to pdf presentation.pptx The…
Converting between Simplified Chinese (SC) and Traditional Chinese (TC) characters on Linux is straightforward with OpenCC, a mature open-source tool designed specifically for this task. Installing OpenCC Most distributions include OpenCC in their standard repositories: # Debian/Ubuntu sudo apt install opencc # RHEL/CentOS/Fedora sudo dnf install opencc # Arch sudo pacman -S opencc Alternatively, build…
The default dd command can feel sluggish because it uses a small block size (512 bytes) by default. You can dramatically improve throughput by increasing the bs (block size) parameter. Basic optimization Instead of: dd if=/dev/sda2 of=./sda2.bak Use: dd if=/dev/sda2 of=./sda2.bak bs=1M The bs parameter controls how much data dd reads and writes in each…
iptables remains the standard firewall configuration tool on Linux systems, though many distributions now layer it with ufw or firewalld. Understanding the basics helps you troubleshoot, migrate, or work on systems without those abstractions. Understanding iptables Fundamentals iptables operates on three main chains: INPUT: rules for incoming traffic FORWARD: rules for traffic passing through the…
When backing up with rsync, you often need to skip directories like cache/, node_modules/, or .git/ that appear at multiple levels in your directory tree. Listing every instance individually is impractical, but rsync’s exclude patterns handle this elegantly. Basic exclude syntax The simplest approach uses –exclude with a directory name pattern: rsync -avxP –exclude=cache/ /path/to/src/directory/…
When you need to audit disk usage or understand directory structure, counting files in each subdirectory is a common task. This is especially useful when dealing with large directory trees where you need a quick overview of distribution. The Basic Approach The simplest method uses a loop with find and wc: for i in */;…
MPlayer is largely unmaintained as of 2026. For playing 3D movies on standard displays, mpv is the modern replacement and offers better stereo rendering support. Using mpv for 3D Playback The most straightforward approach with mpv is to use the stereo3d filter to convert side-by-side or other 3D formats to anaglyph (color-separated) stereo: mpv –vf=stereo3d=sbsl:arced…
A sequence point is a point in execution where all side effects from previous evaluations are guaranteed to be complete and visible. Understanding sequence points is critical for writing correct C code, especially when dealing with expressions that modify variables. The C standard defines side effects as changes to the state of the execution environment…
A database schema is the blueprint that defines how data is organized and stored in a database. Think of it as the architectural plan for your database—it specifies tables, columns, data types, relationships, constraints, and rules that govern how data can be stored and accessed. Core Components of a Schema A schema encompasses several key…
Adding a second metadata directory to your HDFS NameNode increases reliability by maintaining synchronized replicas of the namespace and transaction logs across separate disks. This guide walks through the process safely. Prerequisites and Planning Before starting, verify your current configuration and plan the new directory location: grep -A2 “dfs.namenode.name.dir” $HADOOP_HOME/etc/hadoop/hdfs-site.xml The new directory should be…
Converting a series of JPG images into a single PDF is useful for creating documents, presentations, or archiving scanned photos. Linux offers several tools for this task, each with different trade-offs between simplicity, quality preservation, and features. Using img2pdf (Recommended) For most cases, img2pdf is the best choice because it merges images without re-encoding or…
Removing version control or build artifact directories across a large directory tree is a common sysadmin task. SVN directories (.svn), Git metadata (.git), or node modules (node_modules) often need to be purged before deployment or archiving. Using find with xargs The most efficient approach combines find with xargs: find ./ -name “.svn” -type d |…
RTMP (Real Time Messaging Protocol) streams are still used for live broadcasts and on-demand video delivery, though less commonly than HLS or DASH. If you need to capture an RTMP stream, there are several solid tools available on Linux. Using ffmpeg (recommended) ffmpeg is the modern standard for working with RTMP streams. It’s widely available,…
When you need to increase data redundancy or reduce storage overhead on a running HDFS cluster, you’ll often need to adjust the replication factor. Before making changes, understand that HDFS replication works differently than you might expect. How HDFS Replication Factor Works The replication factor in HDFS is determined at write time by the client,…