NAME dbfilediff – compare two fsdb tables SYNOPSIS dbfilediff[-Eq][-N diff_column_name]– input table1.fsdb– input table2.fsdb OR cat table1.fsdb | dbfilediff [-sq] –input table2.fsdb DESCRIPTION Dbfilediff compares two Fsdb tables, row by row. Unlike Unix diff(1), this program assumes the files are identical line-by-line and we compare fields. Thus, insertion of one extra row will result in…
NAME dbfilecat – concatenate two files with identical schema SYNOPSIS dbfilecat– input A.fsdb[–input B.fsdb…] or echo A.fsdb | dbfilecat –xargs DESCRIPTION Concatenate all provided input files, producing one result. We remove extra header lines. Inputs can both be specified with "–input", or one can come from standard input and the other from "–input". With "–xargs",…
NAME dbfilealter – alter the format of an Fsdb file, changing the row/column separator SYNOPSIS dbfilealter [-c] [-F fs] [-R rs] [-Z compression] [column…] DESCRIPTION This program reformats a Fsdb file, altering the row ("-R rs") or column ("-F fs") separator. It verifies that this action does not violate the file constraints (for example, if…
dbfdump.pl – Dump the record of the dbf file Format dbfdump.pl [options] fileswhere options are –rs output record separator (default newline) –fs output field separator (default colon) –fields comma separated list of fields to print (default all) –undef string to print for NULL values (default empty) –memofile specifies unstandard name of attached memo file –memosep…
NAME dbench – Measure disk throughput for simulated netbench run SYNOPSIS dbench [options]numclients tbench [options]numclientsserver tbench_srv [options] DESCRIPTION This manual page documents briefly the dbench and tbench benchmarks. This manual page was written for the Debian GNU/Linux distribution because the original program does not have a manual page. However, it has fairly easy to read…
NAME dbcolstatscores – compute z-scores or t-scores for each value in a population SYNOPSIS dbcolstatscores [-t] [–tmean=MEAN] [–tstddev=STDDEV] column DESCRIPTION Compute statistics (z-score and optionally t-score) over a COLUMN of numbers. Creates new columns called “zscore”, “tscore”. T-scores are only computed if requested with the "-t" option, or if "–tmean" or "–tstddev" are explicitly specified…
NAME dbcolstats – compute statistics on a fsdb column SYNOPSIS dbcolstats [-amS] [-c ConfidenceFraction] [-q NumberOfQuantiles] column DESCRIPTION Compute statistics over a COLUMN of data. Records containing non-numeric data are considered null do not contribute to the stats (with the "-a" option they are treated as zeros). Confidence intervals are a t-test (+/- (t_{a/2})*s/sqrt(n)) and…
NAME dbcolsregression – compute linear regression between two columns SYNOPSIS dbcolsregression [-a] column1 column2 DESCRIPTION Compute linear regression over "column1" and "column2". Outputs slope, intercept, and correlation coefficient. OPTIONS -a or –include-non-numeric Compute stats over all records (treat non-numeric records as zero rather than just ignoring them). -f FORMAT or –format FORMAT Specify a printf(3)-style…
NAME dbcolsplittorows – split an existing column into multiple new rows SYNOPSIS dbcolsplittorows [-C ElementSeperator] [-e null] [-E] [-N enumerated-name] column [column…] DESCRIPTION Split column into pieces, outputting one row for each piece. By default, any empty fields are ignored. If an empty field value is given with -e, then they produce output. When a…
NAME dbcolsplittocols – split an existing column into multiple new columns SYNOPSIS dbcolsplittocols [-E] [-C ElementSeparator] column [column…] DESCRIPTION Create new columns by splitting an existing column. The fragments of the column are each divided by ElementSeparator (default is underscore). This command is the opposite of dbcolmerge. Names of the new columns are given by…
NAME dbcolscorrelate – find the coefficient of correlation over columns SYNOPSIS dbcolscorrelate column1 column2 [column3…] DESCRIPTION Compute the coefficient of correlation over two (or more) columns. The output is one line of correlations. With exactly two columns, a new column correlation is created. With more than two columns, correlations are computed for each pairwise combination…
NAME dbcolrename – change the names of columns in a fsdb schema SYNOPSIS dbcolrename OldName1 NewName1 [OldName2 NewName2] … DESCRIPTION Dbcolrename changes the names of columns in a fsdb schema, mapping OldName1 to NewName1, and so on for multiple pairs of column names. Note that it is valid to do “overlapping” renames like "dbcolrename a…
NAME dbcolpercentile – compute percentiles or ranks for an existing column SYNOPSIS dbcolpercentile [-rplhS] column DESCRIPTION Compute a percentile of a column of numbers. The new column will be called percentile or rank. Non-numeric records are handled as in other programs. If the data is pre-sorted and only a rank is requested, no extra storage…
NAME dbcolneaten – pretty-print columns of Fsdb data (assuming a monospaced font) SYNOPSIS dbcolneaten [-E] [field_settings] DESCRIPTION dbcolneaten arranges that the Fsdb data appears in neat columns if you view it with a monospaced font. To do this, it pads out each field with spaces to line up the next field. Field settings are of…
NAME dbcolmovingstats – compute moving statistics over a window of a column of data SYNOPSIS dbcolmovingstats [-am] [-w window-width] [-e EmptyValue] column DESCRIPTION Compute moving statistics over a COLUMN of data. Records containing non-numeric data are considered null do not contribute to the stats (optionally they are treated as zeros with "-a"). Currently we compute…
NAME dbcolmerge – merge multiple columns into one SYNOPSIS dbcolmerge [-C ElementSeparator] [columns…] DESCRIPTION For each row, merge multiple columns down to a single column, joining elements with ElementSeparator (defaults to a single underscore). OPTIONS -C S or –element-separator S Specify the separator used to join columns. (Defaults to a single underscore.) -e E or…
NAME dbcolize – DEPRICATED, now use dbfilealter Index
NAME dbcolhisto – compute a histogram over a column of Fsdb data SYNOPSIS dbcolhisto [-ag] [-W BucketWidth] [-S BucketStart] [-E BucketEnd] [-N NumberOfBuckets] column DESCRIPTION This program computes a histogram over a column of data. Records containing non-numeric data are considered null do not contribute to the stats (optionally they are treated as zeros). Defaults…
NAME dbcoldefine – define the columns of a plain text file to make it an Fsdb file SYNOPSIS dbcoldefine [-F x] [column…] DESCRIPTION This program writes a new header before the data with the specified column names. It does not do any validation of the data contents; it is up to the user to verify…
NAME dbcolcreate – create new columns SYNOPSIS dbcolcreate NewColumn1 [NewColumn2] or dbcolcreate -e DefaultValue NewColumnWithDefault DESCRIPTION Create columns "NewColumn1", etc. with an optional "DefaultValue". OPTIONS -e EmptyValue or –empty Specify the value newly created columns get. -f or –first Put all new columns as the first columns of each row. By default, they go at…