dbfilestripcomments – remove comments from a fsdb file Synopsisdbfilestripcomments [-h] DescriptionRemove any comments in a file, including the header. This makes the file unreadable by other Fsdb utilities, but perhaps more readable by humans. With the -h option, leave the header. Options-h or –header Retain the header. This module also supports the standard fsdb options:…
dbfilepivot – pivot a table, converting multiple rows into single wide row Synopsisdbfilepivot [-e empty] -k KeyField -p PivotField [-v ValueField] DescriptionPivot a table, converting multiple rows corresponding to the same key into a single wide row. In a normalized database, one might have data with a schema like (id, attribute, value), but sometimes it’s…
dbfilediff – compare two fsdb tables Synopsis dbfilediff [-Eq] [-N diff_column_name] –input table1.fsdb –input table2.fsdbOR cat table1.fsdb | dbfilediff [-sq] –input table2.fsdbDescriptionDbfilediff compares two Fsdb tables, row by row. Unlike Unix diff(1), this program assumes the files are identical line-by-line and we compare fields. Thus, insertion of one extra row will result in all subsequent…
dbfilecat – concatenate two files with identical schema Synopsis dbfilecat –input A.fsdb [–input B.fsdb…]or echo A.fsdb | dbfilecat –xargsDescriptionConcatenate all provided input files, producing one result. We remove extra header lines. Inputs can both be specified with "–input", or one can come from standard input and the other from "–input". With "–xargs", each line of…
dbfilealter – alter the format of an Fsdb file, changing the row/column separator Synopsisdbfilealter [-c] [-F fs] [-R rs] [-Z compression] [column…] DescriptionThis program reformats a Fsdb file, altering the row ("-R rs") or column ("-F fs") separator. It verifies that this action does not violate the file constraints (for example, if spaces appear in…
dbfdump.pl – Dump the record of the dbf file Format dbfdump.pl [options] fileswhere options are –rs output record separator (default newline) –fs output field separator (default colon) –fields comma separated list of fields to print (default all) –undef string to print for NULL values (default empty) –memofile specifies unstandard name of attached memo file –memosep…
dbench – Measure disk throughput for simulated netbench run Synopsisdbench [options]numclients tbench [options]numclientsserver tbench_srv [options] DescriptionThis manual page documents briefly the dbench and tbench benchmarks. This manual page was written for the Debian GNU/Linux distribution because the original program does not have a manual page. However, it has fairly easy to read source code. Netbench…
dbcolstatscores – compute z-scores or t-scores for each value in a population Synopsisdbcolstatscores [-t] [–tmean=MEAN] [–tstddev=STDDEV] column DescriptionCompute statistics (z-score and optionally t-score) over a COLUMN of numbers. Creates new columns called “zscore”, “tscore”. T-scores are only computed if requested with the "-t" option, or if "–tmean" or "–tstddev" are explicitly specified (defaults are mean…
dbcolstats – compute statistics on a fsdb column Synopsisdbcolstats [-amS] [-c ConfidenceFraction] [-q NumberOfQuantiles] column DescriptionCompute statistics over a COLUMN of data. Records containing non-numeric data are considered null do not contribute to the stats (with the "-a" option they are treated as zeros). Confidence intervals are a t-test (+/- (t_{a/2})*s/sqrt(n)) and assume the population…
dbcolsregression – compute linear regression between two columns Synopsis dbcolsregression [-a] column1 column2DescriptionCompute linear regression over "column1" and "column2". Outputs slope, intercept, and correlation coefficient. Options-a or –include-non-numeric Compute stats over all records (treat non-numeric records as zero rather than just ignoring them). -f FORMAT or –format FORMAT Specify a printf(3)-style format for output statistics….
dbcolsplittorows – split an existing column into multiple new rows Synopsisdbcolsplittorows [-C ElementSeperator] [-e null] [-E] [-N enumerated-name] column [column…] DescriptionSplit column into pieces, outputting one row for each piece. By default, any empty fields are ignored. If an empty field value is given with -e, then they produce output. When a null value is…
dbcolsplittocols – split an existing column into multiple new columns Synopsisdbcolsplittocols [-E] [-C ElementSeparator] column [column…] DescriptionCreate new columns by splitting an existing column. The fragments of the column are each divided by ElementSeparator (default is underscore). This command is the opposite of dbcolmerge. Names of the new columns are given by splitting the name…
dbcolscorrelate – find the coefficient of correlation over columns Synopsis dbcolscorrelate column1 column2 [column3…]DescriptionCompute the coefficient of correlation over two (or more) columns. The output is one line of correlations. With exactly two columns, a new column correlation is created. With more than two columns, correlations are computed for each pairwise combination of rows, and…
dbcolrename – change the names of columns in a fsdb schema Synopsisdbcolrename OldName1 NewName1 [OldName2 NewName2] … DescriptionDbcolrename changes the names of columns in a fsdb schema, mapping OldName1 to NewName1, and so on for multiple pairs of column names. Note that it is valid to do “overlapping” renames like "dbcolrename a b b a"….
dbcolpercentile – compute percentiles or ranks for an existing column Synopsis dbcolpercentile [-rplhS] columnDescriptionCompute a percentile of a column of numbers. The new column will be called percentile or rank. Non-numeric records are handled as in other programs. If the data is pre-sorted and only a rank is requested, no extra storage is required. In…
dbcolneaten – pretty-print columns of Fsdb data (assuming a monospaced font) Synopsisdbcolneaten [-E] [field_settings] Descriptiondbcolneaten arranges that the Fsdb data appears in neat columns if you view it with a monospaced font. To do this, it pads out each field with spaces to line up the next field. Field settings are of the form field…
dbcolmovingstats – compute moving statistics over a window of a column of data Synopsisdbcolmovingstats [-am] [-w window-width] [-e EmptyValue] column DescriptionCompute moving statistics over a COLUMN of data. Records containing non-numeric data are considered null do not contribute to the stats (optionally they are treated as zeros with "-a"). Currently we compute mean and sample…
dbcolmerge – merge multiple columns into one Synopsisdbcolmerge [-C ElementSeparator] [columns…] DescriptionFor each row, merge multiple columns down to a single column, joining elements with ElementSeparator (defaults to a single underscore). Options-C S or –element-separator S Specify the separator used to join columns. (Defaults to a single underscore.) -e E or –empty E give value…
dbcolize – DEPRICATED, now use dbfilealter
dbcolhisto – compute a histogram over a column of Fsdb data Synopsisdbcolhisto [-ag] [-W BucketWidth] [-S BucketStart] [-E BucketEnd] [-N NumberOfBuckets] column DescriptionThis program computes a histogram over a column of data. Records containing non-numeric data are considered null do not contribute to the stats (optionally they are treated as zeros). Defaults to 10 buckets…