A nodejs module for cleaning up CSV files in a nice streaming parser.

Trims white space, changes delimiter to another one, remove spaces.

Unix pipe a file straight into the CleanSV and select an -filename name

cat myfile.csv | node CleanSV -f clean.csv

Usage

  Usage: CleanSV.js [options]

  Options:

    -h, --help                   output usage information
    -V, --version                output the version number
    -f, --filename [type]        Filename to pipe into
    --nt, --noTrim <columns>     Columns not to Trim
    --od, --outputDelim [delim]  The output delimiter
    --rq, --removeQuotes         Remove all quotes

Take a csv file

A,B,C
  fred,XX,  X
lisa  ,X   X,    X

• fred & lisa in column A has a space at the beginning - we want that trimmed.
• the Xs in columns B & C we want to keep as the spaces are important to the data.

So ...

cat myfile.csv | node CleanSV -f clean.csv --nt B,C

Cat myfile.csv piped into CleanSV

• The output filename is clean.csv (-f clean.csv)
• We don't want to trim column B and C (--nt B,C)

The resulting output file (clean.csv)

A,B,C
fred,XX,  X
list,X   X,    X