Encoding: WINDOWS-1252 (Western)
convert encoding:
$ iconv -f WINDOWS-1252 -t UTF-8 $(file).csv > utf-8_$(file).csv
load csv file with csv_sniffer():
$ python3 createTB.py
save db as parquet:
load parquet into postgresql:
Delimiter | Quote | Escape | NewLineDelimiter | SkipRows | HasHeader | Columns | DateFormat | TimestampFormat | UserArguments | Prompt |
---|---|---|---|---|---|---|---|---|---|---|
, | " | " | \n | 0 | true | {'Datasheets': 'VARCHAR', 'Image': 'VARCHAR', 'Digi-Key Part Number': 'VARCHAR', 'Manufacturer Part Number': 'VARCHAR', 'Manufacturer': 'VARCHAR', 'Description': 'VARCHAR', 'Quantity Available': 'BIGINT', 'Factory Stock': 'BIGINT', 'Unit Price (USD)': 'VARCHAR', '@ qty': 'BIGINT', 'Minimum Quantity': 'BIGINT', 'Packaging': 'VARCHAR | FROM read_csv('trans.csv', auto_detect=false, delim=',', quote='"', escape='"', new_line='\n', skip=0, header=true, columns={'Datasheets': 'VARCHAR', 'Image': 'VARCHAR', 'Digi-Key Part Number': 'VARCHAR', 'Manufacturer Part Number': 'VARCHAR', 'Manufacturer': 'VARCHAR', 'Description': 'VARCHAR', 'Quantity Available': 'BIGINT', 'Fac |