philoushka / largefilesplitter Goto Github PK

All resulted files contained the 1st row of the initial file, located in the beginning of each file.
Great job though! Thanks!

Tried to split a 1.6GB file and got the out of memory exception on a Windows 10 machine with 12 GB RAM.

This project doesn't run under any licence so I don't know if I'm allowed to use it in my location (or workplace).

Hi there. I tried to split a 10000-line file in 10 files getting back files with 1001 lines and the last one with 992.

I put the headers line (10001 lines) but it didn't work.
Afterwards I removed the las line (10000 with headers) and happend the same...

I just tried to split a CSV file saved in Windows-1257 character set, and it distorts data upon saving: each non-ASCII character in the output file was turned into the following UTF-8 character: �. When I load the resulting file as Windows-1257, I see the following three bytes instead of every non-ASCII character: ļæ½.
My guess is that the original file was read and the resulting files were saved as UTF-8, but since the original wasn't in UTF-8 in the first place, every "invalid" character was turned into an U+FFFD REPLACEMENT CHARACTER upon reading, thus killing any hope that the resulting files could be saved correctly.
As far as I know, Excel still doesn't allow saving UTF-8 CSV files, so not supporting 8-bit character sets looks like a serious limitation.