Shell command to split large file into 10 smaller files

Question

I have a csv import file with 33 million lines that need to be imported into my database. I can import it with a C# console app but then the stored procedures that run after the

Answer 1

Use split - e.g. to split a file every 3.4 million lines (should give you 10 files):

split -l 3400000

$ man split

Answer 2

splitting by line is good however you can also split by size

creates 1MB files out of the original

split -b 1024k <file_name> 

creates 1GB files out of original

split -b 1024m <file_name>

Answer 3

The version of split in coreutils 8.8 (not yet released) will have the command

split -n l/10

For now you'll need to specify a particular number of lines per file

Answer 4

If your csv file have 500 rows to split two part(250+250)

download and install "Cygwin Terminal"

put comment "split -l 250 filename.csv"