Split a large json file into multiple smaller files

前端 未结 4 1420
臣服心动
臣服心动 2021-02-04 08:21

I have a large JSON file, about 5 million records and a file size of about 32GB, that I need to get loaded into our Snowflake Data Warehouse. I need to get this file broken up i

4条回答
  •  慢半拍i
    慢半拍i (楼主)
    2021-02-04 08:31

    Use this code in linux command prompt

    split -b 53750k 
    cat xa* > 
    

    Refer to this link: https://askubuntu.com/questions/28847/text-editor-to-edit-large-4-3-gb-plain-text-file

提交回复
热议问题