How to split large csv file using dask

Question

I am trying to use dask in order to split a huge tab-delimited file into smaller chunks on an AWS Batch array with 100,000 cores.

Each core has a unique envi