Spring batch Multithreaded processing for Single file to Multiple FIle

Question

My problem statement. Read a csv file with 10 million data and store it in db. with as minimal time as possible.

I had implemented it using Simple multi threaded

Answer 1

You can split your input file to many file , the use Partitionner and load small files with threads, but on error , you must restart all job after DB cleaned.

Full example code (on Github).

Hope this help.