How to use multicore and multithreads to get maximum capacity of cpu and I/O to speed up Program in c++?

Question

I wrote a c++ program that runs with python multiprocess and multithread. Our input include multiple folders with more than 20000 files in it, We read files from disk and then p