Huge memory comsuming while using Python multiprocessing pool

Question

When I use the multiprocessing in the python, I always meet the trouble of memory issue.Below is the code that I wrote:

1. I have many many files need to process,