Using Concurrent Futures without running out of RAM

Question

I\'m doing some file parsing that is a CPU bound task. No matter how many files I throw at the process it uses no more than about 50MB of RAM. The task is parrallelisable, and I

Answer 1

you can try add del to your code like this

for job in futures.as_completed(jobs):
    del jobs[job]
    del job #or job._result = None