nodejs running out of memory processing csv files

Question

I\'ve read through a number of SO questions about nodejs running out of memory, but I haven\'t seen anything that sounds similar to my situation.

I\'m trying to process

Answer 1

1. The script is not exiting cause you have an open connection to mongoose, after all the files has been processed you should close the connection and the script will finish.

2. You have the right Idea of using streams but i think you missed something on the way, I suggest you the following article to update the streamInterface, and events. https://coderwall.com/p/ohjerg/read-large-text-files-in-nodejs

3. An other source of problem could be the mongodb, it seems you make a lot of inserts, it could be related with the max i/o of mongodb that exhaust the memory.