Docker container keeps growing

Question

I have a pyhton script that on a loop

1. Downloads video chunks from AWS S3 to /filename
2. Sorts files in order and concats them.
3. Uploads entire

Answer 1

I would suggest you to use volumes, and mount these volumes in your containers. Changes on volumes are instantaneous, as opposed to changes made to the containers filesystem (which is not really removed until you delete the container).

Have a look at the docs here