cURL allows you to create an array of cURL requests you want to download concurrently and as each one returns, you can add more URLs to that array. In doing so, you can limit th