I am currently using a spider to scrape the pages of 25 domains. To prevent being too much of a burden for these domains, I enabled throttling. This results in a spider that
