calling controller(crawler4j-3.5) inside loop

Question

Hi I am calling controller inside for-loop, because I am having more than 100 url, so I am having all in list and I will iterate and crawl

Answer 1

Try:

for(String url : urls) {
    controller.addSeed(url);
}

and override shouldVisit(WebUrl) so that it can't leave the domains.