We are working on StormCrawler project. We have a special requirement. We need to crawl domains using a depth-first search algorithm. In other words, We need to crawler all URLs