I have a project which I have to crawl into all web pages having same domain how can I crawl them with running my cone only once so far I have come up with a code using bs
