data crawled is repeated when exporting to csv

Question

I am trying to crawl the data from this web
My idea is crawling all the links on the web, then use for to send the request to each link to get the detailed dat