C# Download data from huge list of urls [duplicate]
问题 This question already has answers here : Mass Downloading of Webpages C# (7 answers) Closed 6 years ago . I have a huge list of web pages which display a status, which i need to check. Some urls are within the same site, another set is located on another site. Right now i'm trying to do this in a parallel way by using code like below, but i have the feeling that i'm causing too much overhead. while(ListOfUrls.Count > 0){ Parallel.ForEach(ListOfUrls, url => { WebClient webClient = new