Identifying large bodies of text via BeautifulSoup or other python based extractors

Question

Given some random news article, I want to write a web crawler to find the largest body of text present, and extract it. The intention is to extract the physical news article on

Answer 1

You might look at the python-readability package which does exactly this for you.