How to scrap text included between various tags using scrapy

Question

I am trying to scrap product description from this link. But how do i scrap the whole text including text between tags. Here is the hxs object hxs.select(\'/

Answer 1

Try taking whole content from tag with

 //div[@class="overview"]/div

and then you can remove tags from it with regex or leave them if they are not a problem.

Something like this regex:

 re.sub('<[^>]*>', '', mystring)