I am scraping a website using Scrapy which require cooking and java-script to be enabled. I don\'t think I will have to actually process javascript. All I need is to pretend as
Scrapy doesn't support java script.
but
you can use some other library with Scrapy for executing JS , like Webkit, Selenium etc,
and you don't needs to enable cookies (COOKIES_ENABLED = True
), not even required to add DOWNLOADER_MIDDLEWARES
in your settings.py
because they are already available in default scrapy settings