How to send JavaScript and Cookies Enabled in Scrapy?

后端 未结 3 976
深忆病人
深忆病人 2021-02-08 19:57

I am scraping a website using Scrapy which require cooking and java-script to be enabled. I don\'t think I will have to actually process javascript. All I need is to pretend as

3条回答
  •  無奈伤痛
    2021-02-08 20:09

    Scrapy doesn't support java script.

    but

    you can use some other library with Scrapy for executing JS , like Webkit, Selenium etc,

    and you don't needs to enable cookies (COOKIES_ENABLED = True), not even required to add DOWNLOADER_MIDDLEWARES in your settings.py because they are already available in default scrapy settings

提交回复
热议问题