unknown command: crawl error

Question

I am a newbie to python. I am running python 2.7.3 version 32 bit on 64 bit OS. (I tried 64 bit but it didn\'t workout).

I followed the tutorial and installed scrapy on

Answer 1

If you have already an existing project and suddenly this error "Scrapy 1.3.3 - no active project" came, in my case when I open my project, I cant see the scrapy.cfg file. What I did was, I just made some little changes on my project like removing some extra line and deployed it from github to instance and it worked!

Answer 2

You can run scrapy crawl demoz code from your scrapy project folder which you have created using following command

scrapy startproject tutorials

For example, if you have started scrapy project of name tutorials, then go to tutorials folder first and run crawl command from there

scrapy crawl demoz

Answer 3

You should run scrapy crawl spider_name command being in a scrapy project folder, where scrapy.cfg file resides.

From the docs:

Crawling

To put our spider to work, go to the project’s top level directory and run:

scrapy crawl dmoz