cl.exe' failed: No such file or directory when installing Scrapy

Question

I\'m trying to install Scrapy framework. After installing all dependent libraries and start installing setup.py file, I get this error message: \"cl.exe\' failed: No such fi

Answer 1

As it is said in the scrapy documentation, it is recommended to install scrapy on Windows with Anaconda. It's a virtualenv, so it will make a clean install of scrapy on your system, and all the dependencies will be automatically installed.

Once Anaconda is installed you enter this cmd in your console: conda install -c conda-forge scrapy and you should be fine.

Hope this helps.

Answer 2

I've met the same problem after I installed the latest version of Visual Studio. Here's the solution that worked out in the end:

1. Visit: http://www.lfd.uci.edu/~gohlke/pythonlibs/

2. Download the correct version of Twisted and Lxml accordingly (your python version system version).

3. pip install twisted and lxml before pip install scrapy

Answer 3

According to the documentation

you need to install:

• Twisted 14.0
• lxml 3.4
• pyOpenSSL 0.14

so run :

pip3 install Twisted==14.0 lxml pyOpenSSL Scrapy

Answer 4

cl.exe is the Microsoft C/C++ compiler (included in MS Visual C++ / MS Visual Studio.)

Either you don't have it, or it is not in your PATH environment variable.

You may search for it in your computer (e.g. with help of the very efficient free program Everything) and then add it to your PATH variable (you may use the free program Rapid Environment Editor).

Then prepare your environment by launching vcvarsall.bat batch file (see this answer) and you will be ready to reinstalling Scrapy.