Cannot Set Up a Scrapy Project

Question

I type this into the terminal:

$ scrapy startproject tutorial

I cannot get it to start a new scrapy project, and I keep installing all the

Answer 1

ImportError: dlopen(/Users/carterdavis/anaconda/lib/python2.7/site-packages/OpenSSL/crypto.so, 10):Library not loaded: libssl.1.0.0.dylib

According to the error message above, is there libssl package installed in your OS? If you are using Ubuntu(or Debian), try to execute there command:

apt-get install libssl1.0.0

Answer 2

Looks like you are using Anaconda - I had the same problem and this fixed it (tested on OS X 10.9 and 10.10).

First pip uninstall scrapy if you have it installed.

Use conda to install cryptography:

conda install cryptography

Set the DYLD_LIBRARY_PATH environment variable:

export DYLD_LIBRARY_PATH=$HOME/anaconda/lib

Then install scrapy again

pip install scrapy

Answer 3

This is a problem of cryptography installation, try installing crytography again, which includes installation of OpenSSL also. And your project will starts working with this. Follow these steps.

For Debian and Ubuntu

$ sudo apt-get install build-essential libssl-dev libffi-dev python-dev

For Fedora and RHEL-derivatives

$ sudo yum install gcc libffi-devel python-devel openssl-devel

After installing this, you should now be able to build and install cryptography with the usual

$ pip install cryptography

After this, try creating your scrapy project.