scrapyd-deploy

Scrapyd-Deploy: SPIDER_MODULES not found

♀尐吖头ヾ 提交于 2020-08-09 17:19:34
问题 I am trying to deploy a scrapy 2.1.0 project with scrapy-deploy 1.2 and get this error: scrapyd-deploy example /Library/Frameworks/Python.framework/Versions/3.8/bin/scrapyd-deploy:23: ScrapyDeprecationWarning: Module `scrapy.utils.http` is deprecated, Please import from `w3lib.http` instead. from scrapy.utils.http import basic_auth_header fatal: No names found, cannot describe anything. Packing version r1-master Deploying to project "crawler" in http://myip:6843/addversion.json Server

Scrapyd-Deploy: Errors due to using os path to set directory

蓝咒 提交于 2020-06-28 05:26:05
问题 I am trying to deploy a scrapy project via scrapyd-deploy to a remote scrapyd server. The project itself is functional and works perfectly on my local machine and on the remote server when I deploy it via git push prod to the remote server. With scrapyd-deploy I get this error: % scrapyd-deploy example -p apo { "node_name": "spider1", "status": "error", "message": "/usr/local/lib/python3.8/dist-packages/scrapy/utils/project.py:90: ScrapyDeprecationWarning: Use of environment variables