I am trying to save the output of the scrapy crawl command I have tried scrapy crawl someSpider -o some.json -t json >> some.text But it doesn\'t worked ...c
scrapy crawl someSpider -o some.json -t json >> some.text
You can save as log file:
scrapy crawl someSpider -s LOG_FILE=fileName.log -L
loglevel can be one between CRITICAL, ERROR, WARNING, INFO and DEBUG or --nolog for no log. for more information read Doc.
CRITICAL
ERROR
WARNING
INFO
DEBUG
--nolog