Scrapy : storing the data

Question

I\'m new with python and scrapy. I\'m tring to follow the Scrapy tutorial but I don\'t understand the logic of the storage step.

scrapy crawl spidername -o items         


        

Answer 1

--set

Arguments provided by the command line are the ones that take precedence, overriding any other options.

You can explicitly override one (or more) settings using the -s (or --set) command line option.

Example:

    scrapy crawl myspider -s LOG_FILE=scrapy.log

    sets the LOG_FILE settings value to `scrapy.log`

-o

Specifies the output filename and extension WHERE you will write the scraped data to

Examples: 
    scrapy crawl quotes -o items.csv
    scrapy crawl quotes -o items.json
    scrapy crawl quotes -o items.xml

-t

Specifies the serialisation format or HOW the items are written

https://www.tutorialspoint.com/scrapy/scrapy_settings.htm