python - CSV Exports - Ordering of columns using scrapy crawl -o output.csv

Question

Is there a way to specify the order of the columns in a CSV output using the -o parameter?

It seems to follow a random order and does not follow the order in the items.py file or when the item fields get populated in the scrape.

Thanks!

Answer 1

There is a relevant field_to_export attribute in CsvItemExporter, but, as far as I understand, there is no way to set it from the command-line. You need to do it through the pipeline, see:

• How can I use the fields_to_export attribute in BaseItemExporter to order my Scrapy CSV data?