Web data extraction with Scrapy
Up.. Next bunch... I am writing some code with scrapy Framework to fetch and extract some data. I'm new to it! The following code would theoretically have to fetch and extract, however it does not extract the data when I run. I'm using the item class that exists inside the items file. The issue is that the code does not accuse error in the execution, in cmd appears the information of the requests made and tals, but does not download the data and does not save. If someone can you help me and give a light I will be grateful.
1 answers
Hello, try running the command:
scrapy crawl pensador -o pensador.json
It will save the data in a JSON.
But the most correct way to do is to treat the crawled data in the pipelines.py
There you can save to the database. Take a look at the documentation: https://doc.scrapy.org/en/latest/topics/item-pipeline.html