A Web Scraper that uses Python3 and Scrapy to scrape Quotes To Scrape.
Includes 2 spiders:
- quotes-spider crawls and retrieves all quotes with the author and tags.
- author-spider crawls and retrieves all author details including name, DOB and description.
- Python 3.x
- Scrapy
scrapy crawl quote-spider > quotes.json
scrapy crawl author-spider > authos.json
Example output JSON files are here.
Example output has been beautified with JSON Lint for readability.
Working of this web scraper depends on the source at Quotes To Scrape.
Foundation for this scraper can be found here.