Quotes Scraper Using Scrapy

Intro

A Web Scraper that uses Python3 and Scrapy to scrape Quotes To Scrape.

Includes 2 spiders:

• quotes-spider crawls and retrieves all quotes with the author and tags.
• author-spider crawls and retrieves all author details including name, DOB and description.

Requirements

• Python 3.x
• Scrapy

Usage

scrapy crawl quote-spider > quotes.json
scrapy crawl author-spider > authos.json

Example output JSON files are here.

Caveat

Example output has been beautified with JSON Lint for readability.

Working of this web scraper depends on the source at Quotes To Scrape.

Foundation for this scraper can be found here.