Skip to content

tschumann/scrape

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

68 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

scrape

scrape is a website downloader in less than 300 lines of Python.

It recursively downloads all pages, images, scripts, stylesheets and favicons on the same domain as the initially provided URL.

Usage

python scrape.py https://example.com -v

Installation

pip install pipenv
pipenv install

Running tests

python tests.py