This repo hosts a tool for scraping URLs added to a Google Sheet. Researchers can conveniently add URLs to a Google Sheet. The tool uses GitHub Actions and Google Sheets API to regularly get the URLs added to the Google Sheet, check if they're already in the data file, and, if not, scrape them and store the source code in the data file. As such, this tool makes it easy and fast for researchers to automatically request a website to be scraped. I built this tool for a project as part of my work at Research Computing and Data Services.
-
Notifications
You must be signed in to change notification settings - Fork 0
emiliolehoucq/web_scraping_tool
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Tool for scraping websites added to a Google Sheet
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published