- selenium
- PHP
- github.com/FriendsOfPHP/Goutte Goutte, a simple PHP Web Scraper
- github.com/symfony/dom-crawler The DomCrawler component eases DOM navigation for HTML and XML documents.
- github.com/symfony/browser-kit The BrowserKit component simulates the behavior of a web browser, allowing you to make requests, click on links and submit forms programmatically.
- github.com/symfony/css-selector The CssSelector component converts CSS selectors to XPath expressions.
- github.com/owner888/phpspider
- Go
- github.com/gocolly/colly Elegant Scraper and Crawler Framework for Golang
- github.com/henrylee2cn/pholcus Pholcus is a distributed, high concurrency and powerful web crawler software.
- github.com/PuerkitoBio/gocrawl Polite, slim and concurrent web crawler.
- github.com/MontFerret/ferret Declarative web scraping