Very basic demo of omni_scrapper
It illustrates how to create a simple scrapper in several lines of DSL.
This demo uses gallery
crawler, which implements simple pagination logic through a list of items.
Install all dependencies
bundle install
Start scrapping
./start main
Keep an eye on stdout for scrapping results.
docker build -t omniscrapper/demo .
docker run omniscrapper/demo