Skip to content

omniscrapper/omni_scrapper_demo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Omni Scrapper demo

Very basic demo of omni_scrapper

It illustrates how to create a simple scrapper in several lines of DSL. This demo uses gallery crawler, which implements simple pagination logic through a list of items.

Usage

Install all dependencies

bundle install

Start scrapping

./start main

Keep an eye on stdout for scrapping results.

Dockerized

  • docker build -t omniscrapper/demo .
  • docker run omniscrapper/demo

About

Simple demo illustrating how to use omniscrapper gem

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages