Keep list of scrapped pages

[Mehonoshin]

To prevent multiple visits to the same page during the same scrapper run, we need to keep track of already visited pages and ignore them on subsequent visits.