Skip to content

Latest commit

 

History

History
17 lines (12 loc) · 440 Bytes

README.md

File metadata and controls

17 lines (12 loc) · 440 Bytes

UyghurWebsiteCrawler

simple crawler for some uyghur website such as uy.ts.cn,bbs.bagdax.cn,www.bagdax.cn(using python and scrapy) It is an Amazing work piece.

Preparations:

Python and Scrapy is needed.

Before run this code , please read the Scrapy Docs: http://scrapy.org/

Run

To run the code open the Terminal and run the command some like below(where xxx is your scrapy spider name ):

scrapy crawl xxxx