Skip to content

simple crawler for some uyghur website such as uy.ts.cn,bbs.bagdax.cn,www.bagdax.cn(using python and scrapy)

License

Notifications You must be signed in to change notification settings

snehal691/UyghurWebsiteCrawler

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Uyghur_Website_Crawler

simple crawler for some Uyghur website such as uy.ts.cn,bbs.bagdax.cn,www.bagdax.cn (using python and scrapy)

Preparations:

Python and Scrapy is needed.

Before run this code, please read the Scrapy Docs: http://scrapy.org/

Run

To run the code open the Terminal and run the commond some like below(where xxx is your scrapy spider name ):

scrapy crawl xxxx

About

simple crawler for some uyghur website such as uy.ts.cn,bbs.bagdax.cn,www.bagdax.cn(using python and scrapy)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%