private_crawl

This is crawl for my own requirment, not useful for others

This project contains scrapy scripts, portial scripts and other utils scripts.

依赖库

sudo pip install selenium sudo pip install dateparser sudo pip install xlrd sudo pip install requests

其他说明

scrapy由1.4升级到1.6以后，scrapy.spider包名改为scrapy.spiders了，有些代码里面要改一下