Araneid

Doc: English Chinese

Features

.. todolist::
    .. todo::
       Supports multiple protocols including short connections (HTTP protocol) and long connections (real-time) (WebSocket, Socket protocol) for data collection.
    .. todo::
       Full asyncio support
    .. todo::
       Provides a more user-friendly request concurrency control.
    .. todo::
       Offers comprehensive and high-performance signal processing support.

Introduction

Aranied is designed to be a highly intergrated, configurable, and out of box crawler framework for data.

Requiement

• >=python3.7

Install

Simple example

> The sample code can be checkout at：[demo/GoogleSpider.py](https://github.com/WALL-EEEEEEE/araneid/blob/master/demo/GoogleSpider.py)

Details

Detail usages please refer to: [Document](https://github.com/WALL-EEEEEEE/araneid/blob/master/doc/zh_cn/Start.md)