Skip to content

cortext/cortext-pytheas-tweets

 
 

Repository files navigation

Pytheas_tweet

Simple web interface to download tweets without the use of API (only historical HTML flux from twitter.com/search)

based on :

  • twitterscrap
  • flask
  • request
  • bs4

next to do :

  • processing db
  • documentation
  • parse more filters

how to use ?

  • create docker-compose.yaml && conf/conf.json (with credentials) from example files

with docker and docker-compose

  1. first git clone this repo
git clone --recursive https://github.com/cortext/cortext-pytheas-tweets.git
  1. run docker
docker build -t cortext/cortext_pytheas . && docker-compose up 

with virtualenv and python

  1. Locally you can also more easily (and to debug principaly) directly create a virtualenv with python 3.x
virtualenv env3 -p /usr/bin/python3 && source ./env3/bin/activate
  1. Then install dependancies :
pip install -r requirements.txt
git clone https://github.com/ikario404/twitterscraper.git
cd twitterscraper && python setup.py install && cd ..
  1. Finally :
python app.py

About

webtool to download csv/json from twitter historical feed

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 55.4%
  • HTML 44.2%
  • Shell 0.4%