Skip to content

A simple data pipeline with Airflow - Pandas - Postgres

Notifications You must be signed in to change notification settings

Rheagal98/airflow_pipeline

Repository files navigation

A simple data pipeline with Airflow - Pandas - Postgres

  1. Download csv from storage
  2. Process with pandas
  3. Incremental update to Postgres

Installation

  1. Create .env file
  2. Run: docker-compose -f docker-compose.yaml -d --build

About

A simple data pipeline with Airflow - Pandas - Postgres

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published