Skip to content

Automating A Music Streaming Data Pipeline using Apache Airflow.

Notifications You must be signed in to change notification settings

Naleliwi/DEND_Airflow-Project

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 

Repository files navigation

Automated Data Pipeline for Sparkify Data

About

Sparkify is a fictional music application that store songs and users' activity logs in separate JSON files resides in S3 Bucket. When the application started to grow, it becomes extremely difficult for the company to handle and benefit from these files. The suggested solution is to start investing in Apache Airflow

Final DAG will look like this

example-dag

About

Automating A Music Streaming Data Pipeline using Apache Airflow.

Topics

Resources

Stars

Watchers

Forks

Languages