Udacity Data Engineering Nanodegree

About

This Repo holds all exercises that are part of this online nanodegree

Data Engineering comprises all engineering and operational tasks required to make data available for the end-user, wether for the purposes of analytics, model building or app development.

This online class teaches how to solve common data engineering tasks:

• ingest data from a data source
• build and maintain a data warehouse
• create a data pipeline
• creat an analytics table for a specific use case
• migrate data to the cloud
• schedule and automate pipelines
• backfill data
• debug data quality issues
• optimize queries
• design a database

Chapters

Data Modeling

• Summary Relational Data Modeling
• Relational Data Modeling Project
• Summary NoSQL Data Modeling
• NoSQL Data Modeling Project

Cloud Data Warehouses

• What is a Data Warehouse
• Data Warehouse Architectures
• Olap Cubes
• Redshift Basics
• Data Warehouse Project

Data Lakes with Spark

• Spark Basics
• Run Spark locally with Docker
• Data Lake explained
• Data Lake Project

Data Pipelines with Airflow

• Data Pipelines explained with Airflow
• Data Pipelines Project

Capstone Project