Airflow-Tutorial

My own Document

• Install-and-setup-Airflow-with-virtual-environment
• Introduction-to-Airflow
• Anatomy-of-Airflow-and-Airflow-DAG
• Scheduling-Airflow

Setting up

Create virtual environment

conda create -n airflow-tutorial python=3.8 -y 
conda activate airflow-tutorial

Install airflow with specific version and its constraints

pip install apache-airflow==2.2.3 --constraint constraints-no-providers.txt

Setup Airflow

Create Airflow databases

airflow db init

Expected output: ~/airflow/ folder

Set Airflow home: Airflow need a home with ~/airflow is default.

export AIRFLOW_HOME=~/airflow

Create user

airflow users create --username admin --password admin --firstname Nathan --lastname Ngo --role Admin --email [email protected]

Start Airflow

airflow webserver -p 8080
airflow scheduler