Upgrade airflow to 1.10.14

Includes necessary configuration changes related to Airflow upgrade

The Main Event

Switch a few defaults from master to main

Don't unset variables, attempt 2

Different strategy for not deleting airflow variables before updating them:

• exporting exist variables to a json file with airflow cli
• merging with airflow variables defined in the playbook
• saving merged variables to json file,
• import the merged json file with airflow cli

Allow dag deploys to be skipped

If a dag repo does not have a branch defined, or if it is deifned as "", the deployment of that dag repo will be skipped.

Fix json variables

Release Notes:

• Add to_json filter to Airflow variables

Update Airflow variable management

Release Notes:

• Refactors existing airflow variables to save to a tmp file
• Removes the task where we delete all variables
• Creates new task to merge existing airflow variables with new variables

Do not checkout submodules

Merge pull request #32 from tulibraries/do-not-clone-dags-recursively

Do not clone dag repos submodules.

JUst like v0.1.0, but different

Ansible Galaxy is being wonky...maybe because we forked this repo?

Dag repo indirection

Changes

Use 'is' instead of | for managing airflow installation.

Breaking Changes

Adds a layer of indirection for dag repositories that could break existing installations.

• dag repositories are cloned to a "dags_repos" directory, and then symlinked to the working dags directory picked up by airflow. By default, the root of each dag repository is linked to the dags directory, but you can also specify a sub-directory within the each dag repo. This allows more flexibility in how dag repos are structured, not requiring all dags to be in the root of the project,

Repairs to airflow home variables

v0.0.14

Add back python2