feat(airflow): drop Airflow < 2.3 support + make plugin v2 the default

[hsheth2]

Why is it ok to drop Airflow < 2.3?

• Airflow itself doesn't have much in its docs https://airflow.apache.org/docs/apache-airflow/stable/installation/supported-versions.html, but seems to assume you're on the latest e.g. Airflow 2.10
• GCP composer says support for airflow 2.2.5 ended on March 13, 2024 https://cloud.google.com/composer/docs/concepts/versioning/composer-versions#images-composer-1
• AWS MWAA ended support for airflow 2.2.2 on June 27, 2024 https://docs.aws.amazon.com/mwaa/latest/userguide/airflow-versions.html#airflow-versions-official
• Our own telemetry indicates that the Airflow plugin is used with Airflow 2.2 extremely rarely, and almost never with Airflow 2.1.

Why do we want to do this?
This will let us make the DataHub plugin v2 the default version. Specifically, the v2 plugin dependencies will be part of the base requirements and not an extra. This should significantly increase the v2 plugin adoption, and is pretty safe since we already have tons of folks using it successfully in prod - based on both telemetry and anecdotal evidence.

For now the v1 plugin remains, and can be activated by setting the DATAHUB_AIRFLOW_PLUGIN_USE_V1_PLUGIN=true env variable. However, the goal is to drop the v1 plugin in the future.

Checklist

• The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
• Links to related issues (if applicable)
• Tests for the changes have been added/updated (if applicable)
• Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
• For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

[github-actions]

[actionlint] _{reported by reviewdog 🐶}
the runner of "actions/upload-artifact@v3" action is too old to run on GitHub Actions. update the action's version to fix this issue [action]

datahub/.github/workflows/airflow-plugin.yml

Line 72 in bdc19b9

- uses: actions/upload-artifact@v3

[github-actions]

[actionlint] _{reported by reviewdog 🐶}
the runner of "codecov/codecov-action@v3" action is too old to run on GitHub Actions. update the action's version to fix this issue [action]

datahub/.github/workflows/airflow-plugin.yml

Line 83 in bdc19b9

uses: codecov/codecov-action@v3

[github-actions]

[actionlint] _{reported by reviewdog 🐶}
the runner of "actions/upload-artifact@v3" action is too old to run on GitHub Actions. update the action's version to fix this issue [action]

datahub/.github/workflows/airflow-plugin.yml

Line 96 in bdc19b9

uses: actions/upload-artifact@v3