Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unpin dbt-databricks version #1379

Open
pankajastro opened this issue Dec 10, 2024 · 0 comments
Open

Unpin dbt-databricks version #1379

pankajastro opened this issue Dec 10, 2024 · 0 comments
Labels
area:dependencies Related to dependencies, like Python packages, library versions, etc

Comments

@pankajastro
Copy link
Contributor

dbt-databricks has pin the pydantic https://github.com/databricks/dbt-databricks/blob/main/pyproject.toml#L33-L33

Added in PR: databricks/dbt-databricks#843

But the newer version of Airflow requires pydantic 2.0.

For Airflow < 2.8 working fine: https://github.com/astronomer/astronomer-cosmos/actions/runs/12259335118/job/34201293598

Scope of this issue to unpin dbt-databricks version which is done in PR: #1376
@dosubot dosubot bot added the area:dependencies Related to dependencies, like Python packages, library versions, etc label Dec 10, 2024
@tatiana tatiana mentioned this issue Dec 10, 2024
Merged
tatiana pushed a commit that referenced this issue Dec 10, 2024
@pankajastro
Pin dbt-databricks version to < 1.9 (#1376)
a735b16 
Our CI is broken due to a `dbt-databricks` release with conflicting
dependencies with `Airflow>=2.8`.

The latest release of`dbt-databricks` has pinned the Pydantic to
`"pydantic>=1.10.0, <2"`
https://github.com/databricks/dbt-databricks/blob/main/pyproject.toml#L33-L33

This change was added in PR:
databricks/dbt-databricks#843 and released on 9
December as part of `dbt-databricks==1.9.0`
(https://pypi.org/project/dbt-databricks/1.9.0/).

The `debt-data bricks` conflicts with the neAirflow version, which that
requires Pydantic 2.0.

For Airflow < 2.8, things work as expected:
https://github.com/astronomer/astronomer-cosmos/actions/runs/12259335118/job/34201293598.

In this PR, I'm pinning dbt-databricks version to < 1.9 to make CI green
again.

Follow-up PR:
#1379
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
area:dependencies Related to dependencies, like Python packages, library versions, etc
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@pankajastro