Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pin dbt-databricks version to < 1.9 #1376

Merged
merged 8 commits into from
Dec 10, 2024
Merged

Pin dbt-databricks version to < 1.9 #1376

merged 8 commits into from
Dec 10, 2024

Conversation

pankajastro
Copy link
Contributor

@pankajastro pankajastro commented Dec 10, 2024

Our CI is broken due to a dbt-databricks release with conflicting dependencies with Airflow>=2.8.

The latest release ofdbt-databricks has pinned the Pydantic to "pydantic>=1.10.0, <2" https://github.com/databricks/dbt-databricks/blob/main/pyproject.toml#L33-L33

This change was added in PR: databricks/dbt-databricks#843 and released on 9 December as part of dbt-databricks==1.9.0 (https://pypi.org/project/dbt-databricks/1.9.0/).

The debt-data bricks conflicts with the neAirflow version, which that requires Pydantic 2.0.

For Airflow < 2.8, things work as expected: https://github.com/astronomer/astronomer-cosmos/actions/runs/12259335118/job/34201293598.

In this PR, I'm pinning dbt-databricks version to < 1.9 to make CI green again.

Follow-up PR: #1379

Copy link

cloudflare-workers-and-pages bot commented Dec 10, 2024

Deploying astronomer-cosmos with  Cloudflare Pages  Cloudflare Pages

Latest commit: 487a6fd
Status: ✅  Deploy successful!
Preview URL: https://b9b27ba2.astronomer-cosmos.pages.dev
Branch Preview URL: https://fix-1375.astronomer-cosmos.pages.dev

View logs

Copy link

codecov bot commented Dec 10, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 96.06%. Comparing base (fddc37f) to head (487a6fd).
Report is 4 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1376      +/-   ##
==========================================
+ Coverage   96.02%   96.06%   +0.04%     
==========================================
  Files          67       67              
  Lines        4025     4042      +17     
==========================================
+ Hits         3865     3883      +18     
+ Misses        160      159       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@pankajastro pankajastro changed the title Repoduce-1375 Pin dbt-databricks version to < 1.9 Dec 10, 2024
pyproject.toml Outdated Show resolved Hide resolved
pyproject.toml Outdated Show resolved Hide resolved
@pankajastro pankajastro marked this pull request as ready for review December 10, 2024 16:04
@dosubot dosubot bot added size:XS This PR changes 0-9 lines, ignoring generated files. area:ci Related to CI, Github Actions, or other continuous integration tools area:dependencies Related to dependencies, like Python packages, library versions, etc labels Dec 10, 2024
pyproject.toml Outdated Show resolved Hide resolved
Copy link
Collaborator

@tatiana tatiana left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing this and creating the follow up ticket, @pankajastro ! Happy for this to be merged once the checks pass.

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Dec 10, 2024
@tatiana tatiana merged commit a735b16 into main Dec 10, 2024
64 checks passed
@tatiana tatiana deleted the fix-1375 branch December 10, 2024 16:47
@pankajastro pankajastro added this to the Cosmos 1.8.0 milestone Dec 10, 2024
@pankajastro pankajastro self-assigned this Dec 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:ci Related to CI, Github Actions, or other continuous integration tools area:dependencies Related to dependencies, like Python packages, library versions, etc lgtm This PR has been approved by a maintainer size:XS This PR changes 0-9 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants