Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix DbtTestLocalOperator when using on_warning_callback #558

Merged
merged 7 commits into from
Sep 27, 2023
Merged

Conversation

tatiana
Copy link
Collaborator

@tatiana tatiana commented Sep 26, 2023

Since 1.1.0, the on_warning_callback functionality no longer works. It worked on 1.0.5

Closes: #549
Closes: #545 (the fix was necessary to make the on_warning_callback test pass)

Co-authored-by: Edgaras Navickas [email protected]
Co-authored-by: Marco Yuen [email protected]

@tatiana tatiana requested a review from a team as a code owner September 26, 2023 22:39
@tatiana tatiana requested a review from a team September 26, 2023 22:39
@netlify
Copy link

netlify bot commented Sep 26, 2023

👷 Deploy Preview for amazing-pothos-a3bca0 processing.

Name Link
🔨 Latest commit 9f77ea0
🔍 Latest deploy log https://app.netlify.com/sites/amazing-pothos-a3bca0/deploys/6514220338a75e00085e2d50

@tatiana tatiana temporarily deployed to internal September 26, 2023 22:39 — with GitHub Actions Inactive
@tatiana tatiana temporarily deployed to internal September 26, 2023 22:55 — with GitHub Actions Inactive
@tatiana tatiana temporarily deployed to internal September 26, 2023 23:18 — with GitHub Actions Inactive
@tatiana tatiana temporarily deployed to internal September 26, 2023 23:35 — with GitHub Actions Inactive
@tatiana tatiana temporarily deployed to internal September 27, 2023 00:01 — with GitHub Actions Inactive
@tatiana tatiana temporarily deployed to internal September 27, 2023 00:21 — with GitHub Actions Inactive
@tatiana tatiana temporarily deployed to internal September 27, 2023 00:44 — with GitHub Actions Inactive
@tatiana tatiana temporarily deployed to internal September 27, 2023 09:49 — with GitHub Actions Inactive
@tatiana tatiana temporarily deployed to internal September 27, 2023 12:37 — with GitHub Actions Inactive
@codecov
Copy link

codecov bot commented Sep 27, 2023

Codecov Report

All modified lines are covered by tests ✅

Comparison is base (5ccc126) 92.51% compared to head (9f77ea0) 92.88%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #558      +/-   ##
==========================================
+ Coverage   92.51%   92.88%   +0.37%     
==========================================
  Files          49       49              
  Lines        1963     1968       +5     
==========================================
+ Hits         1816     1828      +12     
+ Misses        147      140       -7     
Files Coverage Δ
cosmos/operators/local.py 90.81% <100.00%> (+2.48%) ⬆️

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Contributor

@harels harels left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

discussed on slack, lgtm!
thanks for adding the new tests!!

@tatiana tatiana merged commit 4c8d6b0 into main Sep 27, 2023
39 checks passed
@tatiana tatiana deleted the fix-549 branch September 27, 2023 13:45
tatiana added a commit that referenced this pull request Sep 27, 2023
Bug fixes

* Fix using ``ExecutionMode.KUBERNETES`` by @pgoslatara and @tatiana in #554
* Add support to ``apache-airflow-providers-cncf-kubernetes < 7.4.0`` by @tatiana in #553
* Improve error message in ``config.py`` by @meyobagero in #532
* Use ``returncode`` instead of ``stderr`` to determine dbt graph loading errors by @cliff-lau-cloverhealth in #547
* Fix only create task group and test task only if model has test by @raffifu in #543
* Fix ``on_warning_callback`` behaviour on ``DbtTestLocalOperator`` by @edgga, @marco9663 and @tatiana in #558
* Fix ``DbtTestOperator`` when test does not have ``test_metadata`` by @tatiana in #558
* Fix ``target-path`` not specified issue in ``dbt-project.yml`` by @tatiana in #533

Others

* Docs: add reference links to dbt and Airflow columns by @TJaniF in #542
* pre-commit updates #552 and #546
@tatiana tatiana mentioned this pull request Sep 27, 2023
tatiana added a commit that referenced this pull request Sep 27, 2023
Since 1.1.0, the `on_warning_callback` functionality no longer works. It
worked on 1.0.5
    
Closes: #549
Closes: #545 (the fix was necessary to make the `on_warning_callback`
test pass)

Co-authored-by: Edgaras Navickas <[email protected]>
Co-authored-by: Marco Yuen <[email protected]>
tatiana added a commit that referenced this pull request Sep 27, 2023
Bug fixes

* Fix using `ExecutionMode.KUBERNETES` by @pgoslatara and @tatiana in #554
* Add support to `apache-airflow-providers-cncf-kubernetes < 7.4.0` by @tatiana in #553
* Improve error message in `config.py` by @meyobagero in #532
* Use `returncode` instead of `stderr` to determine dbt graph loading errors by @cliff-lau-cloverhealth in #547
* Fix `on_warning_callback` behaviour on `DbtTestLocalOperator` by @edgga, @marco9663 and @tatiana in #558
* Fix `DbtTestOperator` when test does not have `test_metadata` by @tatiana in #558
* Fix `target-path` not specified issue in `dbt-project.yml` by @tatiana in #533

Others

* Docs: add reference links to dbt and Airflow columns by @TJaniF in #542
* pre-commit updates #552 and #546
tatiana added a commit that referenced this pull request Sep 27, 2023
Bug fixes

* Fix using `ExecutionMode.KUBERNETES` by @pgoslatara and @tatiana in #554
* Add support to `apache-airflow-providers-cncf-kubernetes < 7.4.0` by @tatiana in #553
* Fix `on_warning_callback` behaviour on `DbtTestLocalOperator` by @edgga, @marco9663 and @tatiana in #558
* Use `returncode` instead of `stderr` to determine dbt graph loading errors by @cliff-lau-cloverhealth in #547
* Improve error message in `config.py` by @meyobagero in #532
* Fix `DbtTestOperator` when test does not have `test_metadata` by @tatiana in #558
* Fix `target-path` not specified issue in `dbt-project.yml` by @tatiana in #533

Others

* Docs: add reference links to dbt and Airflow columns by @TJaniF in #542
* pre-commit updates #552 and #546
tatiana added a commit that referenced this pull request Sep 27, 2023
Bug fixes

* Fix using `ExecutionMode.KUBERNETES` by @pgoslatara and @tatiana in #554
* Add support to `apache-airflow-providers-cncf-kubernetes < 7.4.0` by @tatiana in #553
* Fix `on_warning_callback` behaviour on `DbtTestLocalOperator` by @edgga, @marco9663 and @tatiana in #558
* Use `returncode` instead of `stderr` to determine dbt graph loading errors by @cliff-lau-cloverhealth in #547
* Improve error message in `config.py` by @meyobagero in #532
* Fix `DbtTestOperator` when test does not have `test_metadata` by @tatiana in #558
* Fix `target-path` not specified issue in `dbt-project.yml` by @tatiana in #533

Others

* Docs: add reference links to dbt and Airflow columns by @TJaniF in #542
* pre-commit updates #552 and #546

(cherry picked from commit 427f713)
tatiana added a commit that referenced this pull request Sep 27, 2023
Bug fixes

* Fix using `ExecutionMode.KUBERNETES` by @pgoslatara and @tatiana in #554
* Add support to `apache-airflow-providers-cncf-kubernetes < 7.4.0` by @tatiana in #553
* Fix `on_warning_callback` behaviour on `DbtTestLocalOperator` by @edgga, @marco9663 and @tatiana in #558
* Use `returncode` instead of `stderr` to determine dbt graph loading errors by @cliff-lau-cloverhealth in #547
* Improve error message in `config.py` by @meyobagero in #532
* Fix `DbtTestOperator` when test does not have `test_metadata` by @tatiana in #558
* Fix `target-path` not specified issue in `dbt-project.yml` by @tatiana in #533

Others

* Docs: add reference links to dbt and Airflow columns by @TJaniF in #542
* pre-commit updates #552 and #546

(cherry picked from commit 427f713)
(cherry picked from commit 61e4460)
@tatiana tatiana mentioned this pull request Sep 27, 2023
tatiana added a commit that referenced this pull request Sep 28, 2023
This PR is a subset of the actual Release 1.1.2 (#560), since - for this
release - we had to revert a
[commit](#560 (comment))
which we don't intend to revert on the project's main branch.

Bug fixes

* Fix using `ExecutionMode.KUBERNETES` by @pgoslatara and @tatiana in
#554
* Add support to `apache-airflow-providers-cncf-kubernetes < 7.4.0` by
@tatiana in #553
* Fix `on_warning_callback` behaviour on `DbtTestLocalOperator` by
@edgga, @marco9663 and @tatiana in #558
* Use `returncode` instead of `stderr` to determine dbt graph loading
errors by @cliff-lau-cloverhealth in #547
* Improve error message in `config.py` by @meyobagero in #532
* Fix `DbtTestOperator` when test does not have `test_metadata` by
@tatiana in #558
* Fix `target-path` not specified issue in `dbt-project.yml` by @tatiana
in #533

Others

* Docs: add reference links to dbt and Airflow columns by @TJaniF in
#542
* pre-commit updates #552 and #546
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants