Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Allow to turn off the default behavior of cosmos of creating task groups when a run & test are provided #1348

Open
1 task
corsettigyg opened this issue Nov 28, 2024 · 0 comments
Labels
area:rendering Related to rendering, like Jinja, Airflow tasks, etc enhancement New feature or request triage-needed Items need to be reviewed / assigned to milestone

Comments

@corsettigyg
Copy link
Contributor

Description

Hello,

When dealing with cosmos, by default we will have the creation of a taskGroup with the name of the transformation and under it run and test while for tasks without tests, there is no taskGroup and only the {task}_run

Image

It would be good to be possible to either make all of it flat (so no task groups) or by default always have a taskGroup and, in the absence of tests, just have run inside of it.

Use case/motivation

The reason is because when you try to extend cosmos and do some magic with it, the inconsistency in the task name makes it very hard to create a rule that will always work. For example, if an external DAG is referring to a cosmos DAG and we add a test to the dbt task we are poking, we would get an error in the external DAG since sensors are separated with . (so {taskGroupName}.run) while the current setup would still point to {task}_run.

Related issues

No response

Are you willing to submit a PR?

  • Yes, I am willing to submit a PR!
@corsettigyg corsettigyg added enhancement New feature or request triage-needed Items need to be reviewed / assigned to milestone labels Nov 28, 2024
@dosubot dosubot bot added the area:rendering Related to rendering, like Jinja, Airflow tasks, etc label Nov 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:rendering Related to rendering, like Jinja, Airflow tasks, etc enhancement New feature or request triage-needed Items need to be reviewed / assigned to milestone
Projects
None yet
Development

No branches or pull requests

1 participant