You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am unable to use DbtRunOperator with a private ssh git repo, and while I am unsure if my syntax is correct, I am encountering an error that leads me to believe that it is not my usage of the operator.
We are running
dbt_run=DbtRunOperator(
dbt_conn_id="dbt-projects-github", # Airflow connection to private dbt-airflow github repositorytask_id="dbt_run",
project_dir="git+ssh://github.com/OrganizationName/dbt-airflow",
# project_conn_id=db_conn, select=["+tag:daily"],
exclude=["tag:deprecated"],
target="db_conn", # Airflow Connection to data warehouse# profile="my-project",
)
The url.netloc is github.com, and notably if we passed a github repo url to project_dir that used either git or http/https, then the following code would have run path = str(url.path) rather than path = f"{url.netloc.split(':')[1]}/{str(url.path)}" which appears to be the cause of the error.
Are you able to provide any assistance with this? Also, it would be great while we're struggling through these errors to also receive some feedback on the discussion I opened about this topic as well
Thank you very much!
The text was updated successfully, but these errors were encountered:
Hello, this relates to the discussion I created
I am unable to use
DbtRunOperator
with a private ssh git repo, and while I am unsure if my syntax is correct, I am encountering an error that leads me to believe that it is not my usage of the operator.We are running
which results in the following error:
The
url.netloc
is github.com, and notably if we passed a github repo url toproject_dir
that used eithergit
orhttp/https
, then the following code would have runpath = str(url.path)
rather thanpath = f"{url.netloc.split(':')[1]}/{str(url.path)}"
which appears to be the cause of the error.Are you able to provide any assistance with this? Also, it would be great while we're struggling through these errors to also receive some feedback on the discussion I opened about this topic as well
Thank you very much!
The text was updated successfully, but these errors were encountered: