Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add dag to check ingestion dag health #117

Merged
merged 4 commits into from
Nov 14, 2023
Merged

Add dag to check ingestion dag health #117

merged 4 commits into from
Nov 14, 2023

Conversation

pankajastro
Copy link
Collaborator

@pankajastro pankajastro commented Nov 13, 2023

closes: #118

Sample alert

Screenshot 2023-11-14 at 1 26 35 PM

Copy link

cloudflare-workers-and-pages bot commented Nov 13, 2023

Deploying with  Cloudflare Pages  Cloudflare Pages

Latest commit: bc49069
Status: ✅  Deploy successful!
Preview URL: https://605a20a6.ask-astro.pages.dev
Branch Preview URL: https://monitor-dag.ask-astro.pages.dev

View logs

Copy link
Collaborator

@sunank200 sunank200 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Have you tested this?

airflow/dags/monitor/monitor_ingestion_dags.py Outdated Show resolved Hide resolved
Copy link
Collaborator

@sunank200 sunank200 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pankajastro have you tested this?

@pankajastro pankajastro marked this pull request as ready for review November 14, 2023 07:23
@pankajastro pankajastro requested a review from Lee-W as a code owner November 14, 2023 07:23
@pankajastro
Copy link
Collaborator Author

@pankajastro have you tested this?

@sunank200 it is ready for review

@pankajastro
Copy link
Collaborator Author

Have you tested this?

Yes @sunank200 I have just attached a sample alert message in PR description

@sunank200 sunank200 merged commit 4473df8 into main Nov 14, 2023
7 checks passed
@sunank200 sunank200 deleted the monitor_dag branch November 14, 2023 08:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add a DAG to check health of ingestion dags
2 participants