A query abou the task dependency #787
-
Hello, |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
Hi @JasonNing96, (I have closed the issue to concentrate the discussion here.) Vineyard itself is a storage engine, and doesn't aware about the workflow upon vineyard. Vineyard does have some integration with workflow orchestration engines, e.g., airflow. In airflow, you would describe a task dependency between your task1 and task2, e.g., task2 requires task1. The workflow scheduler ensures task2 will be launched after task1 has been finished. Then when task2 been launched, the required input data should be ready as it has been produced by task1. |
Beta Was this translation helpful? Give feedback.
Hi @JasonNing96,
(I have closed the issue to concentrate the discussion here.)
Vineyard itself is a storage engine, and doesn't aware about the workflow upon vineyard.
Vineyard does have some integration with workflow orchestration engines, e.g., airflow. In airflow, you would describe a task dependency between your task1 and task2, e.g., task2 requires task1. The workflow scheduler ensures task2 will be launched after task1 has been finished. Then when task2 been launched, the required input data should be ready as it has been produced by task1.