Task orchestration method for data processing, orchestrator, device and readable storage medium
摘要:
The present disclosure provides a method for task orchestrating, an orchestrator, a device and a readable storage medium. According to the method provided in the present disclosure, task scripts are edited as descriptive language scripts, and data dependency relationships between source tables and target tables in the tasks corresponding to the task scripts are automatically generated according to the descriptive language scripts of the tasks. The execution of the tasks is driven in a data-driven manner according to the data dependency relationships between the source tables and the target tables in the tasks. There is no need for a technical person to manually edit the workflow file. When some tasks change, the data dependency relationships between the source and target tables in the tasks can be automatically updated according to the task scripts, without affecting the orchestration process between tasks.
信息查询
0/0