Invention Application
- Patent Title: DATA PROCESSING PIPELINE FAILURE RECOVERY
-
Application No.: US16215557Application Date: 2018-12-10
-
Publication No.: US20200183788A1Publication Date: 2020-06-11
- Inventor: Ethan Petrick Dreyfuss , Michael Haggblade , Hao Li , Andres Guillermo Morales Morales
- Applicant: Zoox, Inc.
- Assignee: Zoox, Inc.
- Current Assignee: Zoox, Inc.
- Main IPC: G06F11/14
- IPC: G06F11/14 ; G06F9/30

Abstract:
Techniques are disclosed for re-executing a data processing pipeline following a failure of at least one of its components. The techniques may include a syntax for defining a compute graph associated with the data processing pipeline and receiving such a compute graph in association with a specific data processing pipeline. The technique may include executing the data processing pipeline, determining that a component of the data processing pipeline failed, and determining a portion of the data processing pipeline to execute/re-execute based at least in part on dependencies defined by the data processing pipeline in association with the failed component. Re-executing the one or more components may comprise retrieving an output saved in association with a component upon which the failed component depends.
Public/Granted literature
- US11379308B2 Data processing pipeline failure recovery Public/Granted day:2022-07-05
Information query