Invention Grant
- Patent Title: Data processing pipeline failure recovery
-
Application No.: US16215557Application Date: 2018-12-10
-
Publication No.: US11379308B2Publication Date: 2022-07-05
- Inventor: Ethan Petrick Dreyfuss , Michael Haggblade , Hao Li , Andres Guillermo Morales Morales
- Applicant: Zoox, Inc.
- Applicant Address: US CA Foster City
- Assignee: Zoox, Inc.
- Current Assignee: Zoox, Inc.
- Current Assignee Address: US CA Foster City
- Agency: Lee & Hayes, P.C.
- Main IPC: G06F11/14
- IPC: G06F11/14 ; G06F9/30

Abstract:
Techniques are disclosed for re-executing a data processing pipeline following a failure of at least one of its components. The techniques may include a syntax for defining a compute graph associated with the data processing pipeline and receiving such a compute graph in association with a specific data processing pipeline. The technique may include executing the data processing pipeline, determining that a component of the data processing pipeline failed, and determining a portion of the data processing pipeline to execute/re-execute based at least in part on dependencies defined by the data processing pipeline in association with the failed component. Re-executing the one or more components may comprise retrieving an output saved in association with a component upon which the failed component depends.
Public/Granted literature
- US20200183788A1 DATA PROCESSING PIPELINE FAILURE RECOVERY Public/Granted day:2020-06-11
Information query