Invention Application
- Patent Title: DATAFLOW GRAPH PROCESSING
-
Application No.: US18089349Application Date: 2022-12-27
-
Publication No.: US20230140169A1Publication Date: 2023-05-04
- Inventor: Michael Paul Armbrust , Andreas Neumann , Mukul Murthy , Jonathan Mio
- Applicant: Databricks, Inc.
- Applicant Address: US CA San Francisco
- Assignee: Databricks, Inc.
- Current Assignee: Databricks, Inc.
- Current Assignee Address: US CA San Francisco
- Main IPC: G06F16/901
- IPC: G06F16/901 ; G06F16/245 ; G06F16/215 ; G06F16/22

Abstract:
A system for dataflow graph processing comprises a communication interface and a processor. The communication interface is configured receive an indication to generate a dataflow graph, wherein the indication includes a set of queries and/or commands. The processor is coupled to the communication interface and configured to: determine dependencies of each query in the set of queries on another query; determine a DAG of nodes based at least in part on the dependencies; determine the dataflow graph by determining in-line expressions for tables of the dataflow graph aggregating calculations associated with a subset of dataflow graph nodes designated as view nodes; and provide the dataflow graph.
Public/Granted literature
- US12019682B2 Dataflow graph processing Public/Granted day:2024-06-25
Information query