Invention Grant
- Patent Title: Dataflow graph processing
-
Application No.: US18089349Application Date: 2022-12-27
-
Publication No.: US12019682B2Publication Date: 2024-06-25
- Inventor: Michael Paul Armbrust , Andreas Neumann , Mukul Murthy , Jonathan Mio
- Applicant: Databricks, Inc.
- Applicant Address: US CA San Francisco
- Assignee: Databricks, Inc.
- Current Assignee: Databricks, Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Fenwick & West LLP
- Main IPC: G06F16/901
- IPC: G06F16/901 ; G06F16/215 ; G06F16/22 ; G06F16/245

Abstract:
A system for dataflow graph processing comprises a communication interface and a processor. The communication interface is configured receive an indication to generate a dataflow graph, wherein the indication includes a set of queries and/or commands. The processor is coupled to the communication interface and configured to: determine dependencies of each query in the set of queries on another query; determine a DAG of nodes based at least in part on the dependencies; determine the dataflow graph by determining in-line expressions for tables of the dataflow graph aggregating calculations associated with a subset of dataflow graph nodes designated as view nodes; and provide the dataflow graph.
Public/Granted literature
- US20230140169A1 DATAFLOW GRAPH PROCESSING Public/Granted day:2023-05-04
Information query