Invention Publication
- Patent Title: EFFICIENT MERGE OF TABULAR DATA USING A PROCESSING FILTER
-
Application No.: US17895872Application Date: 2022-08-25
-
Publication No.: US20240069863A1Publication Date: 2024-02-29
- Inventor: Bart Samwel , Tathagata Das , Lars Kroll , Yijia Cui , Juliusz Sompolski , Tom Van Bussel
- Applicant: Databricks, Inc.
- Applicant Address: US CA San Francisco
- Assignee: Databricks, Inc.
- Current Assignee: Databricks, Inc.
- Current Assignee Address: US CA San Francisco
- Main IPC: G06F7/14
- IPC: G06F7/14 ; G06F16/14 ; G06F16/16

Abstract:
A method, system, and computer system for performing an operation with respect to a target table are disclosed. The method includes performing first, second and a third jobs, and obtaining a resulting table based at least in part on the second job resulting file(s) and third job resulting file(s). Performing the first job includes determining a set of matching target table files and storing target table information indicating for each of the set of matching target table files, a particular set of rows having matching rows. Performing the second job includes performing a matching action based on matched rows and obtaining the second job resulting file(s). Performing the third job includes determining unmatched rows for target table files and storing the unmatched rows in third job resulting file(s).
Information query