Invention Publication
- Patent Title: Adaptive Approach to Lazy Materialization in Database Scans using Pushed Filters
-
Application No.: US18160861Application Date: 2023-01-27
-
Publication No.: US20240256543A1Publication Date: 2024-08-01
- Inventor: Shoumik Palkar , Alexander Behm , Mostafa Mokhtar , Sriram Krishnamurthy
- Applicant: Databricks, Inc.
- Applicant Address: US CA San Francisco
- Assignee: Databricks, Inc.
- Current Assignee: Databricks, Inc.
- Current Assignee Address: US CA San Francisco
- Main IPC: G06F16/2453
- IPC: G06F16/2453 ; G06F11/34 ; G06F16/22

Abstract:
Disclosed herein is a method for determining whether to apply a lazy materialization technique to a query run. A data processing service receives a request to perform a query identifying a filter column and a non-filter column in a columnar database. The data processing service accesses a first task of contiguous rows in the filter column from a cloud-based object storage. The data processing service applies a filter defined by the query to the first task. The data processing service generates filter results for the first task that may include a percentage of the first task discarded and a run-time. The data processing service determines, based on the filter results for the first task, a likelihood value that indicates a likelihood of gaining a performance benefit by applying the lazy materialization technique to a second task of the query.
Public/Granted literature
- US12124450B2 Adaptive approach to lazy materialization in database scans using pushed filters Public/Granted day:2024-10-22
Information query