公开(公告)号：US11514045B2

公开(公告)日：2022-11-29

申请号：US16721402

申请日：2019-12-19

Applicant: Databricks Inc.

Inventor： Michael Paul Armbrust ,  Tathagata Das ,  Shi Xin ,  Matei Zaharia

IPC: G06F16/2453 ,  G06F16/2455

Abstract: A system for executing a streaming query includes an interface and a processor. The interface is configured to receive a logical query plan. The processor is configured to determine a physical query plan based at least in part on the logical query plan. The physical query plan comprises an ordered set of operators. Each operator of the ordered set of operators comprises an operator input mode and an operator output mode. The processor is further configured to execute the physical query plan using the operator input mode and the operator output mode for each operator of the query.

公开(公告)号：US11216324B2

公开(公告)日：2022-01-04

申请号：US16793921

申请日：2020-02-18

Applicant: Databricks Inc.

Inventor： Alicja Luszczak ,  Srinath Shankar ,  Shi Xin

IPC: G06F11/07 ,  G06F11/34 ,  G06F11/30

Abstract: A system for monitoring job execution includes an interface and a processor. The interface is configured to receive an indication to start a cluster processing job. The processor is configured to determine whether processing a data instance associated with the cluster processing job satisfies a watchdog criterion; and in the event that processing the data instance satisfies the watchdog criterion, cause the processing of the data instance to be killed.

公开(公告)号：US10606675B1

公开(公告)日：2020-03-31

申请号：US15809907

申请日：2017-11-10

Applicant: Databricks Inc.

Inventor： Alicja Luszczak ,  Srinath Shankar ,  Shi Xin

IPC: G06F11/07 ,  G06F11/34 ,  G06F11/30

Abstract: A system for monitoring job execution includes an interface and a processor. The interface is configured to receive an indication to start a cluster processing job. The processor is configured to determine whether processing a data instance associated with the cluster processing job satisfies a watchdog criterion; and in the event that processing the data instance satisfies the watchdog criterion, cause the processing of the data instance to be killed.

公开(公告)号：US10361928B2

公开(公告)日：2019-07-23

申请号：US15682397

申请日：2017-08-21

Applicant: Databricks Inc.

Inventor： Ali Ghodsi ,  Ion Stoica ,  Matei Zaharia

IPC: G06F15/173 ,  H04L12/24 ,  G06F11/30 ,  H04L12/26

Abstract: A system for cluster management comprises a status monitor and an instance replacement manager. The status monitor is for monitoring status of an instance of a set of instances on a cluster provider. The instance replacement manager is for determining a replacement strategy for the instance in the event the instance does not respond. The replacement strategy for the instance is based at least in part on a management criteria for on-demand instances and spot instances on the cluster provider.

公开(公告)号：US10095735B2

公开(公告)日：2018-10-09

申请号：US15675619

申请日：2017-08-11

Applicant: Databricks Inc.

Inventor： Ali Ghodsi ,  Ion Stoica ,  Matei Zaharia

IPC: G06F7/00 ,  G06F17/30

Abstract: A system for exploring data in a database comprises a query parser, a parameter manager, a query submitter, and a result formatter. The query parser is to receive a base query and determine an input parameter from the base query. The parameter manager is to provide a first request for a value for the input parameter; receive the value for the input parameter; and provide a second request for the value for the input parameter. The query submitter is to determine a first query using the base query and the value for the input parameter; and provide an indication to execute the first query. The result formatter is to receive a result associated with the indication to execute the first query.

公开(公告)号：US09990230B1

公开(公告)日：2018-06-05

申请号：US15052204

申请日：2016-02-24

Applicant: Databricks Inc.

Inventor： Ion Stoica ,  Yandong Mao ,  Eric Liang

IPC: G06F9/46 ,  G06F9/48

CPC classification number: G06F9/4887

Abstract: A system for scheduling a notebook execution includes an interface and a processor. The interface is to receive an indication to schedule a notebook for execution, wherein the indication comprises a scheduled time and a cluster. The processor is to determine whether it is the scheduled time; and in the event that it is the scheduled time: determine whether the cluster is running; and in the event that the cluster is not running, set up the cluster and cause the notebook to execute using the cluster.

公开(公告)号：US09836302B1

公开(公告)日：2017-12-05

申请号：US15010845

申请日：2016-01-29

Applicant: Databricks Inc.

Inventor： Timothee Hunter ,  Ali Ghodsi ,  Ion Stoica

IPC: G06F9/44 ,  G06F17/30 ,  G06F9/445

CPC classification number: G06F8/71 ,  G06F8/54 ,  G06F9/445 ,  G06F9/45512 ,  G06F9/5066 ,  G06F17/30867

Abstract: A system for processing a notebook includes an input interface and a processor. The input interface is to receive a first notebook. The notebook comprises code for interactively querying and viewing data. The processor is to load the first notebook into a shell. The shell receives one or more parameters associated with the first notebook. The shell executes the first notebook using a cluster.

公开(公告)号：US12287698B2

公开(公告)日：2025-04-29

申请号：US18200316

申请日：2023-05-22

Applicant: Databricks, Inc.

Inventor： Alicja Luszczak ,  Srinath Shankar ,  Shi Xin

IPC: G06F11/07 ,  G06F11/30 ,  G06F11/34

Abstract: A system for monitoring job execution includes an interface and a processor. The interface is configured to receive an indication to start a cluster processing job. The processor is configured to determine whether processing a data instance associated with the cluster processing job satisfies a watchdog criterion; and in the event that processing the data instance satisfies the watchdog criterion, cause the processing of the data instance to be killed.

公开(公告)号：US20250131070A1

公开(公告)日：2025-04-24

申请号：US18491500

申请日：2023-10-20

Applicant: Databricks, Inc.

Inventor： Xiaotong Sun ,  Abhijit Chakankar ,  Ramesh Chandra

IPC: G06F21/31

Abstract: A data processing service receives indication that a recipient will request access to data assets of a provider and provides a request for credentials from a recipient governance module. The recipient governance module stores a recipient metastore including an object for a provider metastore. In response to determining that the assets are associated with the provider metastore, the service provides a request for credentials to a provider governance module. The provider governance module stores the provider metastore describing data assets of the provider and permissions for accessing data assets. The provider metastore includes a recipient object attached to the data assets with an identifier for the recipient metastore. In response to verifying that the recipient was provided access to the data assets, the service provides a token to the recipient governance module. The service then provides the token to a computing resource to provide access to the data assets.

公开(公告)号：US20250021536A1

公开(公告)日：2025-01-16

申请号：US18885322

申请日：2024-09-13

Applicant: Databricks, Inc.

Inventor： Aaron Daniel Davidson ,  Clemens Mewald ,  Tomas Nykodym

IPC: G06F16/21 ,  G06F16/955 ,  G06N5/022

Abstract: A system includes an interface, a processor, and a memory. The interface is configured to receive a version of a model from a model registry. The processor is configured to store the version of the model, start a process running the version of the model, and update a proxy with version information associated with the version of the model, wherein the updated proxy indicates to redirect an indication to invoke the version of the model to the process. The memory is coupled to the processor and configured to provide the processor with instructions.