-
公开(公告)号：US20180314556A1
公开(公告)日：2018-11-01
申请号：US15581987
申请日：2017-04-28
Applicant: Databricks Inc.
Inventor： Ali Ghodsi , Srinath Shankar , Sameer Paranjpye , Shi Xin , Matei Zaharia
IPC: G06F9/50
CPC classification number: G06F9/5061 , G06F2209/5011 , G06F2209/505
Abstract: A system for cluster resource allocation includes an interface and a processor. The interface is configured to receive a process and input data. The processor is configured to determine an estimate for resources required for the process to process the input data; determine existing available resources in a cluster for running the process; determine whether the existing available resources are sufficient for running the process; in the event it is determined that the existing available resources are not sufficient for running the process, indicate to add new resources; determine an allocated share of resources in the cluster for running the process; and cause execution of the process using the share of resources.
-
公开(公告)号：US20180300354A1
公开(公告)日：2018-10-18
申请号：US15487896
申请日：2017-04-14
Applicant: Databricks Inc.
Inventor： Eric Keng-hao Liang , Srinath Shankar , Shi Xin
IPC: G06F17/30
Abstract: A system for directory level atomic commits includes an interface and a processor. The interface is configured to receive an indication to provide a set of files. The processor is configured to determine whether a file in a directory has been either 1) atomically committed or 2) written by a non-atomic process and not designated as deleted and provide the file as one file of the set of files in the event that the file in the directory has been either 1) atomically committed or 2) written by a non-atomic process and not designated as deleted.
-
公开(公告)号：US20230359516A1
公开(公告)日：2023-11-09
申请号：US18200316
申请日：2023-05-22
Applicant: Databricks, Inc.
Inventor： Alicja Luszczak , Srinath Shankar , Shi Xin
CPC classification number: G06F11/0757 , G06F11/0721 , G06F11/0793 , G06F11/3419 , G06F11/3024 , G06F11/076 , G06F2201/88 , G06F2201/81
Abstract: A system for monitoring job execution includes an interface and a processor. The interface is configured to receive an indication to start a cluster processing job. The processor is configured to determine whether processing a data instance associated with the cluster processing job satisfies a watchdog criterion; and in the event that processing the data instance satisfies the watchdog criterion, cause the processing of the data instance to be killed.
-
公开(公告)号：US20220083410A1
公开(公告)日：2022-03-17
申请号：US17537124
申请日：2021-11-29
Applicant: Databricks Inc.
Inventor： Alicja Luszczak , Srinath Shankar , Shi Xin
Abstract: A system for monitoring job execution includes an interface and a processor. The interface is configured to receive an indication to start a cluster processing job. The processor is configured to determine whether processing a data instance associated with the cluster processing job satisfies a watchdog criterion; and in the event that processing the data instance satisfies the watchdog criterion, cause the processing of the data instance to be killed.
-
公开(公告)号：US10691433B2
公开(公告)日：2020-06-23
申请号：US16119802
申请日：2018-08-31
Applicant: Databricks Inc.
Inventor： Srinath Shankar , Eric Keng-hao Liang , Gregory George Owen
IPC: G06F9/44 , G06F8/41 , G06F8/54 , G06F8/70 , G06F11/36 , G06F11/07 , G06F21/62 , G06F16/23 , G06F16/907
Abstract: A system for code development and execution includes a client interface and a client processor. The client interface is configured to receive user code for execution and receive an indication of a server that will perform the execution. The client processor is configured to parse the user code to identify one or more data items referred to during the execution. The client processor is also configured to provide the server with an inquiry for metadata regarding the one or more data items, receive the metadata regarding the one or more data items, determine a logical plan based at least in part on the metadata regarding the one or more data items; and provide the logical plan to the server for execution.
-
Patent Agency Ranking
公开(公告)号：US20200073644A1
公开(公告)日：2020-03-05
申请号：US16119802
申请日：2018-08-31
Applicant: Databricks Inc.
Inventor： Srinath Shankar , Eric Keng-hao Liang , Gregory George Owen
Abstract: A system for code development and execution includes a client interface and a client processor. The client interface is configured to receive user code for execution and receive an indication of a server that will perform the execution. The client processor is configured to parse the user code to identify one or more data items referred to during the execution. The client processor is also configured to provide the server with an inquiry for metadata regarding the one or more data items, receive the metadata regarding the one or more data items, determine a logical plan based at least in part on the metadata regarding the one or more data items; and provide the logical plan to the server for execution.
-
公开(公告)号：US11693723B2
公开(公告)日：2023-07-04
申请号：US17537124
申请日：2021-11-29
Applicant: Databricks, Inc.
Inventor： Alicja Luszczak , Srinath Shankar , Shi Xin
CPC classification number: G06F11/0757 , G06F11/076 , G06F11/0721 , G06F11/0793 , G06F11/3024 , G06F11/3419 , G06F2201/81 , G06F2201/88
Abstract: A system for monitoring job execution includes an interface and a processor. The interface is configured to receive an indication to start a cluster processing job. The processor is configured to determine whether processing a data instance associated with the cluster processing job satisfies a watchdog criterion; and in the event that processing the data instance satisfies the watchdog criterion, cause the processing of the data instance to be killed.
-
公开(公告)号：US11216324B2
公开(公告)日：2022-01-04
申请号：US16793921
申请日：2020-02-18
Applicant: Databricks Inc.
Inventor： Alicja Luszczak , Srinath Shankar , Shi Xin
Abstract: A system for monitoring job execution includes an interface and a processor. The interface is configured to receive an indication to start a cluster processing job. The processor is configured to determine whether processing a data instance associated with the cluster processing job satisfies a watchdog criterion; and in the event that processing the data instance satisfies the watchdog criterion, cause the processing of the data instance to be killed.
-
公开(公告)号：US10606675B1
公开(公告)日：2020-03-31
申请号：US15809907
申请日：2017-11-10
Applicant: Databricks Inc.
Inventor： Alicja Luszczak , Srinath Shankar , Shi Xin
Abstract: A system for monitoring job execution includes an interface and a processor. The interface is configured to receive an indication to start a cluster processing job. The processor is configured to determine whether processing a data instance associated with the cluster processing job satisfies a watchdog criterion; and in the event that processing the data instance satisfies the watchdog criterion, cause the processing of the data instance to be killed.
-
公开(公告)号：US11113043B2
公开(公告)日：2021-09-07
申请号：US16864074
申请日：2020-04-30
Applicant: Databricks Inc.
Inventor： Srinath Shankar , Eric Keng-Hao Liang , Gregory George Owen
Abstract: A system for code development and execution includes a client interface and a client processor. The client interface is configured to receive user code for execution and receive an indication of a server that will perform the execution. The client processor is configured to parse the user code to identify one or more data items referred to during the execution. The client processor is also configured to provide the server with an inquiry for metadata regarding the one or more data items, receive the metadata regarding the one or more data items, determine a logical plan based at least in part on the metadata regarding the one or more data items; and provide the logical plan to the server for execution.
-
-
-
-
-
-
-
-
-
Search Results
16
records
(took 0.012 seconds)
