-
公开(公告)号：US11379272B2
公开(公告)日：2022-07-05
申请号：US17020573
申请日：2020-09-14
Applicant: Databricks Inc.
Inventor： Srinath Shankar , Eric Keng-Hao Liang
IPC: G06F9/46 , G06F9/50 , G06F9/48 , G06F9/38 , H04L67/5682
Abstract: The allocation system comprises an interface and a processor. The interface is configured to receive an indication to deactivate idle cluster machines of a set of cluster machines. The processor is configured to determine a list of cluster machines storing one or more intermediate data files of a set of intermediate data files; determine a set of idle cluster machines of the set of cluster machines that are neither running one or more tasks of a set of tasks executing or pending on the set of cluster machines nor storing the one or more intermediate data files of the set of intermediate data files, where the set of intermediate data files is associated with the set of tasks executing or pending on the cluster machines; and deactivate each cluster machine of the set of idle cluster machines.
-
公开(公告)号：US11113043B2
公开(公告)日：2021-09-07
申请号：US16864074
申请日：2020-04-30
Applicant: Databricks Inc.
Inventor： Srinath Shankar , Eric Keng-Hao Liang , Gregory George Owen
Abstract: A system for code development and execution includes a client interface and a client processor. The client interface is configured to receive user code for execution and receive an indication of a server that will perform the execution. The client processor is configured to parse the user code to identify one or more data items referred to during the execution. The client processor is also configured to provide the server with an inquiry for metadata regarding the one or more data items, receive the metadata regarding the one or more data items, determine a logical plan based at least in part on the metadata regarding the one or more data items; and provide the logical plan to the server for execution.
-
公开(公告)号：US10810051B1
公开(公告)日：2020-10-20
申请号：US16188989
申请日：2018-11-13
Applicant: Databricks Inc.
Inventor： Srinath Shankar , Eric Keng-Hao Liang
Abstract: The allocation system comprises an interface and a processor. The interface is configured to receive an indication to deactivate idle cluster machines of a set of cluster machines. The processor is configured to determine a set of tasks executing or pending on the set of cluster machines; determine a set of idle cluster machines of the set of cluster machines that are neither running one or more tasks of the set of tasks nor storing one or more intermediate data files of a set of intermediate data files, where the set of intermediate data files is associated with a set of tasks executing or pending on the cluster machines; and deactivate each cluster machine of the set of idle cluster machines.
-
公开(公告)号：US20200301684A1
公开(公告)日：2020-09-24
申请号：US16864074
申请日：2020-04-30
Applicant: Databricks Inc.
Inventor： Srinath Shankar , Eric Keng-Hao Liang , Gregory George Owen
Abstract: A system for code development and execution includes a client interface and a client processor. The client interface is configured to receive user code for execution and receive an indication of a server that will perform the execution. The client processor is configured to parse the user code to identify one or more data items referred to during the execution. The client processor is also configured to provide the server with an inquiry for metadata regarding the one or more data items, receive the metadata regarding the one or more data items, determine a logical plan based at least in part on the metadata regarding the one or more data items; and provide the logical plan to the server for execution.
-
-
-
Search Results
4
records
(took 0.009 seconds)
