公开(公告)号：US10474501B2

公开(公告)日：2019-11-12

申请号：US15581987

申请日：2017-04-28

Applicant: Databricks Inc.

Inventor： Ali Ghodsi ,  Srinath Shankar ,  Sameer Paranjpye ,  Shi Xin ,  Matei Zaharia

IPC: G06F9/50

Abstract: A system for cluster resource allocation includes an interface and a processor. The interface is configured to receive a process and input data. The processor is configured to determine an estimate for resources required for the process to process the input data; determine existing available resources in a cluster for running the process; determine whether the existing available resources are sufficient for running the process; in the event it is determined that the existing available resources are not sufficient for running the process, indicate to add new resources; determine an allocated share of resources in the cluster for running the process; and cause execution of the process using the share of resources.

公开(公告)号：US10296329B2

公开(公告)日：2019-05-21

申请号：US15803604

申请日：2017-11-03

Applicant: Databricks Inc.

Inventor： Timothee Hunter ,  Ali Ghodsi ,  Ion Stoica

IPC: G06F8/54 ,  G06F8/71 ,  G06F9/50 ,  G06F9/445 ,  G06F9/455 ,  G06F16/9535

Abstract: A system for processing a notebook includes an input interface and a processor. The input interface is to receive a first notebook. The notebook comprises code for interactively querying and viewing data. The processor is to load the first notebook into a shell. The shell receives one or more parameters associated with the first notebook. The shell executes the first notebook using a cluster.