公开(公告)号：US20180300354A1

公开(公告)日：2018-10-18

申请号：US15487896

申请日：2017-04-14

Applicant: Databricks Inc.

Inventor： Eric Keng-hao Liang ,  Srinath Shankar ,  Shi Xin

IPC: G06F17/30

Abstract: A system for directory level atomic commits includes an interface and a processor. The interface is configured to receive an indication to provide a set of files. The processor is configured to determine whether a file in a directory has been either 1) atomically committed or 2) written by a non-atomic process and not designated as deleted and provide the file as one file of the set of files in the event that the file in the directory has been either 1) atomically committed or 2) written by a non-atomic process and not designated as deleted.

公开(公告)号：US11068447B2

公开(公告)日：2021-07-20

申请号：US15487896

申请日：2017-04-14

Applicant: Databricks Inc.

Inventor： Eric Keng-hao Liang ,  Srinath Shankar ,  Shi Xin

IPC: G06F16/18 ,  G06F16/16 ,  G06F16/182

Abstract: A system for directory level atomic commits includes an interface and a processor. The interface is configured to receive an indication to provide a set of files. The processor is configured to determine whether a file in a directory has been either 1) atomically committed or 2) written by a non-atomic process and not designated as deleted and provide the file as one file of the set of files in the event that the file in the directory has been either 1) atomically committed or 2) written by a non-atomic process and not designated as deleted.

公开(公告)号：US10691433B2

公开(公告)日：2020-06-23

申请号：US16119802

申请日：2018-08-31

Applicant: Databricks Inc.

Inventor： Srinath Shankar ,  Eric Keng-hao Liang ,  Gregory George Owen

IPC: G06F9/44 ,  G06F8/41 ,  G06F8/54 ,  G06F8/70 ,  G06F11/36 ,  G06F11/07 ,  G06F21/62 ,  G06F16/23 ,  G06F16/907

Abstract: A system for code development and execution includes a client interface and a client processor. The client interface is configured to receive user code for execution and receive an indication of a server that will perform the execution. The client processor is configured to parse the user code to identify one or more data items referred to during the execution. The client processor is also configured to provide the server with an inquiry for metadata regarding the one or more data items, receive the metadata regarding the one or more data items, determine a logical plan based at least in part on the metadata regarding the one or more data items; and provide the logical plan to the server for execution.

公开(公告)号：US20200073644A1

公开(公告)日：2020-03-05

申请号：US16119802

申请日：2018-08-31

Applicant: Databricks Inc.

Inventor： Srinath Shankar ,  Eric Keng-hao Liang ,  Gregory George Owen

IPC: G06F8/41 ,  G06F8/54 ,  G06F8/70 ,  G06F11/36 ,  G06F11/07 ,  G06F17/30 ,  G06F21/62

Abstract: A system for code development and execution includes a client interface and a client processor. The client interface is configured to receive user code for execution and receive an indication of a server that will perform the execution. The client processor is configured to parse the user code to identify one or more data items referred to during the execution. The client processor is also configured to provide the server with an inquiry for metadata regarding the one or more data items, receive the metadata regarding the one or more data items, determine a logical plan based at least in part on the metadata regarding the one or more data items; and provide the logical plan to the server for execution.