公开(公告)号：US11481398B1

公开(公告)日：2022-10-25

申请号：US17116230

申请日：2020-12-09

Applicant: Databricks Inc.

Inventor： Alexander Behm ,  Ankur Dave ,  Ryan Deng ,  Shoumik Palkar

IPC: G06F16/2455 ,  G06F16/22

Abstract: A system for spilling comprises an interface and a processor. The interface is configured to receive an indication to perform a GROUP BY operation, wherein the indication comprises an input table and a grouping column. The processor is configured to: for each input table entry of the input table, determine a key, wherein the key is based at least in part on the input table entry and the grouping column; add the key to a grouping hash table, wherein adding the key to the grouping hash table comprises last-in, first-out (LIFO) spilling when necessary; create an output table based at least in part on the grouping hash table; and provide the output table.

公开(公告)号：US20220100761A1

公开(公告)日：2022-03-31

申请号：US17237979

申请日：2021-04-22

Applicant: Databricks Inc.

Inventor： Shi Xin ,  Alexander Behm ,  Shoumik Palkar ,  Herman Rudolf Petrus Catharina van Hövell tot Westerflier

IPC: G06F16/2453 ,  G06F16/25 ,  G06F16/2458

Abstract: A system comprises an interface, a processor, and a memory. The interface is configured to receive a query. The processor is configured to: determine a set of nodes for the query; determine whether a node of the set of nodes comprises a first engine node type or a second engine node type, wherein determining whether the node of the set of nodes comprises the first engine node type or the second engine node type is based at least in part on determining whether the node is able to be executed in a second engine; and generate a plan based at least in part on the set of nodes. The memory is coupled to the processor and is configured to provide the processor with instructions.