公开(公告)号：US20210103587A1

公开(公告)日：2021-04-08

申请号：US17125453

申请日：2020-12-17

Applicant: Snowflake Inc.

Inventor： Prasanna Rajaperumal ,  Thierry Cruanes ,  Allison Waingold Lee ,  Igor Demura ,  Jiaqi Yan ,  Benoit Dageville

IPC: G06F16/2453 ,  G06F16/27 ,  G06F16/23 ,  G06F16/22 ,  G06F16/2455

Abstract: The subject technology generates, using one or more processors, a materialized view over a share object, the share object including data associated with a first account. The subject technology merges, using the one or more processors, the materialized view and the share object. The subject technology updates, using the one or more processors, the data associated with the first account subsequent to generating the materialized view. The subject technology generates, using the one or more processors, a refreshed materialized view with respect to the share object in response to detecting the updated data. The subject technology shares, using the one or more processors, the refreshed materialized view to a second account in response to a request from the second account.

公开(公告)号：US10970283B2

公开(公告)日：2021-04-06

申请号：US16716819

申请日：2019-12-17

Applicant: Snowflake Inc.

Inventor： Florian Andreas Funke ,  Thierry Cruanes ,  Benoit Dageville ,  Marcin Zukowski

IPC: G06F16/20 ,  G06F16/2453 ,  G06F16/22 ,  G06F16/2455

Abstract: Systems, methods, and devices, for managing data skew during a join operation are disclosed. A method includes computing a hash value for a join operation and detecting data skew on a probe side of the join operation at a runtime of the join operation using a lightweight sketch data structure. The method includes identifying a frequent probe-side join key on the probe side of the join operation during a probe phase of the join operation. The method includes identifying a frequent build-side row having a build-side join key corresponding with the frequent probe-side join key. The method includes asynchronously distributing the frequent build-side row to one or more remote servers.

公开(公告)号：US10970282B2

公开(公告)日：2021-04-06

申请号：US16005182

申请日：2018-06-11

Applicant: Snowflake Inc.

Inventor： Florian Andreas Funke ,  Thierry Cruanes ,  Benoit Dageville ,  Marcin Zukowski

IPC: G06F16/20 ,  G06F16/2453 ,  G06F16/22 ,  G06F16/2455

Abstract: Systems, methods, and devices, for managing data skew during a join operation are disclosed. A method includes computing a hash value for a join operation and detecting data skew on a probe side of the join operation at a runtime of the join operation using a lightweight sketch data structure. The method includes identifying a frequent probe-side join key on the probe side of the join operation during a probe phase of the join operation. The method includes identifying a frequent build-side row having a build-side join key corresponding with the frequent probe-side join key. The method includes asynchronously distributing the frequent build-side row to one or more remote servers.

公开(公告)号：US10963428B2

公开(公告)日：2021-03-30

申请号：US16749816

申请日：2020-01-22

Applicant: Snowflake Inc.

Inventor： Benoit Dageville ,  Thierry Cruanes ,  Marcin Zukowski ,  Allison Waingold Lee ,  Philipp Thomas Unterbrunner

IPC: G06F16/172 ,  G06F16/13 ,  G06F16/182 ,  G06F16/22 ,  G06F16/2455

Abstract: A system, apparatus, and method for processing queries wherein the query includes a request to access or delete data and accessing metadata associated with the set of data, the metadata defining data characteristics of the set of data and identifying at least sets of data that need or not need to be accessed or deleted based on the metadata without accessing the actual data in the set of data; also methods to optimize processing of some operations based on the collected metadata on data.

公开(公告)号：US10956445B1

公开(公告)日：2021-03-23

申请号：US17125524

申请日：2020-12-17

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Benoit Dageville ,  Allison Waingold Lee

IPC: G06F15/16 ,  G06F16/27 ,  G06F9/50 ,  G06F16/14 ,  G06F16/21 ,  G06F16/22 ,  G06F16/951 ,  G06F16/182 ,  G06F16/23 ,  G06F16/2455 ,  G06F16/2458 ,  G06F16/9535 ,  G06F16/2453 ,  G06F9/48 ,  H04L29/08

Abstract: A system and method for managing data storage and data access with querying data in a distributed system without buffering the results on intermediate operations in disk storage.

公开(公告)号：US20210084042A1

公开(公告)日：2021-03-18

申请号：US17027863

申请日：2020-09-22

Applicant: SNOWFLAKE INC.

Inventor： Pui Kei Johnston Chu ,  Benoit Dageville ,  Matthew J. Glickman ,  Christian Kleinerman ,  Prasanna Krishnan ,  Justin Langseth

IPC: H04L29/06 ,  H04L12/58

Abstract: Systems and methods for managing membership in a private data exchange are provided herein. In one embodiment, the method comprises adding a new member to a data exchange, wherein the data exchange comprises a set of listings, each listing comprising data from one or more datasets stored on a cloud computing service. An account type is assigned to the new member, the account type comprising at least one of a consumer type, provider type, or exchange administrator type. Each of the account types associated with one or more rights with respect to the set of listings, such that the new member has a set of rights based on the account type. The set of rights of the new member are then modified with respect to one or more listings from the set of listings based on a set of visibility and access rules for each of the set of listings.

公开(公告)号：US10949402B1

公开(公告)日：2021-03-16

申请号：US16900840

申请日：2020-06-12

Applicant: SNOWFLAKE INC.

Inventor： Pui Kei Johnston Chu ,  Benoit Dageville ,  Shreyas Narendra Desai ,  German Alberto Gil Echeverri ,  Prasanna Krishnan ,  Vishnu Dutt Paladugu ,  Bowen Zhang

IPC: G06F16/182 ,  G06F16/11 ,  G06F9/54 ,  G06F16/17

Abstract: Provided herein are systems and methods for an efficient method of replicating share objects to remote deployments. For example, the method may comprise modifying a share object of a first account of a data exchange into a global object wherein the share object includes grant metadata indicating share grants to a set of objects of a database. The method may further comprise creating, in a second account of the data exchange, a local replica of the share object on the remote deployment based on the global object, wherein the second account is located in a remote deployment. The set of objects of the database may be replicated to a local database replica on the remote deployment and the share grants may be replicated to the local replica of the share object.

公开(公告)号：US20210073245A1

公开(公告)日：2021-03-11

申请号：US16953315

申请日：2020-11-19

Applicant: Snowflake, Inc.

Inventor： Ashish Motivala ,  Benoit Dageville

IPC: G06F16/27 ,  G06F9/50 ,  G06F16/14 ,  G06F16/21 ,  G06F16/22 ,  G06F16/951 ,  G06F16/182 ,  G06F16/23 ,  G06F16/2455 ,  G06F16/2458 ,  G06F16/9535 ,  G06F16/2453 ,  G06F9/48 ,  H04L29/08

Abstract: Example systems and methods for cloning catalog objects are described. In one implementation, a method identifies an original catalog object associated with data and creates a duplicate copy of the original catalog object without copying the data itself. The method allows access to the data using the duplicate catalog object and supports modifying the data associated with the original catalog object independently of the duplicate catalog object. The duplicate catalog object can be deleted upon completion of modifying the data associated with the original catalog object.

公开(公告)号：US20210064502A1

公开(公告)日：2021-03-04

申请号：US16555996

申请日：2019-08-29

Applicant: Snowflake Inc.

Inventor： Benoit Dageville ,  Johan Harjono ,  Simon Holm Jensen ,  Kunal Prafulla Nabar ,  Steven James Pelley

IPC: G06F11/30 ,  G06F16/2458 ,  G06F16/242 ,  G06F11/34

Abstract: Systems, methods, and devices for retrying a query. A method includes receiving, by a first database query manager, a query directed to database data from a client account. The method includes assigning an original execution of the query to one or more execution nodes of an execution platform. The method includes determining the original execution of the query was unsuccessful. The method includes transferring the query to a second database query manager configured to manage internal tasks for improving operation of a database platform that are not received from client accounts. The method includes assigning, by the second database query manager, a retry execution of the query to one or more execution nodes of an execution platform.

公开(公告)号：US10909121B2

公开(公告)日：2021-02-02

申请号：US16863831

申请日：2020-04-30

Applicant: Snowflake Inc.

Inventor： Benoit Dageville ,  Yi Fang ,  Martin Hentschel ,  Ashish Motivala ,  Spyridon Triantafyllis ,  Yizhi Zhu

IPC: G06F16/2455 ,  G06F16/23 ,  G06F16/2457 ,  G06F16/22 ,  G06F16/2458 ,  G06F16/27

Abstract: The subject technology receives first metadata corresponding to a set of micro-partitions. The subject technology generates second metadata for a grouping of the first metadata. The subject technology generates a first data structure including the first metadata and a second data structure including the second metadata, the second data structure including information associating the second metadata to the first metadata. The subject technology stores the first data structure and the second data structure in persistent storage as a first file and a second file. The subject technology receives a query on a table. Further, the subject technology analyzes the query against cumulative table metadata to determine whether data stored in the table matches the query.