公开(公告)号：US20230367757A1

公开(公告)日：2023-11-16

申请号：US18359322

申请日：2023-07-26

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo

IPC: G06F16/22 ,  G06F16/23 ,  G06F16/2455

CPC classification number: G06F16/2282 ,  G06F16/2358 ,  G06F16/24568

Abstract: A system or persistent table may be generated storing changelog information of a primary base table. The system table may then be used to create streams of relevant information. In some examples, the streams may read from the system table for information past a retention period of the primary table while reading from the primary table information in the retention period.

公开(公告)号：US20230342377A1

公开(公告)日：2023-10-26

申请号：US18345949

申请日：2023-06-30

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo ,  Boyuan Zhang

IPC: G06F16/27

CPC classification number: G06F16/27

Abstract: Techniques described herein can enable stream replication. A first deployment can store a table including one or more streams. The techniques described herein can be used to replicate the table at a second deployment while replicating the one or more streams associated with the table. Select prior table versions and partitions in the table are copied to the second deployment to enable stream replication.

公开(公告)号：US20230315755A1

公开(公告)日：2023-10-05

申请号：US18103977

申请日：2023-01-31

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Dinesh Chandrakant Kulkarni ,  Daniel Mills ,  Daniel E. Sotolongo ,  Di Fei Zhang

IPC: G06F16/27

CPC classification number: G06F16/273

Abstract: Techniques for triggering pipeline execution based on data change (transaction commit) are described. The pipelines can be used for data ingestion or other specified tasks. These tasks can be operational across account, organization, cloud region, and cloud provider boundaries. The tasks can be triggered by commit post-processing. Gates in the tasks can be set up to reference change data capture information. If the gate is satisfied, tasks can be executed to set up data pipelines.

公开(公告)号：US20230297579A1

公开(公告)日：2023-09-21

申请号：US18324710

申请日：2023-05-26

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Thierry Cruanes ,  Istvan Cseri ,  Benoit Dageville ,  Tyler Jones ,  Dinesh Chandrakant Kulkarni

IPC: G06F16/2455 ,  G06F16/2453

CPC classification number: G06F16/24568 ,  G06F16/24544

Abstract: Hybrid tables can be used in different use-case scenarios. Hybrid tables provide a flexible mechanism to support files and data in different formats while providing access to the different types of data as part of one table. This flexibility can allow the use of hybrid tables in data lake or other similar environments.

公开(公告)号：US11727013B2

公开(公告)日：2023-08-15

申请号：US17930150

申请日：2022-09-07

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Thierry Cruanes ,  Istvan Cseri ,  Benoit Dageville ,  Tyler Jones ,  Dinesh Chandrakant Kulkarni

IPC: G06F16/245 ,  G06F16/2455 ,  G06F16/2453

CPC classification number: G06F16/24568 ,  G06F16/24544

Abstract: Hybrid tables can be used in different use-case scenarios. Hybrid tables provide a flexible mechanism to support files and data in different formats while providing access to the different types of data as part of one table. This flexibility can allow the use of hybrid tables in data lake or other similar environments.

公开(公告)号：US20230237043A1

公开(公告)日：2023-07-27

申请号：US18158627

申请日：2023-01-24

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Fabian Hueske ,  Tyler Jones ,  Yevgeniy Kogan ,  Dzmitry Pauliukevich ,  Daniel E. Sotolongo

IPC: G06F16/23 ,  G06F16/2455 ,  G06F16/22

CPC classification number: G06F16/2358 ,  G06F16/2282 ,  G06F16/2456

Abstract: Techniques described herein can accelerate change data capture determinations such as stream reads, which show changes made to a table between two points in time. Three distinct row bitests that mark deleted, updated, inserted, rows in micro-partitions can be added as metadata for the table. These bitsets can be generated during DML operations and then stored as metadata of the new partition generated by the DML operations. The bitsets can then be used to generate streams showing the changes in the table between two points in time (changes interval).

公开(公告)号：US20230205766A1

公开(公告)日：2023-06-29

申请号：US18179762

申请日：2023-03-07

Applicant: Snowflake Inc.

Inventor： Torsten Grabs ,  Istvan Cseri ,  Benoit Dageville

IPC: G06F16/23 ,  G06F16/22 ,  G06F16/2455

CPC classification number: G06F16/2379 ,  G06F16/2282 ,  G06F16/2456 ,  G06F16/24554

Abstract: Systems, methods, and devices for tracking a series of changes to database data are disclosed. A method includes executing a transaction to modify data in a micro-partition of a table of a database by generating a new micro-partition that embodies the transaction. The method includes associating transaction data with the new micro-partition, wherein the transaction data comprises a timestamp when the transaction was fully executed, and further includes associating modification data with the new micro-partition that comprises an indication of one or more rows of the table that were modified by the transaction. The method includes joining the transaction data with the modification data to generate joined data and querying the joined data to determine a listing of intermediate modifications made to the table between a first timestamp and a second timestamp.

公开(公告)号：US20230185952A1

公开(公告)日：2023-06-15

申请号：US18167950

申请日：2023-02-13

Applicant: Snowflake Inc.

Inventor： Damien Carru ,  Jeremy Yujui Chen ,  Pui Kei Johnston Chu ,  Thierry Cruanes ,  Istvan Cseri ,  Benoit Dageville ,  Unmesh Jagtap ,  Subramanian Muralidhar

IPC: G06F21/62 ,  G06F9/445 ,  G06Q30/06

CPC classification number: G06F21/6227 ,  G06F9/44505 ,  G06Q30/06 ,  G06F2221/2141

Abstract: Embodiments of the present disclosure enable users of a data sharing system to build native applications that can be shared with other users of the data sharing system. The native applications can be published and discovered in the data sharing system like any other data listing, and consumers can install them in their local data sharing system account to serve their data processing needs. A provider may define an installation script for installing an application and create a share object to which the installation script may be attached. In response to an imported database being created in a consumer account based on the share object, a native application framework may automatically execute the installation script in the consumer account and may create a set of database roles to manage execution of the application in the consumer account.

公开(公告)号：US20230177039A1

公开(公告)日：2023-06-08

申请号：US18162513

申请日：2023-01-31

Applicant: Snowflake Inc.

Inventor： Subramanian Muralidhar ,  Istvan Cseri ,  Torsten Grabs ,  Benoit Dageville

IPC: G06F16/23 ,  G06F16/27 ,  G06F16/245 ,  G06F16/18

CPC classification number: G06F16/2358 ,  G06F16/278 ,  G06F16/2365 ,  G06F16/245 ,  G06F16/2322 ,  G06F16/1865 ,  G06F9/466

Abstract: A method for table data processing includes retrieving, by at least one hardware processor, first table data associated with a first table version from a plurality of partitions of a storage device. The method further includes detecting, by the at least one hardware processor, an executed transaction causing a modification to the first table data resulting in a second table data associated with a second table version. The second table data is modified to include partition metadata. The partition metadata includes table version information with a mapping of the first table version and the second table version to a plurality of transactions associated with generating the first table data and the second table data.

公开(公告)号：US20230139362A1

公开(公告)日：2023-05-04

申请号：US17813548

申请日：2022-07-19

Applicant: Snowflake Inc.

Inventor： Elliott Brossard ,  Srilakshmi Chintala ,  Istvan Cseri ,  Rodger N. Kline ,  Nitya Kumar Sharma ,  Igor Zinkovsky

IPC: G06F16/2455 ,  G06F16/25 ,  G06F16/27

Abstract: An external function system can be implemented on a database to perform processing on one or more external network services. The external function system can comprise a particular external function for a particular external service, an outbound serializer function, and an inbound serializer function that are linked with the particular external function. The outbound serializer function can be configured to transform the data of a query from a database format to a different format of the particular external network service. The inbound deserializer function can be configured to receive data returned from the external service and transform the data to the format of the database.