公开(公告)号：US11461335B1

公开(公告)日：2022-10-04

申请号：US17455594

申请日：2021-11-18

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Thierry Cruanes ,  Istvan Cseri ,  Benoit Dageville ,  Tyler Jones ,  Dinesh Chandrakant Kulkarni

IPC: G06F16/245 ,  G06F16/2455 ,  G06F16/2453

Abstract: Hybrid tables can be used in different use-case scenarios. Hybrid tables provide a flexible mechanism to support files and data in different formats while providing access to the different types of data as part of one table. This flexibility can allow the use of hybrid tables in data lake or other similar environments.

公开(公告)号：US20220245121A1

公开(公告)日：2022-08-04

申请号：US17660132

申请日：2022-04-21

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Torsten Grabs ,  Benoit Dageville

IPC: G06F16/23 ,  G06F16/27 ,  G06F16/2455

Abstract: A method includes partitioning a database table into a first plurality of partitions. A plurality of changes are executed on the database table in response to a transaction. The changes occur at a corresponding plurality of timestamps and result in a second plurality of partitions. The database table is updated to include a log with the plurality of changes. For each change of the plurality of changes, the log includes and an identification of a portion of the database table the change is applied to. A selection of a first timestamp and a second timestamp of the plurality of timestamps is detected. A delta is generated in response to the selection. The delta indicates a total change occurring to the database table between a first change of the plurality of changes corresponding to the first timestamp and a second change of the plurality of changes corresponding to the second timestamp.

公开(公告)号：US20220222247A1

公开(公告)日：2022-07-14

申请号：US17656960

申请日：2022-03-29

Applicant: Snowflake Inc.

Inventor： Torsten Grabs ,  Istvan Cseri ,  Benoit Dageville

IPC: G06F16/23 ,  G06F16/22 ,  G06F16/2455

Abstract: Systems, methods, and devices for tracking a series of changes to database data are disclosed. A method includes executing a transaction to modify data in a micro-partition of a table of a database by generating a new micro-partition that embodies the transaction. The method includes associating transaction data with the new micro-partition, wherein the transaction data comprises a timestamp when the transaction was fully executed, and further includes associating modification data with the new micro-partition that comprises an indication of one or more rows of the table that were modified by the transaction. The method includes joining the transaction data with the modification data to generate joined data and querying the joined data to determine a listing of intermediate modifications made to the table between a first timestamp and a second timestamp.

公开(公告)号：US11269869B2

公开(公告)日：2022-03-08

申请号：US17498382

申请日：2021-10-11

Applicant: Snowflake Inc.

Inventor： Subramanian Muralidhar ,  Benoit Dageville ,  Thierry Cruanes ,  Nileema Shingte ,  Saurin Shah ,  Torsten Grabs ,  Istvan Cseri

IPC: G06F16/20 ,  G06F16/242 ,  G06F3/06 ,  G06F16/2453 ,  G06F16/25 ,  G06F16/23

Abstract: Disclosed herein are systems and methods for processing queries over external tables. In an embodiment, a database platform receives a query directed at least to data in an external table stored in a storage platform that is external to the database platform. The database platform uses metadata that summarizes the data in the external table to identify one or more partitions of the external table as potentially including data satisfying the query, and generates a query plan that includes a plurality of discrete subtasks that collectively include instructions to scan the identified one or more partitions of the external table for data satisfying the query. The database platform assigns, based on the metadata, the plurality of discrete subtasks to one or more nodes in an execution platform, and refreshes the metadata in response to a threshold number of modifications being made to the external table.

公开(公告)号：US11269866B2

公开(公告)日：2022-03-08

申请号：US17461208

申请日：2021-08-30

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Torsten Grabs ,  Benoit Dageville

IPC: G06F16/00 ,  G06F16/23 ,  G06F9/46

Abstract: Systems, methods, and devices for executing a task on database data in response to a trigger event are disclosed. A method includes executing a transaction on a table comprising database data, wherein executing the transaction comprises generating a new table version. The method includes, in response to the transaction being fully executed, generating a change tracking entry comprising an indication of one or more modifications made to the table by the transaction and storing the change tracking entry in a change tracking stream. The method includes executing a task on the new table version in response to a trigger event.

公开(公告)号：US20220035611A1

公开(公告)日：2022-02-03

申请号：US16945561

申请日：2020-07-31

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Isaac Kunen ,  Bing Li ,  Edward Ma ,  Srinath Shankar

IPC: G06F8/51 ,  G06F16/2452 ,  G06F16/27 ,  G06F16/242 ,  G06F16/901 ,  G06F16/2455

Abstract: The subject technology receives first code in a first programming language, the first code including a reference to a first dataset. The subject technology converting the first code to: second code in a second programming language different than the first programming language, and at least one data query in a second format different than the first programming language. Further the subject technology sends the converted first code and the at least one data query to a data system for execution.

公开(公告)号：US11194814B1

公开(公告)日：2021-12-07

申请号：US17302049

申请日：2021-04-22

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo ,  Zhuo Zhang

IPC: G06F16/245 ,  G06F16/2455 ,  G06F16/25 ,  G06F16/22

Abstract: A streaming ingest platform can improve latency and expense issues related to uploading data into a cloud data system. The streaming ingest platform can organize the data to be ingested into per-table chunks and per-account blobs. This data may be committed and may be made available for query processing before it is ingested into the target source tables. This significantly improves latency issues. The streaming ingest platform can also accommodate uploading data from various sources with different processing and communication capabilities, such as Internet of Things (IOT) devices.

公开(公告)号：US11188502B2

公开(公告)日：2021-11-30

申请号：US16813048

申请日：2020-03-09

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Tyler Jones

IPC: G06F16/17 ,  G06F16/182 ,  G06F16/18 ,  G06F11/14 ,  G06F16/14

Abstract: The subject technology receives an operation to perform on an external data source accessible via a network, the external data source being hosted by an external system separate from a network-based database system. The subject technology determines a set of shards corresponding to the external data source. The subject technology determines a set of offsets of each shard of the set of shards. The subject technology, based on the set of shards and the set of offsets, performs the operation on the external data source. The subject technology provides an indication that the operation is complete.

公开(公告)号：US20210357391A1

公开(公告)日：2021-11-18

申请号：US17389234

申请日：2021-07-29

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Torsten Grabs ,  Benoit Dageville

IPC: G06F16/23 ,  G06F9/46

Abstract: Systems, methods, and devices for executing a task on database data in response to a trigger event are disclosed. A method includes executing a transaction on a table comprising database data, wherein executing the transaction comprises generating a new table version. The method includes, in response to the transaction being fully executed, generating a change tracking entry comprising an indication of one or more modifications made to the table by the transaction and storing the change tracking entry in a change tracking stream. The method includes executing a task on the new table version in response to a trigger event.

公开(公告)号：US11169983B1

公开(公告)日：2021-11-09

申请号：US17364562

申请日：2021-06-30

Applicant: Snowflake Inc.

Inventor： Subramanian Muralidhar ,  Istvan Cseri ,  Torsten Grabs ,  Benoit Dageville

IPC: G06F16/23 ,  G06F16/27 ,  G06F16/245 ,  G06F9/46 ,  G06F16/18

Abstract: Systems, methods, and devices for generating a transactional change tracking summary for a database. A method includes executing a transaction on a table of a database, wherein the table includes a micro-partition and the transaction is executed on the micro-partition. The method includes, in response to the transaction being fully executed, generating a change tracking entry comprising an indication of one or modifications made to the table by the transaction. The method includes storing the change tracking entry in a change tracking stream, wherein the change tracking stream includes one or more sequential change tracking entries that each correspond to a different transaction that is fully executed on the table.