-
公开(公告)号:US20210318994A1
公开(公告)日:2021-10-14
申请号:US17345422
申请日:2021-06-11
申请人: Snowflake Inc.
IPC分类号: G06F16/18 , G06F16/182 , G06F16/2453 , G06F16/2455 , G06F16/23
摘要: The subject technology determines, using a stream object provided by a network-based database system separate from an external system, a set of offsets of each shard of a set of shards, the set of offsets being determined by executing a user defined function (UDF) included in the stream object, the stream object and the UDF being implemented in a particular programming language different than a database query language. The subject technology identifies an operation to perform on the set of shards. The subject technology, based on the set of shards and the set of offsets, performs, using the UDF included in the stream object, the operation on an external data source hosted by the external system. The subject technology increments a property indicating a different version of the stream object after performing the operation on the external data source, the property being included in the stream object.
-
公开(公告)号:US11086841B1
公开(公告)日:2021-08-10
申请号:US16779045
申请日:2020-01-31
申请人: Snowflake Inc.
IPC分类号: G06F16/00 , G06F16/23 , G06F16/2457 , G06F16/17 , G06F16/18 , G06F16/16 , G06F16/22 , G06F16/182
摘要: A database platform can track changes using a stream that records changes made by database transactions. Streams on views can be implemented by applying a stream to source data, and applying the view to the streamed data. Users of the database platform can query the stream on the view to review recent changes to the view, such as changes made since the last database transaction.
-
公开(公告)号:US20210240690A1
公开(公告)日:2021-08-05
申请号:US16779045
申请日:2020-01-31
申请人: Snowflake Inc.
IPC分类号: G06F16/23 , G06F16/22 , G06F16/2457 , G06F16/17 , G06F16/18 , G06F16/16 , G06F16/182
摘要: A database platform can track changes using a stream that records changes made by database transactions. Streams on views can be implemented by applying a stream to source data, and applying the view to the streamed data. Users of the database platform can query the stream on the view to review recent changes to the view, such as changes made since the last database transaction.
-
公开(公告)号:US11080257B2
公开(公告)日:2021-08-03
申请号:US16410695
申请日:2019-05-13
申请人: Snowflake Inc.
摘要: Systems, methods, and devices for storing database data in journal tables comprising a snapshot and a log table. A method includes defining a journal table comprising a snapshot and a log table, the snapshot comprising an up-to-date representation of data in the journal table at a point in time. The method includes assigning a timestamp to the snapshot indicating when the snapshot was generated. The method includes receiving a request to execute a transaction on the journal table to modify the data in the journal table, the transaction comprising one or more of an insert, a delete, an update, or a merge. The method includes inserting a new row into the log table in lieu of executing the transaction on the snapshot of the journal table, the new row comprising an indication of a change requested to be made to the journal table based on the transaction.
-
公开(公告)号:US10983980B2
公开(公告)日:2021-04-20
申请号:US16942717
申请日:2020-07-29
申请人: Snowflake Inc.
发明人: Istvan Cseri , Torsten Grabs , Benoit Dageville
IPC分类号: G06F16/23 , G06F16/27 , G06F16/2455
摘要: The subject technology executes a change on an existing micro-partition of a table of a database, the executing of the change comprising generating a new micro-partition that embodies the change. The subject technology receives a request for a delta for the table between a first timestamp and a second timestamp. The subject technology queries at least one change tracking column to determine the delta between the first timestamp and the second timestamp, the delta including information indicating at least one database operation that was performed to at least one row of a set of rows of the table, without including information as to intermediate changes made to at least one row of the set of rows of the table between the first timestamp and the second timestamp, that facilitates a reduction in storage of historical versions of the set of rows of the table.
-
公开(公告)号:US20200167340A1
公开(公告)日:2020-05-28
申请号:US16203322
申请日:2018-11-28
申请人: Snowflake Inc.
发明人: Istvan Cseri , Torsten Grabs , Benoit Dageville
摘要: Systems, methods, and devices for executing a task on database data in response to a trigger event are disclosed. A method includes executing a transaction on a table comprising database data, wherein executing the transaction comprises generating a new table version. The method includes, in response to the transaction being fully executed, generating a change tracking entry comprising an indication of one or more modifications made to the table by the transaction and storing the change tracking entry in a change tracking stream. The method includes executing a task on the new table version in response to a trigger event.
-
公开(公告)号:US20240311369A1
公开(公告)日:2024-09-19
申请号:US18668993
申请日:2024-05-20
申请人: Snowflake Inc.
发明人: Torsten Grabs , Istvan Cseri , Benoit Dageville
IPC分类号: G06F16/23 , G06F16/22 , G06F16/2455
CPC分类号: G06F16/2379 , G06F16/2282 , G06F16/24554 , G06F16/2456
摘要: Systems, methods, and devices for tracking a series of changes to database data are disclosed. A method includes executing a transaction to modify data in a micro-partition of a table of a database by generating a new micro-partition that embodies the transaction. The method includes associating transaction data with the new micro-partition, wherein the transaction data comprises a timestamp when the transaction was fully executed, and further includes associating modification data with the new micro-partition that comprises an indication of one or more rows of the table that were modified by the transaction. The method includes joining the transaction data with the modification data to generate joined data and querying the joined data to determine a listing of intermediate modifications made to the table between a first timestamp and a second timestamp.
-
公开(公告)号:US20240281557A1
公开(公告)日:2024-08-22
申请号:US18652655
申请日:2024-05-01
申请人: SNOWFLAKE INC.
发明人: Damien Carru , Jeremy Yujui Chen , Pui Kei Johnston Chu , Thierry Cruanes , Istvan Cseri , Benoit Dageville , Unmesh Jagtap , Subramanian Muralidhar
CPC分类号: G06F21/6227 , G06F9/44505 , G06Q30/06 , G06F2221/2141
摘要: Embodiments of the present disclosure related to sharing applications within a data sharing platform. An example method includes replicating a database from a provider account of a data sharing platform to a consumer account of the data sharing platform. The method further includes executing an installation script within the consumer account to install an application in the consumer account of the data sharing platform responsive to the replicating. The method further includes creating, by a processing device, a set of database roles to manage execution of the application in the consumer account, wherein one or more of the set of database roles determine access privileges granted to the application for accessing the database inside the consumer account. The application is to perform a data processing service relative to a data asset in the database.
-
公开(公告)号:US20240095229A1
公开(公告)日:2024-03-21
申请号:US18520845
申请日:2023-11-28
申请人: Snowflake Inc.
发明人: Istvan Cseri , Torsten Grabs , Benoit Dageville
IPC分类号: G06F16/23 , G06F16/2455 , G06F16/27
CPC分类号: G06F16/2358 , G06F16/2455 , G06F16/278
摘要: A method includes detecting, by at least one hardware processor, a change request for a table of a database, the table comprising a plurality of micro-partitions. A transaction associated with the change request is executed at a first timestamp. The transaction causes replacement of a first micro-partition of the plurality of micro-partitions with a second micro-partition. A change tracking column is generated in the second micro-partition. The change tracking column comprises metadata for the transaction. A delta for the table between the first timestamp and a second timestamp is generated using the metadata in the change tracking column. The delta indicates changes made to one or more rows of the table between the first time stamp and the second timestamp.
-
公开(公告)号:US11880381B1
公开(公告)日:2024-01-23
申请号:US18351661
申请日:2023-07-13
申请人: Snowflake Inc.
发明人: Annissa Al-Alusi , Istvan Cseri , Yifung Lin , Jue Liu , Michael Joseph Papale , William A. Pugh , Jeffrey Shaw , Wei Song , Thiago Teixeira
IPC分类号: G06F16/248 , G06F16/2453 , G06F16/2455
CPC分类号: G06F16/248 , G06F16/24542 , G06F16/24568
摘要: A data platform for running a subset of cells in a notebook is provided. The data platform receives a run cells message from a notebook user interface (UI) application specifying the subset of cells to run. For each cell in the subset, the data platform runs the cell to generate a set of results, generates a cell execution stream using the results, stores the stream, and transmits the stream to the notebook UI application. The notebook UI application generates a display for the user using the cell execution stream. The data platform provides an efficient way to run specific cells in a notebook and display the results to the user.
-
-
-
-
-
-
-
-
-