Data clean rooms using defined access

    公开(公告)号:US11803432B1

    公开(公告)日:2023-10-31

    申请号:US18051457

    申请日:2022-10-31

    Applicant: Snowflake Inc.

    CPC classification number: G06F9/547 G06F9/541 G06F16/2456 G06F21/6254

    Abstract: In an embodiment, a data platform creates an application in a data-provider account. The application includes one or more APIs corresponding to one or more underlying code blocks. The data platform shares provider data with the application in the data-provider account, and also installs, in a data-consumer account, an application instance of the application. The application instance includes one or more APIs corresponding to the one or more APIs in the application in the data-provider account. The data platform shares consumer data with the application instance in the data-consumer account, and invokes one or more of the APIs of the application instance to execute respective associated underlying code blocks, which are not visible to the data-consumer account. The data platform also saves output of the one or more respective associated underlying code blocks locally within the data-consumer account.

    SCALABLE COMPACTION FOR A DISTRIBUTED DATABASE
    102.
    发明公开

    公开(公告)号:US20230325409A1

    公开(公告)日:2023-10-12

    申请号:US18326683

    申请日:2023-05-31

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/273 G06F16/2343 G06F16/2379

    Abstract: The subject technology performs, using asynchronous threads of execution nodes of a distributed database, asynchronous transformation and compaction of key-value pairs of data that correspond to a plurality of transactional queries, the asynchronous threads transforming the key-value pairs from an initial format to a commit format that includes a commit time of data committed to the distributed database, the asynchronous threads compacting the key-value pairs by deleting the key-value pairs in the initial format. The subject technology processes, using transactional threads in the execution nodes, the plurality of transactional queries to generate results data, the asynchronous threads performing the asynchronous transformation and compaction while the transactional threads generate the results data. The subject technology stores the results data.

    CONCURRENT TRANSACTIONS CONSISTENCY IN DATABASE SYSTEMS

    公开(公告)号:US20230325376A1

    公开(公告)日:2023-10-12

    申请号:US18326950

    申请日:2023-05-31

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/2329 G06F16/2282 G06F16/24568 G06F16/248

    Abstract: The subject technology performs a read operation from a first transaction on a table in a database. The subject technology determines a first commit version identifier corresponding to first data resulting from the read operation. The subject technology proceeds to perform a particular write operation from the first transaction. The subject technology determines that the first commit version identifier fails to match a second commit version identifier corresponding to a second transaction. The subject technology aborts the particular write operation from the first transaction. The subject technology performs a particular read operation from the first transaction. The subject technology determines a particular commit version identifier corresponding to particular data resulting from the particular read operation. The subject technology retries to perform the particular write operation. The subject technology performs the particular write operation in response to the particular commit version identifier matching the second commit version identifier.

    Low latency ingestion into a data system

    公开(公告)号:US11775563B2

    公开(公告)日:2023-10-03

    申请号:US17809931

    申请日:2022-06-30

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/278 G06F16/1815 G06F16/24532 G06F16/258

    Abstract: Described herein are techniques for improving transfer of metadata from a metadata database to a database stored in a data system, such as a data warehouse. The metadata may be written into the metadata database with a version stamp, which is monotonic increasing register value, and a partition identifier, which can be generated using attribute values of the metadata. A plurality of readers can scan the metadata database based on version stamp and partition identifier values to export the metadata to a cloud storage location. From the cloud storage location, the exported data can be auto ingested into the database, which includes a journal and snapshot table.

    Feature sets using semi-structured data storage

    公开(公告)号:US11775544B2

    公开(公告)日:2023-10-03

    申请号:US18162522

    申请日:2023-01-31

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/25 G06F16/2282 G06F16/24558 G06F16/86

    Abstract: The subject technology receives by a database system, raw input data from a source table provided by an external environment, the source table comprising multiple rows and multiple columns, the raw input data comprising values in a first format, the values comprising input features corresponding to datasets included in the raw input data for machine learning models, the external environment comprising an external system from the database system and is accessed by different users. The subject technology generates cell data for a second table based on the values from the source table. The subject technology performs a database operation to generate the second table including table metadata, column metadata, and the generated cell data.

    Key prefix driven data encryption in tree structures

    公开(公告)号:US11762846B1

    公开(公告)日:2023-09-19

    申请号:US18087726

    申请日:2022-12-22

    Applicant: Snowflake Inc.

    Abstract: The subject technology receives a transaction for performing an operation on a distributed database, the transaction associated with an account. The subject technology identifies a tenant corresponding to the account associated with the transaction. The subject technology retrieves a set of encryption keys based at least in part on the account and the tenant. The subject technology determines a derived encryption key using a cryptographic hash function applied to a hybrid tenant master encryption key and a local random generated identifier. The subject technology encrypts a record value and a key value associated with transaction using the derived encryption key. The subject technology determines a tree structure associated with the tenant. The subject technology determines a non-leaf node using a tenant prefix of the tenant. The subject technology inserts the encrypted record value, and the encrypted key value at a leaf node below the non-leaf node of the tree structure.

    SOFTWARE BUGS DETECTION USING QUERY ANALYSIS
    109.
    发明公开

    公开(公告)号:US20230281196A1

    公开(公告)日:2023-09-07

    申请号:US18318293

    申请日:2023-05-16

    Applicant: Snowflake Inc.

    Inventor: Orestis Kostakis

    CPC classification number: G06F16/245 G06F11/362

    Abstract: A method includes parsing, by at least one hardware processor, a query to determine query comments and query code associated with the query. A query execution plan is generated based on the query code. Query execution using the query code is performed at a first computing node associated with a query processing pipeline. A detection is made that the query comments are indicative of a software bug in the query code based on analysis of the query comments. The detection is performed at a second computing node associated with a query analysis pipeline. A notification of the software bug and a result of the query execution is output.

    Certificate revocation check proxy service

    公开(公告)号:US11750406B2

    公开(公告)日:2023-09-05

    申请号:US17823922

    申请日:2022-08-31

    Applicant: Snowflake Inc.

    CPC classification number: H04L9/3268 H04L9/3297 H04L67/289 H04L67/1097

    Abstract: A proxy revocation service provides a reliable service for performing revocation checks. The proxy revocation service queries public certificate authorities for the revocation status of a set of digital certificates and maintains a database of the revocation statuses. The proxy revocation service provides a singular endpoint that is Application Protocol Interface (API) accessible to web clients. Web clients communicate with the proxy revocation service through use of API message to perform revocation checks, rather than communicating with the public certificate authorities using an online certificate status protocol (OCSP). Use of the proxy revocation service provides both a reliable service for performing revocation checks as well as shifts the complexity away from the web clients.

Patent Agency Ranking