Low latency ingestion into a data system

    公开(公告)号:US11487788B1

    公开(公告)日:2022-11-01

    申请号:US17648228

    申请日:2022-01-18

    Applicant: Snowflake Inc.

    Abstract: Described herein are techniques for improving transfer of metadata from a metadata database to a database stored in a data system, such as a data warehouse. The metadata may be written into the metadata database with a version stamp, which is monotonic increasing register value, and a partition identifier, which can be generated using attribute values of the metadata. A plurality of readers can scan the metadata database based on version stamp and partition identifier values to export the metadata to a cloud storage location. From the cloud storage location, the exported data can be auto ingested into the database, which includes a journal and snapshot table.

    DEPLOYMENT INFRASTRUCTURE FOR SHARING USAGE METRICS WITH CUSTOMERS

    公开(公告)号:US20250061473A1

    公开(公告)日:2025-02-20

    申请号:US18452189

    申请日:2023-08-18

    Applicant: SNOWFLAKE INC.

    Abstract: A deployment infrastructure for sharing usage metrics with customers is described. An example method includes transforming a usage view file into an anonymous block build file. The usage view file corresponds to a view of customer usage data. The method includes embedding the anonymous block build file into a task, and executing the task to produce a share object that is based on the anonymous block build file. The method includes deploying the share object to a customer account, which enables the customer account to access the view of the customer usage data.

    Low latency ingestion into a data system

    公开(公告)号:US12235875B2

    公开(公告)日:2025-02-25

    申请号:US18456675

    申请日:2023-08-28

    Applicant: Snowflake Inc.

    Abstract: Described herein are techniques for improving transfer of metadata from a metadata database to a database stored in a data system, such as a data warehouse. The metadata may be written into the metadata database with a version stamp, which is monotonic increasing register value, and a partition identifier, which can be generated using attribute values of the metadata. A plurality of readers can scan the metadata database based on version stamp and partition identifier values to export the metadata to a cloud storage location. From the cloud storage location, the exported data can be auto ingested into the database, which includes a journal and snapshot table.

    LOW LATENCY INGESTION INTO A DATA SYSTEM
    4.
    发明公开

    公开(公告)号:US20230229672A1

    公开(公告)日:2023-07-20

    申请号:US17809931

    申请日:2022-06-30

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/278 G06F16/1815 G06F16/24532 G06F16/258

    Abstract: Described herein are techniques for improving transfer of metadata from a metadata database to a database stored in a data system, such as a data warehouse. The metadata may be written into the metadata database with a version stamp, which is monotonic increasing register value, and a partition identifier, which can be generated using attribute values of the metadata. A plurality of readers can scan the metadata database based on version stamp and partition identifier values to export the metadata to a cloud storage location. From the cloud storage location, the exported data can be auto ingested into the database, which includes a journal and snapshot table.

    LOW LATENCY INGESTION INTO A DATA SYSTEM
    5.
    发明公开

    公开(公告)号:US20230401235A1

    公开(公告)日:2023-12-14

    申请号:US18456675

    申请日:2023-08-28

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/278 G06F16/1815 G06F16/24532 G06F16/258

    Abstract: Described herein are techniques for improving transfer of metadata from a metadata database to a database stored in a data system, such as a data warehouse. The metadata may be written into the metadata database with a version stamp, which is monotonic increasing register value, and a partition identifier, which can be generated using attribute values of the metadata. A plurality of readers can scan the metadata database based on version stamp and partition identifier values to export the metadata to a cloud storage location. From the cloud storage location, the exported data can be auto ingested into the database, which includes a journal and snapshot table.

    Low latency ingestion into a data system

    公开(公告)号:US11775563B2

    公开(公告)日:2023-10-03

    申请号:US17809931

    申请日:2022-06-30

    Applicant: Snowflake Inc.

    CPC classification number: G06F16/278 G06F16/1815 G06F16/24532 G06F16/258

    Abstract: Described herein are techniques for improving transfer of metadata from a metadata database to a database stored in a data system, such as a data warehouse. The metadata may be written into the metadata database with a version stamp, which is monotonic increasing register value, and a partition identifier, which can be generated using attribute values of the metadata. A plurality of readers can scan the metadata database based on version stamp and partition identifier values to export the metadata to a cloud storage location. From the cloud storage location, the exported data can be auto ingested into the database, which includes a journal and snapshot table.

Patent Agency Ranking