-
公开(公告)号:US11928099B1
公开(公告)日:2024-03-12
申请号:US18067692
申请日:2022-12-16
Applicant: Amazon Technologies, Inc.
Inventor: James Christopher Sorenson, III , Hao He , Nicholas Gordon , Mrithyunjaya Kumar Annapragada
CPC classification number: G06F16/2358 , G06F11/1451 , G06F16/219 , G06F16/2365 , G06F21/602 , G06F16/113 , G06F2201/84
Abstract: Time and value ordering may be applied for items stored in data backups. A change log that persists changes to a data set may be updated with changes and used to update an in-memory table for the data set, which describes changes to items up to a current time. An event may be detected to seal the in-memory table from subsequent updates and a persistent data object that orders the items in the in-memory according to both keys of the respective items and the respective time values of the items, as stored in the change log, may be generated and stored as part of a backup for the data set.
-
公开(公告)号:US11860892B2
公开(公告)日:2024-01-02
申请号:US17670332
申请日:2022-02-11
Applicant: Amazon Technologies, Inc.
Inventor: Sharatkumar Nagesh Kuppahally , Peter Zhivkov , Somasundaram Perianayagam , James Christopher Sorenson, III , Amit Gupta , Chase Kernan , Nicholas Gordon , Ravi Math , Vaibhav Jain , Remi Paucher
CPC classification number: G06F16/27 , G06F16/2282
Abstract: Offline building of a projected data subset may be performed. A request to create a data set that is a projected subset of data from a source data set may be received. A data store separate from the data store storing the source data set may store a copy of the source data set that is used to replicate items to the projected subset of data according to a schema for the projected data subset. Updates made to the source data set may also be replicated to the projected data subset according to the schema. Conflicts between replicated items and replicated updates to the projected data set may be resolved by comparing a version identifier for the replicated update and replicated item to determine what to store in the projected data subset.
-
公开(公告)号:US11698914B1
公开(公告)日:2023-07-11
申请号:US17548042
申请日:2021-12-10
Applicant: Amazon Technologies, Inc.
Inventor: Divyank Duvedi , Akshat Vig , Somasundaram Perianayagam , Nicholas Gordon
CPC classification number: G06F16/252 , G06F16/2228 , G06F16/278 , G06F16/28
Abstract: A system receives a request to import data file(s) from a source data store into a target database. The system reserves a first portion of computing resources that host the target database to import the data file(s). The reservation of the first portion of computing resources permits the import throughput rate of the data file(s) through the first portion of computing resources while maintaining a second portion of the computing resources to support client access to the target database at an access throughput rate. The system initiates import of the data file(s) from the source data store to the target database through one or more storage nodes at the import throughput rate according to the first portion of computing resources. The target database is able to receive access requests from one or more clients during the import of the data file(s) to the target database.
-
公开(公告)号:US20230185671A1
公开(公告)日:2023-06-15
申请号:US18167802
申请日:2023-02-10
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Tate A. Certain , Nicholas Gordon , Go Hori
CPC classification number: G06F11/1451 , G06F11/1471 , G06F11/1464 , G06F11/1469 , G06F11/1461 , G06F16/27 , G06F2201/84 , G06F2201/80
Abstract: An interface for requesting, and technique for generation of, a backup of a past state of a database table are provided. Changes made to a database table are accumulated, in durable storage, and snapshots of partitions of the table are obtained. The accumulated changes and the successive partition snapshots are used to generate a past state of the database at any point in time across a continuum between successive snapshots. Although each partition of the table may have a snapshot that was generated at a time different from when other partition snapshots were generated, changes from respective change logs may be selectively log-applied to distinct partitions of a table to generate backup in the past of the entire table at common point-in-time across partitions.
-
公开(公告)号:US10754844B1
公开(公告)日:2020-08-25
申请号:US15717614
申请日:2017-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Vaibhav Jain , Tate Andrew Certain , James Christopher Sorenson, III , Sharatkumar Nagesh Kuppahally , Akshat Vig , Go Hori , Chase Kernan , Naveen Ganapathi Subramanian , Nicholas Gordon
Abstract: Various systems and methods to efficiently store backups of partitions of a database are disclosed. An indication to take a current snapshot of a partition of the database is received. A log size and operation type statistics are determined for a portion of the change log for the partition. A snapshot type is determined for the partition based at least in part on the log size and the operation type statistics, where the snapshot type specifies a log-based snapshot or a full snapshot. The snapshot is stored as metadata indicating a point in the change log if the determined snapshot type is log-based snapshot or stored as complete data of the partition if the determined snapshot type is full snapshot.
-
公开(公告)号:US12174845B1
公开(公告)日:2024-12-24
申请号:US17937419
申请日:2022-09-30
Applicant: Amazon Technologies, Inc.
Inventor: Nicholas Gordon , Akshat Vig , Amit Purohit , Ravi Math , Joseph Robert Idziorek , Christopher John Anderson
IPC: G06F16/00 , G06F11/14 , G06F16/2458
Abstract: Queries may be made against a non-relational database without impacting the capacities of the non-relational database by enabling performance of queries to a non-relational database via an external query management, backup management, and a non-relational database backup hosted in an external data storage. The query management and backup management of the non-relational database service may split transactional load to the non-relational database and analytical load, and furthermore allow selection of a desired data freshness for queries including various time ranges, such as seconds, minutes, or days.
-
公开(公告)号:US11860835B1
公开(公告)日:2024-01-02
申请号:US16915879
申请日:2020-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Almero Gouws , Steven A Mayszak , Olaf Anders Grette , Arturo Hinojosa , Lakshmi Narasimha Guptha Munuhur Rajagopal , Nicholas Gordon , Somasundaram Perianayagam
IPC: G06F16/215 , G06F16/22 , G06F16/23
CPC classification number: G06F16/215 , G06F16/221 , G06F16/2365
Abstract: Columns of a non-relational data store may be efficiently dropped. A drop column request for a table stored in a non-relational database may be received. In response to the drop column request, schema information for the table may be updated to filter out the column from subsequent read responses to read requests. A backup of the table is created and evaluated to identify those items in the table that include the column. The column is then deleted from the identified items.
-
公开(公告)号:US11595205B1
公开(公告)日:2023-02-28
申请号:US16693167
申请日:2019-11-22
Applicant: Amazon Technologies, Inc.
Inventor: Sroaj Sosothikul , Akshat Vig , Avinash Kodakandla , Nicholas Gordon , Sharan Rajesh Munyal , Somasundaram Perianayagam , Mazen Moez Ali , Ravi Math
Abstract: A distributed database encrypts a table using a table encryption key protected by a client master encryption key. The encrypted table is replicated among a plurality of nodes of the distributed database. The table encryption key is replicated among the plurality of nodes, and is stored on each node in a respective secure memory. In the event of node failure, a copy of the stored key held by another member of the replication group is used to restore a node to operation. The replication group may continue operation in the event of a revocation of authorization to access the client master encryption key.
-
公开(公告)号:US20220164366A1
公开(公告)日:2022-05-26
申请号:US17670332
申请日:2022-02-11
Applicant: Amazon Technologies, Inc.
Inventor: Sharatkumar Nagesh Kuppahally , Peter Zhivkov , Somasundaram Perianayagam , James Christopher Sorenson, III , Amit Gupta , Chase Kernan , Nicholas Gordon , Ravi Math , Vaibhav Jain , Remi Paucher
Abstract: Offline building of a projected data subset may be performed. A request to create a data set that is a projected subset of data from a source data set may be received. A data store separate from the data store storing the source data set may store a copy of the source data set that is used to replicate items to the projected subset of data according to a schema for the projected data subset. Updates made to the source data set may also be replicated to the projected data subset according to the schema. Conflicts between replicated items and replicated updates to the projected data set may be resolved by comparing a version identifier for the replicated update and replicated item to determine what to store in the projected data subset.
-
公开(公告)号:US20220004462A1
公开(公告)日:2022-01-06
申请号:US17478162
申请日:2021-09-17
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Tate A. Certain , Nicholas Gordon , Go Hori
Abstract: An interface for requesting, and technique for generation of, a backup of a past state of a database table are provided. Changes made to a database table are accumulated, in durable storage, and snapshots of partitions of the table are obtained. The accumulated changes and the successive partition snapshots are used to generate a past state of the database at any point in time across a continuum between successive snapshots. Although each partition of the table may have a snapshot that was generated at a time different from when other partition snapshots were generated, changes from respective change logs may be selectively log-applied to distinct partitions of a table to generate backup in the past of the entire table at common point-in-time across partitions.
-
-
-
-
-
-
-
-
-