-
公开(公告)号:US11327949B2
公开(公告)日:2022-05-10
申请号:US15495815
申请日:2017-04-24
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may export individual partitions of the table from the database and package them to be independently uploaded (e.g., in parallel) to a remote storage system (e.g., a key-value durable storage system). Prior to uploading the exported and packaged partitions to the remote storage system, the service may verify that the exported and packaged partitions can be subsequently restored, which may include unpackaging and/or re-inflating the exported and packaged partitions to create additional unpackaged copies of the partitions, re-importing the additional unpackaged copies of the partitions into the database (e.g., as additional replicas), and/or comparing checksums generated for the exported partitions with checksums generated for the additional unpackaged copies of the partitions.
-
52.
公开(公告)号:US20220067025A1
公开(公告)日:2022-03-03
申请号:US17472449
申请日:2021-09-10
Applicant: Amazon Technologies, Inc.
Inventor: Douglas Brian Terry , Tate Andrew Certain , Amit Gupta , Rishabh Jain , Vaibhav Jain , Alexander Richard Keyes , Somasundaram Perianayagam , Nathan Pellegrom Riley , Akshat Vig , Ming-Chuan Wu
IPC: G06F16/23 , G06F16/182 , G06F16/18 , G06F9/48 , G06F9/50
Abstract: Transaction requests may be ordered in a distributed database according to an independently assigned sequence. Different distributed system nodes, such as a transaction coordinator and a storage node may independently assign sequence numbers to requests to access a distributed database. A storage node may receive the request from a transaction coordinator with an assigned sequence number and another request to which the storage node may assign a sequence number. The storage node can then order performance of the requests based on the sequence numbers.
-
公开(公告)号:US11030220B2
公开(公告)日:2021-06-08
申请号:US16570891
申请日:2019-09-13
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Somasundaram Perianayagam , Tony Petrossian , Arijit Choudhury , James Christopher Sorenson, III , Alexander Richard Keyes , Akanksha Fouzdar , Mark Roper , Oren Yossef , Joon Ahn
Abstract: Systems and methods are disclosed to implement, in a database system, global table management operations for global tables or objects that are replicated across multiple locations. In embodiments, for a regional replica of a global table, a requested change to a metadata property of the replica (e.g., an attribute data type, a write throughput limit, or a time-to-live setting) is propagated to other replicas of the global table at other locations. In embodiments, before performing the requested management operation, the database system may first verify that the operation can be successfully performed in all locations. In embodiments, the operation may be performed optimistically without verification, and rolled back if it cannot be performed everywhere. In embodiments, to serialize management operations on a global table, the database system may check for other pending management operations via a shared control object, and proceed when any pending operations are finished.
-
公开(公告)号:US10853194B1
公开(公告)日:2020-12-01
申请号:US15812901
申请日:2017-11-14
Applicant: Amazon Technologies, Inc.
Inventor: Tate Andrew Certain , Vaibhav Govil , Go Hori , Akshat Vig
IPC: G06F16/00 , G06F11/14 , G06F16/22 , G06F16/2455
Abstract: A selective data restoration technique is disclosed. A request to recover data in a dataset is received along with an identifier of a particular portion of the data to be recovered. The request may specify a time that indicates a desired recovery state (e.g., recover the values as they were at the time). Change data is determined for the specified time. For example, data stream filters generate recovery data by applying filters (e.g., keys) to a time window batch of the stream data. The stream data may correspond to changes to a data set, and the recovery data may correspond to only a portion of the dataset (e.g., a portion of a table). The system performs a recovery action, based on the recovery data, using the recovery data to automatically restore data in a data store, or providing the recovery date to the requesting entity, for example.
-
公开(公告)号:US10754844B1
公开(公告)日:2020-08-25
申请号:US15717614
申请日:2017-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Vaibhav Jain , Tate Andrew Certain , James Christopher Sorenson, III , Sharatkumar Nagesh Kuppahally , Akshat Vig , Go Hori , Chase Kernan , Naveen Ganapathi Subramanian , Nicholas Gordon
Abstract: Various systems and methods to efficiently store backups of partitions of a database are disclosed. An indication to take a current snapshot of a partition of the database is received. A log size and operation type statistics are determined for a portion of the change log for the partition. A snapshot type is determined for the partition based at least in part on the log size and the operation type statistics, where the snapshot type specifies a log-based snapshot or a full snapshot. The snapshot is stored as metadata indicating a point in the change log if the determined snapshot type is log-based snapshot or stored as complete data of the partition if the determined snapshot type is full snapshot.
-
公开(公告)号:US10025673B1
公开(公告)日:2018-07-17
申请号:US14032870
申请日:2013-09-20
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to restore a given table that was backed up in a remote storage system (e.g., key-value durable storage system), the service may create a new table, and may import a copy of each of the partitions of the given table from the remote storage system into the new table. The request to restore the table may specify a modified value for a configuration parameter for the table or for one of its partitions. The service may apply the new configuration parameter value to the table or its partitions during the restore operation. The new configuration parameter value may indicate an increase or decrease in storage capacity or throughput capacity, and its application may automatically trigger a partition split or move operation.
-
公开(公告)号:US09996573B1
公开(公告)日:2018-06-12
申请号:US14222377
申请日:2014-03-21
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Wei Xiao , Somasundaram Perianayagam , Timothy Andrew Rath , Barry Bailey Hunter, Jr. , Kiran-Kumar Muniswamy-Reddy , Yijun Lu , Qiang Liu , Ying Lin , Stuart Henry Seelye Marshall
IPC: G06F17/30
CPC classification number: G06F17/30584
Abstract: A hosted service may limit access to a table initially comprising one or more partitions. Access to the table may be limited to a provisioned capacity. A client of the service may request an increased capacity. A minimum number of partitions for providing the increased capacity may be determined. Proportions of the increased capacity may be allocated among members of successive generations of partitions to be provided by a member of a generation or its descendants. The proportions may be allocated to minimize the costs associated with splitting partitions based on the minimum number of partitions.
-
公开(公告)号:US20170228417A1
公开(公告)日:2017-08-10
申请号:US15495815
申请日:2017-04-24
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin NG , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
CPC classification number: G06F16/2365 , G06F11/1451 , G06F11/1464 , G06F11/1469 , G06F11/2094 , G06F16/24561 , G06F16/278 , G06F2201/80 , G06F2201/84
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may export individual partitions of the table from the database and package them to be independently uploaded (e.g., in parallel) to a remote storage system (e.g., a key-value durable storage system). Prior to uploading the exported and packaged partitions to the remote storage system, the service may verify that the exported and packaged partitions can be subsequently restored, which may include unpackaging and/or re-inflating the exported and packaged partitions to create additional unpackaged copies of the partitions, re-importing the additional unpackaged copies of the partitions into the database (e.g., as additional replicas), and/or comparing checksums generated for the exported partitions with checksums generated for the additional unpackaged copies of the partitions.
-
公开(公告)号:US09632878B1
公开(公告)日:2017-04-25
申请号:US14032894
申请日:2013-09-20
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
CPC classification number: G06F11/1469 , G06F11/1464 , G06F11/2094 , G06F2201/80
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may export individual partitions of the table from the database and package them to be independently uploaded (e.g., in parallel) to a remote storage system (e.g., a key-value durable storage system). Prior to uploading the exported and packaged partitions to the remote storage system, the service may verify that the exported and packaged partitions can be subsequently restored, which may include unpackaging and/or re-inflating the exported and packaged partitions to create additional unpackaged copies of the partitions, re-importing the additional unpackaged copies of the partitions into the database (e.g., as additional replicas), and/or comparing checksums generated for the exported partitions with checksums generated for the additional unpackaged copies of the partitions.
-
公开(公告)号:US20170093755A1
公开(公告)日:2017-03-30
申请号:US14868236
申请日:2015-09-28
Applicant: Amazon Technologies, Inc.
Inventor: Parikshit Shivajirao Pol , Subramanian Sankara Subramanian , Rajaprabhu Thiruchi Loganathan , Rama Krishna Sandeep Pokkunuri , Gopinath Duddi , Akshat Vig , Safeer Mohiuddin , Sudarshan Narasimhan
IPC: H04L12/911 , H04L12/26 , G06F17/30
Abstract: Information describing changes to a collection of items maintained by a database may be stored in a log file. The information in the log file may be converted into a stream of records describing the changes. The records may be directed to a computing node selected for performing a trigger function in response to the change, based on applying a hash function to a portion of the record, identifying a hash space associated with a value output by the hash function, and mapping from the hash space to the selected computing node.
-
-
-
-
-
-
-
-
-