-
公开(公告)号:US11314717B1
公开(公告)日:2022-04-26
申请号:US15632266
申请日:2017-06-23
Applicant: Amazon Technologies, Inc.
Inventor: Tate Andrew Certain , Anshul Gupta , Vaibhav Jain , Sharatkumar Nagesh Kuppahally , Alexander Richard Keyes , Rajaprabhu Thiruchi Loganathan , Ravi Math , Adam Douglas Morley , Lokendra Singh Panwar , Krishnan Seshadrinathan , James Christopher Sorenson, III , Stefano Stefani , Wei Xiao
Abstract: Scalable architecture for propagating updates may be implemented for data replicated from a data set. A node may receive updates to items in a data set that have been committed to the data set. The node may determine whether the update should be applied to a replicated portion of the data set. For updates that should be applied, the node may identify another node that hosts the replicated portion of the data set and send a request to the other node to perform a conditional atomic operation to apply the update to the item in the replicated portion of the data set. The condition may compare a version identifier associated with an update and a current version identifier for the item at the other node. If the condition evaluates true, then the update to the item in the replicated portion may be performed.
-
公开(公告)号:US11258725B2
公开(公告)日:2022-02-22
申请号:US16880740
申请日:2020-05-21
Applicant: Amazon Technologies, Inc.
Inventor: Parikshit Shivajirao Pol , Subramanian Sankara Subramanian , Rajaprabhu Thiruchi Loganathan , Rama Krishna Sandeep Pokkunuri , Gopinath Duddi , Akshat Vig , Safeer Mohiuddin , Sudarshan Narasimhan
IPC: G06F16/30 , H04L47/70 , G06F16/13 , G06F16/901 , G06F16/2455 , G06F9/50 , G06F11/34 , G06F16/23 , H04L43/065 , G06F11/30
Abstract: Information describing changes to a collection of items maintained by a database may be stored in a log file. The information in the log file may be converted into a stream of records describing the changes. The records may be directed to a computing node selected for performing a trigger function in response to the change, based on applying a hash function to a portion of the record, identifying a hash space associated with a value output by the hash function, and mapping from the hash space to the selected computing node.
-
公开(公告)号:US20210064476A1
公开(公告)日:2021-03-04
申请号:US17019072
申请日:2020-09-11
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin NG , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
IPC: G06F11/14
Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.
-
公开(公告)号:US10423493B1
公开(公告)日:2019-09-24
申请号:US14977472
申请日:2015-12-21
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Parikshit Shivajirao Pol , Subramanian Sankara Subramanian , Rama Krishna Sandeep Pokkunuri , Rajaprabhu Thiruchi Loganathan , Harini Chandrasekharan
Abstract: In response to determining that continuous data protection is to be enabled for a particular table of a database service, a service component verifies that automated transmission of change records of the table to a log-structured journal has been configured. A given change record comprises a before-image and an after-image associated with a committed database write, and is assigned a unique sequence number. In response to a determination to restore the table as of a specified point in time, a restore record set is identified from the journal with respect to a selected snapshot of the table. The restore record set includes change records which are not represented in the snapshot and are to be represented in the restored table. A restore result table is created using the selected snapshot and the restore record set.
-
公开(公告)号:US20140149537A1
公开(公告)日:2014-05-29
申请号:US13685615
申请日:2012-11-26
Applicant: Amazon Technologies, Inc.
Inventor: Nishanth Shankaran , Dong Shou , Rajat Arya , Clint Joseph Sbisa , Shyam Krishnamoorthy , Rajaprabhu Thiruchi Loganathan
IPC: G06F15/167
CPC classification number: H04L41/0816 , H04L41/0668 , H04L67/2842
Abstract: A management system may enable and monitor a cache or other cluster to make the cluster configuration-aware such that initialization and changes to the underlying structure of the cluster can be dynamically updated. For example, a distributed memory caching system may provide initial configuration to a client from a memory caching node referenced by an alias provided by a configuration endpoint. Updates of configuration may be retrieved from memory caching nodes, each storing current configuration of the cache cluster. A management system monitors changes to the cache cluster, such as provisioning of new caching nodes, and updates the configuration stored in the caching nodes for retrieval by a client.
Abstract translation: 管理系统可以启用和监视高速缓存或其他集群以使得集群配置感知到能够动态更新集群的基础结构的初始化和更改。 例如,分布式存储器高速缓存系统可以从由配置端点提供的别名引用的存储器缓存节点向客户端提供初始配置。 可以从存储器高速缓存节点检索配置的更新,每个缓存节点存储高速缓存集群的当前配置。 管理系统监视缓存集群的更改,例如提供新的缓存节点,并更新存储在缓存节点中的配置以供客户端检索。
-
公开(公告)号:US11588755B2
公开(公告)日:2023-02-21
申请号:US17589643
申请日:2022-01-31
Applicant: Amazon Technologies, Inc.
Inventor: Parikshit Shivajirao Pol , Subramanian Sankara Subramanian , Rajaprabhu Thiruchi Loganathan , Rama Krishna Sandeep Pokkunuri , Gopinath Duddi , Akshat Vig , Safeer Mohiuddin , Sudarshan Narasimhan
IPC: G06F16/30 , H04L47/70 , G06F16/13 , G06F16/901 , G06F16/2455 , G06F9/50 , G06F11/34 , G06F16/23 , H04L43/065 , G06F11/30
Abstract: Information describing changes to a collection of items maintained by a database may be stored in a log file. The information in the log file may be converted into a stream of records describing the changes. The records may be directed to a computing node selected for performing a trigger function in response to the change, based on applying a hash function to a portion of the record, identifying a hash space associated with a value output by the hash function, and mapping from the hash space to the selected computing node.
-
公开(公告)号:US20220158953A1
公开(公告)日:2022-05-19
申请号:US17589643
申请日:2022-01-31
Applicant: Amazon Technologies, Inc.
Inventor: Parikshit Shivajirao Pol , Subramanian Sankara Subramanian , Rajaprabhu Thiruchi Loganathan , Rama Krishna Sandeep Pokkunuri , Gopinath Duddi , Akshat Vig , Safeer Mohiuddin , Sudarshan Narasimhan
IPC: H04L47/70 , G06F16/13 , G06F16/901 , G06F16/2455 , G06F9/50 , G06F11/34 , G06F16/23 , H04L43/065
Abstract: Information describing changes to a collection of items maintained by a database may be stored in a log file. The information in the log file may be converted into a stream of records describing the changes. The records may be directed to a computing node selected for performing a trigger function in response to the change, based on applying a hash function to a portion of the record, identifying a hash space associated with a value output by the hash function, and mapping from the hash space to the selected computing node.
-
公开(公告)号:US11036591B2
公开(公告)日:2021-06-15
申请号:US16035465
申请日:2018-07-13
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to restore a given table that was backed up in a remote storage system (e.g., key-value durable storage system), the service may create a new table, and may import a copy of each of the partitions of the given table from the remote storage system into the new table. The request to restore the table may specify a modified value for a configuration parameter for the table or for one of its partitions. The service may apply the new configuration parameter value to the table or its partitions during the restore operation. The new configuration parameter value may indicate an increase or decrease in storage capacity or throughput capacity, and its application may automatically trigger a partition split or move operation.
-
公开(公告)号:US10853182B1
公开(公告)日:2020-12-01
申请号:US14977474
申请日:2015-12-21
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Lokendra Singh Panwar , Subramanian Sankara Subramanian , Rajaprabhu Thiruchi Loganathan , Parikshit Shivajirao Pol , Rama Krishna Sandeep Pokkunuri , Harini Chandrasekharan
Abstract: In response to determining that a secondary index is to be created for a particular table of a non-relational database service, a service component verifies that automated transmission of change records of the table to a log-structured journal has been configured. A given change record comprises a before-image and an after-image associated with a committed database write, and is assigned a unique sequence number. A change record propagator for the secondary index examines change records stored in the journal, and transmits selected change records to an index storage node. The index storage node builds the secondary index using the selected change records.
-
公开(公告)号:US10666574B2
公开(公告)日:2020-05-26
申请号:US14868236
申请日:2015-09-28
Applicant: Amazon Technologies, Inc.
Inventor: Parikshit Shivajirao Pol , Subramanian Sankara Subramanian , Rajaprabhu Thiruchi Loganathan , Rama Krishna Sandeep Pokkunuri , Gopinath Duddi , Akshat Vig , Safeer Mohiuddin , Sudarshan Narasimhan
IPC: G06F16/30 , H04L12/911 , G06F16/13 , G06F16/901 , G06F16/2455 , G06F9/50 , G06F11/34 , H04L12/26 , G06F11/30
Abstract: Information describing changes to a collection of items maintained by a database may be stored in a log file. The information in the log file may be converted into a stream of records describing the changes. The records may be directed to a computing node selected for performing a trigger function in response to the change, based on applying a hash function to a portion of the record, identifying a hash space associated with a value output by the hash function, and mapping from the hash space to the selected computing node.
-
-
-
-
-
-
-
-
-