-
公开(公告)号:US09262323B1
公开(公告)日:2016-02-16
申请号:US13685620
申请日:2012-11-26
Applicant: Amazon Technologies, Inc.
Inventor: Nishanth Shankaran , Rajaprabhu Thiruchi Loganathan , Dong Shou , Clint Joseph Sbisa , Shyam Krishnamoorthy , Rajat Arya
CPC classification number: G06F12/0868 , G06F17/30212 , G06F2212/286 , G06F2212/314 , H04L67/2842
Abstract: A cache cluster is configuration-aware such that client initialization, access to replicated cached data and changes to the underlying structure of the cache cluster can be dynamically updated. For example, a management system monitoring a cache cluster notices a large number of requests for a key that causes a significant load on a first memory caching node. To reduce the load on the first memory caching node, the management system may cause cached data related to the key to be replicated to a second memory caching node. A configuration stored in one or more of the memory caching nodes may be updated by the management system to allow both memory caching nodes to serve the requests for the key to clients.
Abstract translation: 高速缓存集群具有配置感知能力,可以动态更新客户机初始化,对复制的缓存数据的访问以及对缓存集群的底层结构的更改。 例如,监视高速缓存集群的管理系统通知大量的对第一内存缓存节点造成重大负载的密钥请求。 为了减少第一存储器高速缓存节点上的负载,管理系统可以使与密钥相关的高速缓存的数据被复制到第二存储器高速缓存节点。 存储在一个或多个存储器高速缓存节点中的配置可以由管理系统更新,以允许存储器高速缓存节点向客户端发送对密钥的请求。
-
公开(公告)号:US11327949B2
公开(公告)日:2022-05-10
申请号:US15495815
申请日:2017-04-24
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may export individual partitions of the table from the database and package them to be independently uploaded (e.g., in parallel) to a remote storage system (e.g., a key-value durable storage system). Prior to uploading the exported and packaged partitions to the remote storage system, the service may verify that the exported and packaged partitions can be subsequently restored, which may include unpackaging and/or re-inflating the exported and packaged partitions to create additional unpackaged copies of the partitions, re-importing the additional unpackaged copies of the partitions into the database (e.g., as additional replicas), and/or comparing checksums generated for the exported partitions with checksums generated for the additional unpackaged copies of the partitions.
-
公开(公告)号:US10025673B1
公开(公告)日:2018-07-17
申请号:US14032870
申请日:2013-09-20
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to restore a given table that was backed up in a remote storage system (e.g., key-value durable storage system), the service may create a new table, and may import a copy of each of the partitions of the given table from the remote storage system into the new table. The request to restore the table may specify a modified value for a configuration parameter for the table or for one of its partitions. The service may apply the new configuration parameter value to the table or its partitions during the restore operation. The new configuration parameter value may indicate an increase or decrease in storage capacity or throughput capacity, and its application may automatically trigger a partition split or move operation.
-
公开(公告)号:US20170228417A1
公开(公告)日:2017-08-10
申请号:US15495815
申请日:2017-04-24
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin NG , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
CPC classification number: G06F16/2365 , G06F11/1451 , G06F11/1464 , G06F11/1469 , G06F11/2094 , G06F16/24561 , G06F16/278 , G06F2201/80 , G06F2201/84
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may export individual partitions of the table from the database and package them to be independently uploaded (e.g., in parallel) to a remote storage system (e.g., a key-value durable storage system). Prior to uploading the exported and packaged partitions to the remote storage system, the service may verify that the exported and packaged partitions can be subsequently restored, which may include unpackaging and/or re-inflating the exported and packaged partitions to create additional unpackaged copies of the partitions, re-importing the additional unpackaged copies of the partitions into the database (e.g., as additional replicas), and/or comparing checksums generated for the exported partitions with checksums generated for the additional unpackaged copies of the partitions.
-
公开(公告)号:US09632878B1
公开(公告)日:2017-04-25
申请号:US14032894
申请日:2013-09-20
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
CPC classification number: G06F11/1469 , G06F11/1464 , G06F11/2094 , G06F2201/80
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may export individual partitions of the table from the database and package them to be independently uploaded (e.g., in parallel) to a remote storage system (e.g., a key-value durable storage system). Prior to uploading the exported and packaged partitions to the remote storage system, the service may verify that the exported and packaged partitions can be subsequently restored, which may include unpackaging and/or re-inflating the exported and packaged partitions to create additional unpackaged copies of the partitions, re-importing the additional unpackaged copies of the partitions into the database (e.g., as additional replicas), and/or comparing checksums generated for the exported partitions with checksums generated for the additional unpackaged copies of the partitions.
-
公开(公告)号:US20170093755A1
公开(公告)日:2017-03-30
申请号:US14868236
申请日:2015-09-28
Applicant: Amazon Technologies, Inc.
Inventor: Parikshit Shivajirao Pol , Subramanian Sankara Subramanian , Rajaprabhu Thiruchi Loganathan , Rama Krishna Sandeep Pokkunuri , Gopinath Duddi , Akshat Vig , Safeer Mohiuddin , Sudarshan Narasimhan
IPC: H04L12/911 , H04L12/26 , G06F17/30
Abstract: Information describing changes to a collection of items maintained by a database may be stored in a log file. The information in the log file may be converted into a stream of records describing the changes. The records may be directed to a computing node selected for performing a trigger function in response to the change, based on applying a hash function to a portion of the record, identifying a hash space associated with a value output by the hash function, and mapping from the hash space to the selected computing node.
-
公开(公告)号:US09529772B1
公开(公告)日:2016-12-27
申请号:US13685596
申请日:2012-11-26
Applicant: Amazon Technologies, Inc.
Inventor: Nishanth Shankaran , Rajat Arya , Clint Joseph Sbisa , Dong Shou , Rajaprabhu Thiruchi Loganathan , Shyam Krishnamoorthy
IPC: G06F15/167 , H04L12/24 , H04L29/08
CPC classification number: H04L67/1097 , H04L41/0803 , H04L41/0853 , H04L67/2842
Abstract: A cache or other cluster is configuration-aware such that initialization and changes to the underlying structure of the cluster can be dynamically updated. For example, a client may resolve an alias from a static configuration endpoint to a node in a cluster. The client may request initial configuration from the node and then update configuration from nodes that store the current configuration of the cluster.
Abstract translation: 缓存或其他集群是配置感知的,从而可以动态更新集群底层结构的初始化和更改。 例如,客户端可以将静态配置端点的别名解析为群集中的节点。 客户端可以从节点请求初始配置,然后从存储集群当前配置的节点更新配置。
-
公开(公告)号:US11928029B2
公开(公告)日:2024-03-12
申请号:US17019072
申请日:2020-09-11
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
CPC classification number: G06F11/1451 , G06F11/1464 , G06F11/1469 , G06F11/1458 , G06F11/2094 , G06F2201/80
Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.
-
公开(公告)号:US10776212B2
公开(公告)日:2020-09-15
申请号:US15495827
申请日:2017-04-24
Applicant: Amazon Technologies, Inc.
Inventor: Maximliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.
-
公开(公告)号:US20180322017A1
公开(公告)日:2018-11-08
申请号:US16035465
申请日:2018-07-13
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin NG , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
IPC: G06F11/14
CPC classification number: G06F11/1458
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to restore a given table that was backed up in a remote storage system (e.g., key-value durable storage system), the service may create a new table, and may import a copy of each of the partitions of the given table from the remote storage system into the new table. The request to restore the table may specify a modified value for a configuration parameter for the table or for one of its partitions. The service may apply the new configuration parameter value to the table or its partitions during the restore operation. The new configuration parameter value may indicate an increase or decrease in storage capacity or throughput capacity, and its application may automatically trigger a partition split or move operation.
-
-
-
-
-
-
-
-
-