-
公开(公告)号:US10922303B1
公开(公告)日:2021-02-16
申请号:US15680128
申请日:2017-08-17
Applicant: Amazon Technologies, Inc.
Inventor: Lewis Bruck , Pejus Manoj Das , Dumanshu Goyal , Chase Kernan , Akshat Vig
Abstract: A system that implements a data storage system may store data for a database table in multiple replicated partitions on respective storage nodes. An export of an active database partition may generate an exported copy of the database partition. A first exported copy may be stored locally on a source node and a second exported copy of the database partition may be sent to a recipient node. The source node may validate the first copy responsive to sending the second copy and may perform the validation while the second copy is being sent and processed at the recipient node. If the first copy cannot be validated, the source node may cause the second copy to be invalidated and abort further processing of the second copy. The source node may also cause the second copy to be marked as invalid to prevent reliance on an invalid database partition copy.
-
公开(公告)号:US10776212B2
公开(公告)日:2020-09-15
申请号:US15495827
申请日:2017-04-24
Applicant: Amazon Technologies, Inc.
Inventor: Maximliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.
-
公开(公告)号:US20200159745A1
公开(公告)日:2020-05-21
申请号:US16684901
申请日:2019-11-15
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Timothy Andrew Rath , Stuart Henry Seelye Marshall , Rande A. Blackman , David Alan Lutz , Jian Wang , Jiandan Zheng , Janani Narayanan
IPC: G06F16/27 , G06F16/2455 , G06F16/2458 , G06F16/90 , G06F16/28
Abstract: Methods and apparatus for conditional master election in a distributed database are described. A plurality of replicas of a database object are stored by a distributed database service. Some types of operations corresponding to client requests directed at the database object are to be coordinated by a master replica. Client access to the database object is enabled prior to election of a master replica. In response to a triggering condition, a particular replica is elected master. The master coordinates implementation of operations with one or more other replicas in response to client requests.
-
公开(公告)号:US20180322017A1
公开(公告)日:2018-11-08
申请号:US16035465
申请日:2018-07-13
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin NG , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
IPC: G06F11/14
CPC classification number: G06F11/1458
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to restore a given table that was backed up in a remote storage system (e.g., key-value durable storage system), the service may create a new table, and may import a copy of each of the partitions of the given table from the remote storage system into the new table. The request to restore the table may specify a modified value for a configuration parameter for the table or for one of its partitions. The service may apply the new configuration parameter value to the table or its partitions during the restore operation. The new configuration parameter value may indicate an increase or decrease in storage capacity or throughput capacity, and its application may automatically trigger a partition split or move operation.
-
公开(公告)号:US20170228290A1
公开(公告)日:2017-08-10
申请号:US15495827
申请日:2017-04-24
Applicant: Amazon Technologies, Inc.
Inventor: Maximliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin NG , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
IPC: G06F11/14
CPC classification number: G06F11/1451 , G06F11/1458 , G06F11/1464 , G06F11/1469 , G06F11/2094 , G06F2201/80
Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.
-
公开(公告)号:US20170154091A1
公开(公告)日:2017-06-01
申请号:US15431706
申请日:2017-02-13
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Timothy Andrew Rath , Stuart Henry Seelye Marshall , Rande A. Blackman , David Alan Lutz , Jian Wang , Jiandan Zheng , Janani Narayanan
IPC: G06F17/30
Abstract: Methods and apparatus for conditional master election in a distributed database are described. A plurality of replicas of a database object are stored by a distributed database service. Some types of operations corresponding to client requests directed at the database object are to be coordinated by a master replica. Client access to the database object is enabled prior to election of a master replica. In response to a triggering condition, a particular replica is elected master. The master coordinates implementation of operations with one or more other replicas in response to client requests.
-
公开(公告)号:US09569513B1
公开(公告)日:2017-02-14
申请号:US14023165
申请日:2013-09-10
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Timothy Andrew Rath , Stuart Henry Seelye Marshall , Rande A. Blackman , David Alan Lutz , Jian Wang , Jiandan Zheng , Janani Narayanan
CPC classification number: G06F17/30575 , G06F17/3051 , G06F17/30545 , G06F17/30587 , G06F17/30943
Abstract: Methods and apparatus for conditional master election in a distributed database are described. A plurality of replicas of a database object are stored by a distributed database service. Some types of operations corresponding to client requests directed at the database object are to be coordinated by a master replica. Client access to the database object is enabled prior to election of a master replica. In response to a triggering condition, a particular replica is elected master. The master coordinates implementation of operations with one or more other replicas in response to client requests.
Abstract translation: 描述了分布式数据库中条件主选择的方法和设备。 数据库对象的多个副本由分布式数据库服务存储。 对应于针对数据库对象的客户端请求的某些类型的操作将由主副本进行协调。 在选择主副本之前,客户端对数据库对象的访问已启用。 响应于触发条件,特定副本被选为主控。 主人根据客户端请求协调与一个或多个其他副本的操作执行。
-
-
-
-
-
-