-
公开(公告)号:US11640410B1
公开(公告)日:2023-05-02
申请号:US14957421
申请日:2015-12-02
Applicant: Amazon Technologies, Inc.
Inventor: Matthew Joseph Zulak , Tao Chen , Fan Ping , Lakshmi N. Pallikila , Shobha Agrawal , Marc John Brooker
IPC: G06F16/27
Abstract: Data replication groups may be used to store data in a distributed computing environment. The data replication groups may include a set of nodes executing a consensus protocol to maintain data durably. The nodes of the data replication groups may generate logs containing information corresponding committed operations performed by the nodes. These logs may be collected and processed to obtain useful information corresponding to the operation of the data replication group. Furthermore, this processed information may be provided in the form of a stream to enable event driven operations corresponding to the logs.
-
公开(公告)号:US10938668B1
公开(公告)日:2021-03-02
申请号:US15283192
申请日:2016-09-30
Applicant: Amazon Technologies, Inc.
Inventor: Matthew Joseph Zulak , Marc John Brooker , Dylan Owen Marriner , Julian Embry Herwitz , Mauricio Roman , Guanghao Ding , Sanath Kumar Ramesh
IPC: H04L12/24 , H04L29/08 , G06F9/48 , H04L12/803
Abstract: Computing resource service providers operate various services used to provide functionality to customers and other computing resources operated by various entities. These services may use consistent hash rings to direct a request to a particular worker. Previous versions of the consistent hash ring may be maintained such that predecessor information can be determined. When a request is received the request and predecessor information may be provided to a worker manager. The worker manager may utilize the predecessor information to obtain state information from a predecessor worker manager. The state information may then be used to process the request.
-
公开(公告)号:US10733201B1
公开(公告)日:2020-08-04
申请号:US14954987
申请日:2015-11-30
Applicant: Amazon Technologies, Inc.
Inventor: Tao Chen , Madhuvanesh Parthasarathy , Shobha Agrawal , Fan Ping , Divya Ashok Kumar Jain , Marc John Brooker , Matthew Joseph Zulak , Lakshmi N. Pallikila
Abstract: Data replication groups may be used to store data in a distributed computing environment. The data replication groups may include a set of nodes executing a consensus protocol to maintain data durably. In order to increase the speed of provisioning, a data replication may be provision with less than the total number of nodes to be included in the group. Once an initial set of nodes have been provisioned and are implementing a consensus protocol, the data replication group may begin to receive traffic. Furthermore, new nodes may be added to the group until the total number of nodes for the group has been reached.
-
公开(公告)号:US10567499B1
公开(公告)日:2020-02-18
申请号:US14957477
申请日:2015-12-02
Applicant: Amazon Technologies, Inc.
Inventor: Tao Chen , Matthew Joseph Zulak , Lakshmi N. Pallikila , Shobha Agrawal , Fan Ping , Divya Ashok Kumar Jain
Abstract: Data replication groups may be used to store data in a distributed computing environment. The data replication groups may include a set of nodes executing a consensus protocol to maintain data durably. During the execution of the set of nodes various nodes may become stale or otherwise obtain a state that is inconsistent with at least one other node of the data replication group. A catch up algorithm may be employed in which a set of teachers is initialized, the various node which may be stale may select a teacher from the set of teachers and perform learning operations. This process may be repeated until the state of the various nodes is current with at least one other node of the data replication group.
-
公开(公告)号:US10452681B1
公开(公告)日:2019-10-22
申请号:US14954928
申请日:2015-11-30
Applicant: Amazon Technologies, Inc.
Inventor: Tao Chen , Madhuvanesh Parthasarathy , Shobha Agrawal , Fan Ping , Divya Ashok Kumar Jain , Marc John Brooker , Matthew Joseph Zulak , Lakshmi N. Pallikila
IPC: G06F16/27 , G06F16/23 , G06F16/955
Abstract: Data replication groups may be used to store data in a distributed computing environment. The data replication groups may include a set of nodes executing a consensus protocol to maintain data durably. In order to increase the speed of provisioning, a pool of data replication groups may be maintained. When a request is received a data replication group may be selected from the pool, removed from the pool, and associated with the request. Furthermore, a replacement data replication group may be provisioned and added to the pool.
-
-
-
-