-
公开(公告)号:US11838357B1
公开(公告)日:2023-12-05
申请号:US17388660
申请日:2021-07-29
Applicant: Amazon Technologies, Inc.
Inventor: Ankit Kumar , Dan Popick , Sandesh Sanjeev , Meng Li , David Michael Hulme
IPC: H04L67/1025 , H04L67/1014 , H04L67/1029
CPC classification number: H04L67/1014 , H04L67/1025 , H04L67/1029
Abstract: Techniques for incremental stream switching in a distributed system with flip events are described. A special-purpose flip event is inserted into an event stream that indicates, to recipients of the stream, whether they are to switch to use of an alternate event stream. The flip event may identify which other event stream to use, how to obtain events of that event stream, when to switch to the other event stream, and/or whether that particular recipient is to switch. The recipients may be selectively or iteratively migrated using flip events targeting different recipients, limiting the blast radius of a switch. Via use of a tracking data structure, event replay and event skips can be avoided.
-
公开(公告)号:US11620194B1
公开(公告)日:2023-04-04
申请号:US17362463
申请日:2021-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Sharad Sridhar , Sandesh Sanjeev , Ankit Kumar , Munjal Doshi , Rachit Jain
Abstract: Features are disclosed for managing multiple hosts that stream sequential data to nodes for propagation. The hosts can include a primary host and a failover host that each store a replica of the sequential data. A computing device can monitor the hosts and identify the occurrence of a failover event for the primary host. For example, the computing device may determine the schema has been modified. The computing device can further determine to failover to the failover host based on the failover event. The computing device can insert a flip task into the stream of sequential data for the primary host. The insertion of the flip task may be automatic. Further, each node reading from the stream of sequential data for the primary host may encounter the flip task and failover to the failover host at the same logical position but a different absolute position.
-