-
公开(公告)号:US20210089238A1
公开(公告)日:2021-03-25
申请号:US16579614
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Danny Wei , Norbert Paul Kusters , Romain Benoit Seguy , Rahul Upadhyaya , Divya Ashok Kumar Jain , William Zaharchuk , Wells Lin
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Each volume can be implemented by at least two computing devices, a first of which is configured as a primary device to which reads from and writes to the volume are directed. To ensure consistency in the distributed device, a multi-tier authority service is implemented, in which a cross-computing system authority service designates a volume as having authority to accept writes to the virtualized device, and in which a second tier authority service designates a computing device as having authority to accept writes to the volume.
-
公开(公告)号:US10915486B1
公开(公告)日:2021-02-09
申请号:US15809622
申请日:2017-11-10
Applicant: Amazon Technologies, Inc.
Inventor: Asif Khan , Thomas A. Volpe , Marc John Brooker , Marc Stephen Olson , Norbert Paul Kusters , Mark Bradley Davis , Robert Michael Johnson
Abstract: Server computers often include one or more input/output (I/O) devices for communicating with a network or directly attached storage device. The data transfer latency for request can be reduced by utilizing ingress data placement logic to bypass the processor of the I/O device. For example, host memory descriptors can be stored in a memory of the I/O device to facilitate placement of the requested data.
-
公开(公告)号:US10802921B2
公开(公告)日:2020-10-13
申请号:US16259571
申请日:2019-01-28
Applicant: Amazon Technologies, Inc.
Inventor: Jianhua Fan , Benjamin Arthur Hawks , Norbert Paul Kusters , Nachiappan Arumugam , Danny Wei , John Luther Guthrie
Abstract: Systems and methods for provisioning a slave copy for redundant data storage and for writing data to persistent storage in a block-based storage system using sequential operation numbers are provided. In one embodiment, the method includes maintaining a master copy and a slave copy of a data volume, the master copy including data generated by a plurality of operations having respective sequential operation numbers, receiving a write instruction for second data to be added to the master copy, and recording the second data as a note that is not readable. The method may further include sending a copy of the note from the master copy to the slave copy, committing the note to the master copy with a sequential operation number, and committing the copy of the note to the slave copy based in part on the sequential operation number. A B-tree may be created based at least in part on an offset for a write instruction associated with the second data, a length, and an operation number included in the note.
-
公开(公告)号:US10565227B1
公开(公告)日:2020-02-18
申请号:US15253677
申请日:2016-08-31
Applicant: Amazon Technologies, Inc.
Inventor: Tao Chen , Marc John Brooker , Divya Ashok Kumar Jain , Norbert Paul Kusters , Fan Ping , Lakshmi N. Pallikila
Abstract: Data replication groups may be used to store data in a distributed computing environment. A data replication group may include a set of nodes executing a consensus protocol to maintain data durably. In order to increase efficiency and performance of the data replication, a particular node of the data replication group may be assigned the role of master node. The role of master node may be lease in accordance with a consensus protocol. If the lease is not renewed within an interval of time election/selection of a new master node may be commenced.
-
公开(公告)号:US10412002B1
公开(公告)日:2019-09-10
申请号:US14668557
申请日:2015-03-25
Applicant: Amazon Technologies, Inc.
Inventor: David R. Richardson , Marc John Brooker , Norbert Paul Kusters , Anthony Nicholas Liguori , Marc Stephen Olson
IPC: H04L12/741 , H04L29/06
Abstract: A method for processing packet data in a service provider environment includes, by a network-enabled data processing device within a server computer of the service provider environment, receiving packet data comprising header information and payload information. The header information is separated from the payload information. The separated header information is forwarded to a processor of the server computer for processing, without forwarding at least a portion of the payload information. At least one address of a storage location is received from the processor. The at least one address is associated with a logical-to-physical address mapping based on the header information. The payload information is stored in the storage location based on the at least one address.
-
公开(公告)号:US10108572B1
公开(公告)日:2018-10-23
申请号:US15887779
申请日:2018-02-02
Applicant: Amazon Technologies, Inc.
Inventor: Robert Michael Johnson , Marc John Brooker , Marc Stephen Olson , Mark Bradley Davis , Norbert Paul Kusters
Abstract: Server computers may include one or more input/output (I/O) adapter devices for communicating with a network and/or direct-attached device. The I/O adapter device may implement processes to manage write requests in a general and flexible manner. The I/O adapter device may also implement processes to manage write requests in a fast an efficient—that is, low latency—manner. Low latency write requests processes may include determining that a write packet for a write request can be processed without additional assistance from a processor, once a processor has initiated a memory access request to fetch write data and also generated protocol information for transmitting the write packet. The I/O adapter device may then process and transmit the write packet through an offload pipeline, without interrupting a processor.
-
公开(公告)号:US20180232308A1
公开(公告)日:2018-08-16
申请号:US15433951
申请日:2017-02-15
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , Nachiappan Arumugam , Andre Podnozov , Shobha Agrawal , Shreyas Ramalingam , Danny Wei , David R. Richardson , Marc John Brooker , Christopher Nathan Watson , John Luther Guthrie, II , Ravi Nankani
IPC: G06F12/0808 , G06F3/06
CPC classification number: G06F3/0619 , G06F3/061 , G06F3/065 , G06F3/0665 , G06F3/0683 , G06F11/14 , G06F11/2007 , G06F11/2015 , G06F11/2058 , G06F2201/81 , G06F2201/84
Abstract: A data storage system includes a head node and mass storage devices. The head node is configured to flush data stored in a storage of the head node, based at least in part on one or more triggers being met, from the storage of the head node to a set of the mass storage devices of the data storage system. The flushed data is written to a segment of free storage space across the set of the mass storage devices allocated for the given data flush operation. In some embodiments, a head node may flush both current version data and point-in-time version data to the set of mass storage devices. Also, the data storage system maintains an index that indicates storage locations of data for particular portions of a volume before and after the data is flushed to the set of mass storage devices.
-
公开(公告)号:US09639397B1
公开(公告)日:2017-05-02
申请号:US14675714
申请日:2015-03-31
Applicant: Amazon Technologies, Inc.
Inventor: Norbert Paul Kusters , John Robert Smiley , Marc John Brooker , Bei-Jing Guo , Marc Levy
CPC classification number: G06F9/5011 , G06F2209/5022 , G06F2209/504 , Y02D10/22
Abstract: Burst throttling methods may be used manage computing resources of a data storage service. Tokens may represent I/O operations executed by a customer of the data storage service. A global token bucket may contain a set of tokens representing the overall I/O operation capacity of the data storage service. Additionally, a work token bucket may contain a set of tokens for a given logical volume maintained by the data storage service. When I/O requests are received the data storage service may dynamically determine an amount of tokens to be removed from the global token bucket and/or work token bucket for each received request. Furthermore, if there is sufficient capacity the data storage service may charge a reduced number of tokens to the work token bucket.
-
公开(公告)号:US12135891B2
公开(公告)日:2024-11-05
申请号:US18297403
申请日:2023-04-07
Applicant: Amazon Technologies, Inc.
Inventor: Swapnil Vinay Dinkar , Pradeep Kunni Raman , David Matthew Buches , Hon Ping Shea , Norbert Paul Kusters
IPC: G06F3/06
Abstract: A storage service supports attachment of multiple clients to a distributed storage object and further supports persistent reservations that govern types of access the respective clients are granted with respect to the distributed storage object. In order to efficiently distribute reservation state changes to multiple partitions of the distributed storage object hosted by different data storage units/servers, existing connections are used between the data storage units/servers hosting the partitions of the distributed storage object and the connected clients to propagate reservation state changes.
-
公开(公告)号:US11231885B2
公开(公告)日:2022-01-25
申请号:US16579614
申请日:2019-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Kiran-Kumar Muniswamy-Reddy , Danny Wei , Norbert Paul Kusters , Romain Benoit Seguy , Rahul Upadhyaya , Divya Ashok Kumar Jain , William Zaharchuk , Wells Lin
Abstract: The present disclosure generally relates to creating virtualized block storage devices whose data is replicated across isolated computing systems to lower risk of data loss even in wide-scale events, such as natural disasters. The virtualized device can include at least two volumes, each of which is implemented in a distinct computing system. Each volume can be implemented by at least two computing devices, a first of which is configured as a primary device to which reads from and writes to the volume are directed. To ensure consistency in the distributed device, a multi-tier authority service is implemented, in which a cross-computing system authority service designates a volume as having authority to accept writes to the virtualized device, and in which a second tier authority service designates a computing device as having authority to accept writes to the volume.
-
-
-
-
-
-
-
-
-