-
公开(公告)号:US12204668B1
公开(公告)日:2025-01-21
申请号:US17393813
申请日:2021-08-04
Applicant: Amazon Technologies, Inc.
Inventor: Eric Jason Brandwine , Rebecca Claire Weiss , Andrew Kent Warfield
Abstract: Techniques are described for enabling users to create and configure request-based policies used by a data storage system to generate custom responses to particular types of requests for users' stored data objects. The request-based policies include rules used to identify types of requests for data objects and corresponding types of responses to be generated responsive to detecting such requests. The types of responses that can be specified in such policies include responses other than simply returning a requested data object or denying a request. For example, a rule for certain types of responses can instruct the data storage system to return a dynamically generated data object, another rule can instruct the system to return a different data object than the one requested, and so forth.
-
公开(公告)号:US11586595B1
公开(公告)日:2023-02-21
申请号:US16457595
申请日:2019-06-28
Applicant: Amazon Technologies, Inc.
Inventor: Khawaja Salman Shams , Ryan Farris , Benjamin Aldouby Schwartz , David Dunlap , Andrew Kent Warfield
IPC: G06F16/182 , G06F16/18 , H04L67/1097
Abstract: A set of data units associated with a data object is obtained, such that respective instances of the data object can be reconstructed from respective subsets of the set. Corresponding to a request for the data object, a first subset of the set is identified. The first subset meets a uniqueness criterion with respect to other subsets of the set that are used to respond to other requests for the data object. An instance of the data object is reconstructed from the first subset.
-
公开(公告)号:US11474741B1
公开(公告)日:2022-10-18
申请号:US16916988
申请日:2020-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Munif M. Farhan , Keun Soo Jo , James Alexander Bornholt , Andrew Kent Warfield , Andrew C. Schleit , Seth W. Markle
Abstract: Technologies are provided for supporting storage device write barriers. A host computer can be configured to transmit a write barrier command to a storage device to indicate that one or more data access commands should be processed before one or more other data access commands are processed. For example, a host computer can transmit one or more data access commands to a storage device. The host computer can then transmit a write barrier command to the storage device. The storage device can be configured to receive the write barrier command and to associate a write barrier with the one or more data access commands. The host computer can continue to transmit additional data access commands to the storage device. However, the storage device will not process the additional data access commands until after the one or more data access commands associated with the write barrier have been processed.
-
公开(公告)号:US11360708B1
公开(公告)日:2022-06-14
申请号:US16917037
申请日:2020-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Munif M. Farhan , Keun Soo Jo , James Alexander Bornholt , Andrew Kent Warfield , Andrew C. Schleit , Seth W. Markle
Abstract: Technologies are provided for supporting storage device write barriers. A storage device can be configured to associate a data access command with a write barrier. The write barrier can be used to indicate that one or more data access commands should be processed before one or more other data access commands are processed. For example, a host computer can transmit one or more data access commands to a storage device. The storage device can determine that the one or more data access commands are associated with a write barrier. The host computer can continue to transmit additional data access commands to the storage device. However, the storage device will not process the additional data access commands until after the one or more data access commands associated with the write barrier have been processed.
-
公开(公告)号:US11356120B1
公开(公告)日:2022-06-07
申请号:US17021696
申请日:2020-09-15
Applicant: Amazon Technologies, Inc.
Inventor: Seth W. Markle , Andrew Kent Warfield , Qianyong Yu , Grant Fresen
Abstract: Described are systems and methods for storing a data object using a hierarchical erasure encoding to store a physical representation of the data object across a plurality of fault domains. A first erasure encoding is applied to the data object to generate a first set of shards of the data object. Individual shards of the set of shards may then be distributed across the fault domains for storage. Within the fault domains a second erasure encoding may be applied to the individual shards to generate a second set of shards. Finally, a manifest may be generate in order to reconstruct the data object from the first set of shards and the second set of shards.
-
公开(公告)号:US20250004648A1
公开(公告)日:2025-01-02
申请号:US18345890
申请日:2023-06-30
Applicant: Amazon Technologies, Inc.
Inventor: Enrico Sartorello , Jessie E Felix , Seth W. Markle , Andrew Kent Warfield , Leon Thrane , Valentin Flunkert , Miroslav Miladinovic , Christoph Bartenstein , James C Kirschner
IPC: G06F3/06
Abstract: An object storage system includes mass storage devices that implement general storage for objects stored in the object storage system and additionally includes other storage devices, such as solid-state drives, that provide higher performance storage access. The object storage system implements a common access interface for accessing both accelerated access objects (who are eligible to have cached copies stored on the higher performance storage devices) and non-accelerated access objects stored in the general storage. The cache is fully managed by the service and no changes are required for client applications to receive accelerated access to objects that are classified as accelerated access objects per a customer configurable acceleration policy for the object or for a bucket in which the object is stored.
-
公开(公告)号:US11609707B1
公开(公告)日:2023-03-21
申请号:US16588300
申请日:2019-09-30
Applicant: Amazon Technologies, Inc.
Inventor: Keun Soo Jo , Munif M. Farhan , Andrew Kent Warfield , Seth W. Markle , Roey Rivnay
Abstract: Technologies are provided for supporting multi-actuator storage device access using logical addresses. Separate sets of logical addresses (such as logical block addresses) can be associated with different actuators of a storage device. For example, a first set of logical addresses can be assigned to storage locations on one or more storage media that is/are accessible using a first actuator of the storage device and a second set of logical addresses can be assigned to storage locations on one or more storage media that is/are accessible using a second actuator of the storage device. The storage device can receive a data access request containing a logical address and can identify a logical address set to which the logical address belongs. The storage device can use an actuator associated with the logical address set to access a storage location assigned to the logical address.
-
公开(公告)号:US20230066170A1
公开(公告)日:2023-03-02
申请号:US18045100
申请日:2022-10-07
Applicant: Amazon Technologies, Inc.
Inventor: Roey Rivnay , Brendan Cully , William Mark Megarity , Ryan F. Conroy , Andrew Kent Warfield , Priti Choudhary
IPC: G06F1/18
Abstract: A device includes an interposer card that includes a processor, such as a system on a chip (SoC), and memory devices. The interposer card mounts to a mass storage device and has a shape that corresponds to a size of an end of the mass storage device to which the interposer card is mounted. The SoC of the interposer card is configured to implement an individual server for the mass storage device to which the interposer card is mounted. In some embodiments, a data storage system includes multiple mass storage devices mounted in a chassis and coupled to one or more backplanes, wherein interposer cards are connected between the mass storage devices and the one or more backplanes.
-
公开(公告)号:US11943294B1
公开(公告)日:2024-03-26
申请号:US17039938
申请日:2020-09-30
Applicant: Amazon Technologies, Inc.
Inventor: Christoph Bartenstein , Brad E Marshall , Andrew Kent Warfield
IPC: H04L67/1097 , G06N20/00 , H04L67/5651 , H04L67/75 , H04L69/04
CPC classification number: H04L67/1097 , G06N20/00 , H04L67/5651 , H04L67/75 , H04L69/04
Abstract: An object compression system of a storage service may provide a user-friendly and cost-efficient solution to manage stored objects for users of the storage service. The object compression system may automatically monitor individual objects in an object-based storage system of the storage service. Based on one or more characteristics and additional features of the objects, the object compression system may generate respective determinations whether to compress the individual objects. Responsive to determinations to compress the objects, the object compression system may determine compression algorithms for individual objects. The object compression system may compress the objects according to respective compression algorithms to create compressed files. The object compression system may store the compressed files in a tier different from the objects and delete the objects from the storage service.
-
公开(公告)号:US11308992B1
公开(公告)日:2022-04-19
申请号:US16711959
申请日:2019-12-12
Applicant: Amazon Technologies, Inc.
Inventor: Keun Soo Jo , Munif M. Farhan , Andrew Kent Warfield , Seth W. Markle , Roey Rivnay
IPC: G11B5/54 , G11B15/087 , G11B21/08
Abstract: Technologies are provided for accessing a physical location of a storage medium reader of a storage device. A computing device can transmit a request for the storage medium reader's physical location. The storage device can determine the physical location of the storage medium reader and transmit the location to the computing device. The computing device can use the physical location of the storage medium reader to determine an expected latency for retrieving one or more stored data items. The computing device can transmit a command to change the physical location of the storage medium reader, for example by changing a location of the storage medium reader with respect to a given storage medium and/or changing a storage medium that is accessed by the storage medium reader. The computing device can control the placement of the storage medium reader in order to optimize retrieval of data items from the storage device.
-
-
-
-
-
-
-
-
-