-
公开(公告)号:US11531658B2
公开(公告)日:2022-12-20
申请号:US16707790
申请日:2019-12-09
发明人: Praveen Kumar Gattu , Aykud Gonen , Jonathan Jorge Nadal , Abhilasha Seth , Joseph Thomas Selman
摘要: A method and apparatus for criterion-based retention of data object versions are disclosed. In the method and apparatus, a plurality of keys are sorted in accordance with an ordering scheme, whereby a key of the plurality of keys has an associated version of a data object and a timestamp. The key is inspected in accordance with the ordering scheme to determine based at least in part on the timestamp whether a criterion for performing an action on the associated version of the data object is satisfied. If the criterion is satisfied, a marker key is added to the plurality of keys, whereby the marker key precedes the inspected key according to the ordering scheme and indicates that the criterion is satisfied.
-
公开(公告)号:US20200228574A1
公开(公告)日:2020-07-16
申请号:US16835925
申请日:2020-03-31
摘要: A customer of a resource provider environment can apply policies at the data object level that will live with a data object during its lifecycle, even as the object moves across trusted boundaries. A customer can classify data, causing tags and/or predicates to be applied to the corresponding data object. Each tag corresponds to a policy, with predicates relating to various actions that can be performed on the data. A chain of custody is maintained for each data object, such that any changes to the object, tags, or policies for the data can be determined, as may be required for various audit processes. The support of such policies also enables the resource provider environment to function as an intermediary, whereby a third party can receive the data along with the tags, policies, and chain of custody as long as the environment trusts the third party to receive the data object.
-
公开(公告)号:US20190213179A1
公开(公告)日:2019-07-11
申请号:US16355557
申请日:2019-03-15
CPC分类号: G06F16/2255 , G06F16/1873
摘要: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.
-
公开(公告)号:US09658983B1
公开(公告)日:2017-05-23
申请号:US13715863
申请日:2012-12-14
发明人: Jeffrey Michael Barber , Praveen Kumar Gattu , Derek Ernest Denny-Brown, II , Christopher Henning Elving , Carl Yates Perry
IPC分类号: G06F15/16 , G06F15/167
CPC分类号: G06F15/167 , G06F17/30309 , G06F17/30548
摘要: Methods and apparatus for lifecycle support for storage objects are disclosed. A storage medium stores program instructions that when executed on a processor implement a storage lifecycle manager of a multi-tenant storage service. The lifecycle manager determines a lifecycle policy to be implemented for a storage object. The policy indicates lifecycle transitions of the object, including a transition from a first service level to a second service level. The first service level and the second service level may each specify a maximum number of versions of the storage object. The lifecycle manager initiates modification operations corresponding to the storage object's data in accordance with the lifecycle policy, and verifies that the modification operations succeeded. The lifecycle manager provides, in response to a query, an indication of a current service level of the storage object.
-
公开(公告)号:US11899595B2
公开(公告)日:2024-02-13
申请号:US17929650
申请日:2022-09-02
CPC分类号: G06F12/1466 , G06F3/067 , G06F3/0608 , G06F3/0619 , G06F3/0622 , G06F3/0652 , G06F3/0671 , G06F3/0673 , G06F11/1435 , G06F11/1453 , G06F16/162 , G06F16/1873 , G06F16/2329 , G06F2201/80 , G06F2201/84 , G06F2212/1052
摘要: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects. In response to a delete operation specifying both a user key and a version identifier, the storage system may permanently delete the specified version of an object having the specified key. In response to a delete operation specifying a user key, but not a version identifier, the storage system may create a delete marker object that does not contain object data, and may generate a new version identifier for the delete marker. The delete marker may be stored as the latest object version of the user key, and may be addressable in the storage system using a composite key comprising the user key and the new version identifier. Subsequent attempts to retrieve the user key without specifying a version identifier may return an error, although the object was not actually deleted.
-
公开(公告)号:US11604781B2
公开(公告)日:2023-03-14
申请号:US17478671
申请日:2021-09-17
摘要: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.
-
公开(公告)号:US10534726B2
公开(公告)日:2020-01-14
申请号:US15979327
申请日:2018-05-14
摘要: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects. In response to a delete operation specifying both a user key and a version identifier, the storage system may permanently delete the specified version of an object having the specified key. In response to a delete operation specifying a user key, but not a version identifier, the storage system may create a delete marker object that does not contain object data, and may generate a new version identifier for the delete marker. The delete marker may be stored as the latest object version of the user key, and may be addressable in the storage system using a composite key comprising the user key and the new version identifier. Subsequent attempts to retrieve the user key without specifying a version identifier may return an error, although the object was not actually deleted.
-
公开(公告)号:US20170093913A1
公开(公告)日:2017-03-30
申请号:US14863804
申请日:2015-09-24
CPC分类号: H04L63/20 , G06F21/604 , G06F21/6236 , G06F2221/2101 , G06F2221/2107 , G06F2221/2115 , G06F2221/2141 , H04L63/08 , H04L63/0846 , H04L63/105 , H04L67/10
摘要: A customer of a resource provider environment can apply policies at the data object level that will live with a data object during its lifecycle, even as the object moves across trusted boundaries. A customer can classify data, causing tags and/or predicates to be applied to the corresponding data object. Each tag corresponds to a policy, with predicates relating to various actions that can be performed on the data. A chain of custody is maintained for each data object, such that any changes to the object, tags, or policies for the data can be determined, as may be required for various audit processes. The support of such policies also enables the resource provider environment to function as an intermediary, whereby a third party can receive the data along with the tags, policies, and chain of custody as long as the environment trusts the third party to receive the data object.
-
公开(公告)号:US09235476B2
公开(公告)日:2016-01-12
申请号:US14673808
申请日:2015-03-30
CPC分类号: G06F12/1466 , G06F3/0608 , G06F3/0619 , G06F3/0622 , G06F3/0652 , G06F3/067 , G06F3/0671 , G06F3/0673 , G06F11/1435 , G06F11/1453 , G06F17/30117 , G06F17/3023 , G06F17/30356 , G06F2201/80 , G06F2201/84 , G06F2212/1052
摘要: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects. In response to a delete operation specifying both a user key and a version identifier, the storage system may permanently delete the specified version of an object having the specified key. In response to a delete operation specifying a user key, but not a version identifier, the storage system may create a delete marker object that does not contain object data, and may generate a new version identifier for the delete marker. The delete marker may be stored as the latest object version of the user key, and may be addressable in the storage system using a composite key comprising the user key and the new version identifier. Subsequent attempts to retrieve the user key without specifying a version identifier may return an error, although the object was not actually deleted.
-
公开(公告)号:US09063946B1
公开(公告)日:2015-06-23
申请号:US13715889
申请日:2012-12-14
发明人: Jeffrey Michael Barber , Praveen Kumar Gattu , Christopher Henning Elving , Carl Yates Perry , Derek Ernest Denny-Brown, II
IPC分类号: G06F17/30
CPC分类号: G06F17/30117 , G06F17/30085 , G06F17/30174
摘要: Methods and apparatus for backoff-based scheduling of storage object deletions are disclosed. A storage medium stores program instructions that when executed on a processor, obtain an indication of a collection of storage objects of a network-accessible multi-tenant storage service to be deleted in accordance with specified deletion criteria. A deletion of a storage object comprises a metadata deletion operation and one or more other operations. The instructions initiate, corresponding to at least some objects of the collection, respective metadata deletion operations at a metadata node of the storage service. If a metric associated with the metadata node meets a threshold criterion, the instructions delay, by a particular amount of time, an initiation of an operation corresponding to a deletion of another storage object.
摘要翻译: 公开了用于存储对象删除的基于退避的调度的方法和装置。 存储介质存储当在处理器上执行时的程序指令,根据指定的删除标准来获取要删除的网络可访问的多租户存储服务的存储对象的集合的指示。 存储对象的删除包括元数据删除操作和一个或多个其他操作。 所述指令对应于所述收集的至少一些对象,在所述存储服务的元数据节点处发起相应的元数据删除操作。 如果与元数据节点相关联的度量符合阈值标准,则指令延迟特定时间量,启动对应于另一个存储对象的删除的操作。
-
-
-
-
-
-
-
-
-