Criterion-based retention of data object versions

    公开(公告)号:US11531658B2

    公开(公告)日:2022-12-20

    申请号:US16707790

    申请日:2019-12-09

    IPC分类号: G06F7/00 G06F16/21 G06F16/11

    摘要: A method and apparatus for criterion-based retention of data object versions are disclosed. In the method and apparatus, a plurality of keys are sorted in accordance with an ordering scheme, whereby a key of the plurality of keys has an associated version of a data object and a timestamp. The key is inspected in accordance with the ordering scheme to determine based at least in part on the timestamp whether a criterion for performing an action on the associated version of the data object is satisfied. If the criterion is satisfied, a marker key is added to the plurality of keys, whereby the marker key precedes the inspected key according to the ordering scheme and indicates that the criterion is satisfied.

    POLICY MANAGEMENT FOR DATA MIGRATION
    2.
    发明申请

    公开(公告)号:US20200228574A1

    公开(公告)日:2020-07-16

    申请号:US16835925

    申请日:2020-03-31

    摘要: A customer of a resource provider environment can apply policies at the data object level that will live with a data object during its lifecycle, even as the object moves across trusted boundaries. A customer can classify data, causing tags and/or predicates to be applied to the corresponding data object. Each tag corresponds to a policy, with predicates relating to various actions that can be performed on the data. A chain of custody is maintained for each data object, such that any changes to the object, tags, or policies for the data can be determined, as may be required for various audit processes. The support of such policies also enables the resource provider environment to function as an intermediary, whereby a third party can receive the data along with the tags, policies, and chain of custody as long as the environment trusts the third party to receive the data object.

    SYSTEM AND METHOD FOR CLUSTERING DISTRIBUTED HASH TABLE ENTRIES

    公开(公告)号:US20190213179A1

    公开(公告)日:2019-07-11

    申请号:US16355557

    申请日:2019-03-15

    IPC分类号: G06F16/22 G06F16/18

    CPC分类号: G06F16/2255 G06F16/1873

    摘要: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.

    System and method for clustering distributed hash table entries

    公开(公告)号:US11604781B2

    公开(公告)日:2023-03-14

    申请号:US17478671

    申请日:2021-09-17

    IPC分类号: G06F16/22 G06F16/18

    摘要: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.

    System and method for logical deletion of stored data objects

    公开(公告)号:US10534726B2

    公开(公告)日:2020-01-14

    申请号:US15979327

    申请日:2018-05-14

    摘要: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects. In response to a delete operation specifying both a user key and a version identifier, the storage system may permanently delete the specified version of an object having the specified key. In response to a delete operation specifying a user key, but not a version identifier, the storage system may create a delete marker object that does not contain object data, and may generate a new version identifier for the delete marker. The delete marker may be stored as the latest object version of the user key, and may be addressable in the storage system using a composite key comprising the user key and the new version identifier. Subsequent attempts to retrieve the user key without specifying a version identifier may return an error, although the object was not actually deleted.

    Backoff-based scheduling of storage object deletions
    10.
    发明授权
    Backoff-based scheduling of storage object deletions 有权
    基于退货的存储对象删除调度

    公开(公告)号:US09063946B1

    公开(公告)日:2015-06-23

    申请号:US13715889

    申请日:2012-12-14

    IPC分类号: G06F17/30

    摘要: Methods and apparatus for backoff-based scheduling of storage object deletions are disclosed. A storage medium stores program instructions that when executed on a processor, obtain an indication of a collection of storage objects of a network-accessible multi-tenant storage service to be deleted in accordance with specified deletion criteria. A deletion of a storage object comprises a metadata deletion operation and one or more other operations. The instructions initiate, corresponding to at least some objects of the collection, respective metadata deletion operations at a metadata node of the storage service. If a metric associated with the metadata node meets a threshold criterion, the instructions delay, by a particular amount of time, an initiation of an operation corresponding to a deletion of another storage object.

    摘要翻译: 公开了用于存储对象删除的基于退避的调度的方法和装置。 存储介质存储当在处理器上执行时的程序指令,根据指定的删除标准来获取要删除的网络可访问的多租户存储服务的存储对象的集合的指示。 存储对象的删除包括元数据删除操作和一个或多个其他操作。 所述指令对应于所述收集的至少一些对象,在所述存储服务的元数据节点处发起相应的元数据删除操作。 如果与元数据节点相关联的度量符合阈值标准,则指令延迟特定时间量,启动对应于另一个存储对象的删除的操作。