SYSTEM AND METHOD FOR CLUSTERING DISTRIBUTED HASH TABLE ENTRIES

    公开(公告)号:US20190213179A1

    公开(公告)日:2019-07-11

    申请号:US16355557

    申请日:2019-03-15

    IPC分类号: G06F16/22 G06F16/18

    CPC分类号: G06F16/2255 G06F16/1873

    摘要: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.

    System and method for clustering distributed hash table entries

    公开(公告)号:US11604781B2

    公开(公告)日:2023-03-14

    申请号:US17478671

    申请日:2021-09-17

    IPC分类号: G06F16/22 G06F16/18

    摘要: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.

    System and method for performing object-modifying commands in an unstructured storage service

    公开(公告)号:US11494437B1

    公开(公告)日:2022-11-08

    申请号:US15701338

    申请日:2017-09-11

    摘要: Embodiments of system and method for performing object-modifying commands in an unstructured storage service are described. Embodiments may include utilizing one or more nodes to implement an unstructured storage service including a service interface configured to service data storage requests and data retrieval requests from remote clients. The unstructured storage service is configured to isolate access to each of multiple storage domains of the service to different clients. Embodiments may also include receiving from a given remote client, a request to store a data object to a given storage domain of the service. The request further specifying a command to modify source data for the object prior to storing the object. Embodiments may also include using the unstructured storage service to perform the command without exporting the source data from the unstructured storage service to the given remote client prior to completion of the command.

    System and method for logical deletion of stored data objects

    公开(公告)号:US10534726B2

    公开(公告)日:2020-01-14

    申请号:US15979327

    申请日:2018-05-14

    摘要: Systems and methods for providing object versioning in a storage system may support the logical deletion of stored objects. In response to a delete operation specifying both a user key and a version identifier, the storage system may permanently delete the specified version of an object having the specified key. In response to a delete operation specifying a user key, but not a version identifier, the storage system may create a delete marker object that does not contain object data, and may generate a new version identifier for the delete marker. The delete marker may be stored as the latest object version of the user key, and may be addressable in the storage system using a composite key comprising the user key and the new version identifier. Subsequent attempts to retrieve the user key without specifying a version identifier may return an error, although the object was not actually deleted.

    Backoff-based scheduling of storage object deletions
    8.
    发明授权
    Backoff-based scheduling of storage object deletions 有权
    基于退货的存储对象删除调度

    公开(公告)号:US09063946B1

    公开(公告)日:2015-06-23

    申请号:US13715889

    申请日:2012-12-14

    IPC分类号: G06F17/30

    摘要: Methods and apparatus for backoff-based scheduling of storage object deletions are disclosed. A storage medium stores program instructions that when executed on a processor, obtain an indication of a collection of storage objects of a network-accessible multi-tenant storage service to be deleted in accordance with specified deletion criteria. A deletion of a storage object comprises a metadata deletion operation and one or more other operations. The instructions initiate, corresponding to at least some objects of the collection, respective metadata deletion operations at a metadata node of the storage service. If a metric associated with the metadata node meets a threshold criterion, the instructions delay, by a particular amount of time, an initiation of an operation corresponding to a deletion of another storage object.

    摘要翻译: 公开了用于存储对象删除的基于退避的调度的方法和装置。 存储介质存储当在处理器上执行时的程序指令,根据指定的删除标准来获取要删除的网络可访问的多租户存储服务的存储对象的集合的指示。 存储对象的删除包括元数据删除操作和一个或多个其他操作。 所述指令对应于所述收集的至少一些对象,在所述存储服务的元数据节点处发起相应的元数据删除操作。 如果与元数据节点相关联的度量符合阈值标准,则指令延迟特定时间量,启动对应于另一个存储对象的删除的操作。

    System and method for clustering distributed hash table entries

    公开(公告)号:US11947510B2

    公开(公告)日:2024-04-02

    申请号:US18182294

    申请日:2023-03-10

    IPC分类号: G06F16/22 G06F16/18

    CPC分类号: G06F16/2255 G06F16/1873

    摘要: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.

    SYSTEM AND METHOD FOR CLUSTERING DISTRIBUTED HASH TABLE ENTRIES

    公开(公告)号:US20230281181A1

    公开(公告)日:2023-09-07

    申请号:US18182294

    申请日:2023-03-10

    IPC分类号: G06F16/22 G06F16/18

    CPC分类号: G06F16/2255 G06F16/1873

    摘要: A distributed storage system may store data object instances in persistent storage and may store keymap information for those data object instances in a distributed hash table on multiple computing nodes. Each data object instance may include a composite key containing a user key. The keymap information for each data object instance may map the user key to a locator and the locator to the data object instance. A request to store or retrieve keymap information for a data object instance may be routed to a particular computing node based on a consistent hashing scheme in which a hash function is applied to a portion of the composite key of the data object instance. Thus, related entries may be clustered on the same computing nodes. The portion of the key to which the hash function is applied may include a pre-determined number of bits or be identified using a delimiter.