System and method for managing replicas of objects in a distributed storage system
    11.
    发明授权
    System and method for managing replicas of objects in a distributed storage system 有权
    用于管理分布式存储系统中对象的副本的系统和方法

    公开(公告)号:US08352424B2

    公开(公告)日:2013-01-08

    申请号:US13022290

    申请日:2011-02-07

    IPC分类号: G06F7/00 G06F17/00

    摘要: A system and method for generating replication requests for objects in a distributed storage system is provided. Replication requests for objects in a distributed storage system are generated based at least in part on replication policies for the objects and a current state of the distributed storage system, wherein a respective replication request for a respective object instructs a respective instance of the distributed storage system to replicate the respective object so as to at least partially satisfy a replication policy for the respective object, wherein a respective replication policy includes criteria specifying at least storage device types on which replicas of object are to be stored. At least a subset of the replication requests is then distributed to the respective instances of the distributed storage system for execution.

    摘要翻译: 提供了一种用于在分布式存储系统中生成对象的复制请求的系统和方法。 至少部分地基于对象的复制策略和分布式存储系统的当前状态生成对分布式存储系统中的对象的复制请求,其中相应对象的相应复制请求指示分布式存储系统的相应实例 以复制相应的对象以便至少部分地满足相应对象的复制策略,其中相应的复制策略包括至少指定要存储对象的副本的存储设备类型的标准。 至少复制请求的一部分然后被分发到分布式存储系统的相应实例以供执行。

    Asynchronous distributed object uploading for replicated content addressable storage clusters
    12.
    发明授权
    Asynchronous distributed object uploading for replicated content addressable storage clusters 有权
    复制内容可寻址存储集群的异步分布式对象上传

    公开(公告)号:US08171202B2

    公开(公告)日:2012-05-01

    申请号:US12427367

    申请日:2009-04-21

    IPC分类号: G06F13/00

    摘要: A method is performed by two or more devices of a group of devices in a distributed data replication system. The method includes receiving, at the two or more devices, a group of chunks having a same unique temporary identifier, where the group of chunks comprises an object to be uploaded; creating an entry for the object in a replicated index, where the entry is keyed by the unique temporary identifier, and where the replicated index is replicated at each of the two or more devices; and determining, by an initiating device of the two or more devices, that a union of the group of chunks contains all data of the object. The method also includes calculating a content-based identifier to the object; creating another entry for the object in the replicated index, where the other entry is keyed by the content-based identifier; and updating the replicated index to point from the unique temporary identifier to the content-based identifier.

    摘要翻译: 一种方法由分布式数据复制系统中的一组设备的两个或多个设备执行。 该方法包括在两个或更多个设备处接收具有相同唯一临时标识符的一组块,其中该组块包括要上传的对象; 为复制索引中的对象创建条目,其中该条目由唯一的临时标识符键入,并且复制索引被复制在两个或更多个设备中的每一个上; 以及由所述两个或多个设备的发起设备确定所述一组组合的联合包含所述对象的所有数据。 该方法还包括向对象计算基于内容的标识符; 为复制索引中的对象创建另一个条目,其中另一个条目由基于内容的标识符键入; 并将所复制的索引更新为从唯一临时标识符指向基于内容的标识符。

    Pruning of blob replicas
    14.
    发明授权
    Pruning of blob replicas 有权
    修剪blob副本

    公开(公告)号:US08744997B2

    公开(公告)日:2014-06-03

    申请号:US13022213

    申请日:2011-02-07

    IPC分类号: G06F17/00 G06F7/00

    摘要: A system and method generating and distributing replica removal requests for objects in a distributed storage system is provided. Replica removal requests for objects in a distributed storage system are generated based at least in part on replication policies for the objects. A respective replica removal request instructs a respective instance of the distributed storage system to remove a respective replica of the respective object so as to at least partially satisfy replication policies for the respective object. Then the replica removal requests for the objects in the distributed storage system are distributed to respective instances of the distributed storage system corresponding to the replica removal requests for execution.

    摘要翻译: 提供了一种在分布式存储系统中生成和分发对象的副本去除请求的系统和方法。 至少部分地基于对象的复制策略生成分布式存储系统中对象的副本删除请求。 相应的副本删除请求指示分布式存储系统的相应实例去除相应对象的相应副本,以便至少部分地满足相应对象的复制策略。 然后,将分布式存储系统中的对象的副本删除请求分发到与要执行的副本删除请求相对应的分布式存储系统的相应实例。

    Asynchronous distributed object uploading for replicated content addressable storage clusters
    15.
    发明授权
    Asynchronous distributed object uploading for replicated content addressable storage clusters 有权
    复制内容可寻址存储集群的异步分布式对象上传

    公开(公告)号:US08468291B2

    公开(公告)日:2013-06-18

    申请号:US13444247

    申请日:2012-04-11

    IPC分类号: G06F13/00

    摘要: A method performed by two or more devices of a group of devices in a distributed data replication system may include receiving a group of chunks having a same unique temporary identifier, the group of chunks comprising an object to be uploaded; creating an entry for the object in a replicated index, the entry being keyed by the unique temporary identifier, and the replicated index being replicated at each of the two or more devices; and determining, by an initiating device of the two or more devices, that a union of the group of chunks contains all data of the object. The method may also include calculating a content-based identifier to the object; creating another entry for the object in the replicated index, the other entry being keyed by the content-based identifier; and updating the replicated index to point from the unique temporary identifier to the content-based identifier.

    摘要翻译: 分布式数据复制系统中的一组设备的两个或多个设备执行的方法可以包括接收具有相同唯一临时标识符的一组块,该组块包括要上传的对象; 在复制索引中创建对象的条目,该条目由唯一临时标识符键入,并且复制索引被复制在两个或更多个设备中的每一个上; 以及由所述两个或多个设备的发起设备确定所述一组组合的联合包含所述对象的所有数据。 该方法还可以包括:向对象计算基于内容的标识符; 为复制索引中的对象创建另一个条目,另一个条目由基于内容的标识符键入; 并将所复制的索引更新为从唯一临时标识符指向基于内容的标识符。

    Method and System for Dynamically Replicating Data Within A Distributed Storage System
    16.
    发明申请
    Method and System for Dynamically Replicating Data Within A Distributed Storage System 有权
    在分布式存储系统中动态复制数据的方法和系统

    公开(公告)号:US20110196828A1

    公开(公告)日:2011-08-11

    申请号:US13022579

    申请日:2011-02-07

    IPC分类号: G06F17/30

    CPC分类号: G06F17/30581

    摘要: A server computer at a first storage sub-system of a distributed storage system receives from a client a first client request for an object. If the object is not present in the first storage sub-system, the server computer identifies a second storage sub-system of the distributed storage system as having a replica of the requested object, the requested object including content and metadata. The server computer submits an object replication request for the requested object to the second storage sub-system and independently receives the content and metadata of the requested object from the second storage sub-system. The server computer generates a new replica of the object at the first storage sub-system using the received metadata and content and returns the metadata of the new replica of the object to the client.

    摘要翻译: 在分布式存储系统的第一存储子系统处的服务器计算机从客户端接收对象的第一客户端请求。 如果对象不存在于第一存储子系统中,则服务器计算机将分布式存储系统的第二存储子系统识别为具有请求对象的副本,所请求的对象包括内容和元数据。 服务器计算机向所述第二存储子系统提交所请求对象的对象复制请求,并且从第二存储子系统独立地接收所请求对象的内容和元数据。 服务器计算机使用接收到的元数据和内容在第一个存储子系统生成对象的新副本,并将对象的新副本的元数据返回给客户端。

    ASYNCHRONOUS DISTRIBUTED OBJECT UPLOADING FOR REPLICATED CONTENT ADDRESSABLE STORAGE CLUSTERS
    18.
    发明申请
    ASYNCHRONOUS DISTRIBUTED OBJECT UPLOADING FOR REPLICATED CONTENT ADDRESSABLE STORAGE CLUSTERS 有权
    用于替代内容可寻址存储群集的异步分布式物件上载

    公开(公告)号:US20100268902A1

    公开(公告)日:2010-10-21

    申请号:US12427367

    申请日:2009-04-21

    IPC分类号: G06F15/16 G06F12/02

    摘要: A method is performed by two or more devices of a group of devices in a distributed data replication system. The method includes receiving, at the two or more devices, a group of chunks having a same unique temporary identifier, where the group of chunks comprises an object to be uploaded; creating an entry for the object in a replicated index, where the entry is keyed by the unique temporary identifier, and where the replicated index is replicated at each of the two or more devices; and determining, by an initiating device of the two or more devices, that a union of the group of chunks contains all data of the object. The method also includes calculating a content-based identifier to the object; creating another entry for the object in the replicated index, where the other entry is keyed by the content-based identifier; and updating the replicated index to point from the unique temporary identifier to the content-based identifier.

    摘要翻译: 一种方法由分布式数据复制系统中的一组设备的两个或多个设备来执行。 该方法包括在两个或更多个设备处接收具有相同唯一临时标识符的一组块,其中该组块包括要上传的对象; 为复制索引中的对象创建条目,其中该条目由唯一的临时标识符键入,并且复制索引被复制在两个或更多个设备中的每一个上; 以及由所述两个或多个设备的发起设备确定所述一组组合的联合包含所述对象的所有数据。 该方法还包括向对象计算基于内容的标识符; 为复制索引中的对象创建另一个条目,其中另一个条目由基于内容的标识符键入; 并将所复制的索引更新为从唯一临时标识符指向基于内容的标识符。

    ASYNCHRONOUS DISTRIBUTED GARBAGE COLLECTION FOR REPLICATED STORAGE CLUSTERS
    19.
    发明申请
    ASYNCHRONOUS DISTRIBUTED GARBAGE COLLECTION FOR REPLICATED STORAGE CLUSTERS 有权
    用于替代存储群的异步分布式收集

    公开(公告)号:US20100161688A1

    公开(公告)日:2010-06-24

    申请号:US12644689

    申请日:2009-12-22

    IPC分类号: G06F17/30

    摘要: A method may be performed by a device of a group of devices in a distributed data replication system. The method may include storing objects in a data store, at least one or more of the objects being replicated with the distributed data replication system, and conducting a scan of the objects in the data store. The method may further include identifying one of the objects as not having a reference pointing to the object, storing a delete negotiation message as metadata associated with the one of the objects, and replicating the metadata with the delete negotiation message to one or more other devices of the group of devices.

    摘要翻译: 一种方法可以由分布式数据复制系统中的一组设备的设备执行。 该方法可以包括将对象存储在数据存储器中,所述对象中的至少一个或多个被复制分布式数据复制系统,并对数据存储中的对象进行扫描。 该方法还可以包括将对象中的一个标识为不具有指向对象的引用,将删除协商消息存储为与该对象之一相关联的元数据,并将具有删除协商消息的元数据复制到一个或多个其他设备 的设备组。

    ASYNCHRONOUS DISTRIBUTED DE-DUPLICATION FOR REPLICATED CONTENT ADDRESSABLE STORAGE CLUSTERS
    20.
    发明申请
    ASYNCHRONOUS DISTRIBUTED DE-DUPLICATION FOR REPLICATED CONTENT ADDRESSABLE STORAGE CLUSTERS 有权
    用于复制内容可寻址存储群集的异步分布式重传

    公开(公告)号:US20100161554A1

    公开(公告)日:2010-06-24

    申请号:US12644693

    申请日:2009-12-22

    IPC分类号: G06F17/30

    摘要: A method is performed by a device of a group of devices in a distributed data replication system. The method includes storing an index of objects in the distributed data replication system, the index being replicated while the objects are stored locally by the plurality of devices in the distributed data replication system. The method also includes conducting a scan of at least a portion of the index and identifying a redundant replica(s) of the at least one of the objects based on the scan of the index. The method further includes de-duplicating the redundant replica(s), and updating the index to reflect the status of the redundant replica.

    摘要翻译: 一种方法由分布式数据复制系统中的一组设备的设备执行。 所述方法包括在所述分布式数据复制系统中存储对象的索引,所述索引在所述对象由所述分布式数据复制系统中的所述多个设备在本地存储的同时进行复制。 该方法还包括对索引的至少一部分进行扫描,并且基于索引的扫描来识别所述至少一个对象的冗余副本。 该方法还包括解除复制冗余副本,并更新索引以反映冗余副本的状态。