公开(公告)号：US20110196833A1

公开(公告)日：2011-08-11

申请号：US13023503

申请日：2011-02-08

申请人： Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickery ,  Frank C. Dachille ,  George Datuashvili

发明人： Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickery ,  Frank C. Dachille ,  George Datuashvili

IPC分类号： G06F17/30

CPC分类号： G06F17/30345 ,  G06F3/065 ,  G06F17/30082 ,  G06F17/30554 ,  G06F17/30575

摘要： A distributed storage system has multiple instances. There is a plurality of local instances, and at least some of the local instances are at physically distinct geographic locations. Each local instance is configured to store data for a non-empty set of blobs in a plurality of data stores having a plurality of distinct data store types. In addition, each local instance stores metadata for the respective set of blobs in a metadata store distinct from the data stores. There is also a plurality of global instances. Each global instance is configured to store data for zero or more blobs in zero or more data stores and store metadata for all blobs stored at any local or global instance. The system selects one global instance to run a replication module that replicates blobs between instances according to blob policies. Some systems also include dynamic replication based on user needs.

摘要翻译： 分布式存储系统有多个实例。 存在多个本地实例，并且至少一些本地实例位于物理上不同的地理位置。 每个本地实例被配置为在具有多个不同数据存储类型的多个数据存储器中存储用于非空的一组Blob的数据。 此外，每个本地实例存储与数据存储不同的元数据存储中的相应组的组的元数据。 还有多个全局实例。 每个全局实例被配置为在零个或多个数据存储中存储零个或多个blob的数据，并存储在任何本地或全局实例中存储的所有blob的元数据。 系统选择一个全局实例来运行复制模块，该复制模块根据blob策略在实例之间复制Blob。 一些系统还包括基于用户需求的动态复制。

公开(公告)号：US20110196828A1

公开(公告)日：2011-08-11

申请号：US13022579

申请日：2011-02-07

申请人： Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

发明人： Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

IPC分类号： G06F17/30

CPC分类号： G06F17/30581

摘要： A server computer at a first storage sub-system of a distributed storage system receives from a client a first client request for an object. If the object is not present in the first storage sub-system, the server computer identifies a second storage sub-system of the distributed storage system as having a replica of the requested object, the requested object including content and metadata. The server computer submits an object replication request for the requested object to the second storage sub-system and independently receives the content and metadata of the requested object from the second storage sub-system. The server computer generates a new replica of the object at the first storage sub-system using the received metadata and content and returns the metadata of the new replica of the object to the client.

摘要翻译： 在分布式存储系统的第一存储子系统处的服务器计算机从客户端接收对象的第一客户端请求。 如果对象不存在于第一存储子系统中，则服务器计算机将分布式存储系统的第二存储子系统识别为具有请求对象的副本，所请求的对象包括内容和元数据。 服务器计算机向所述第二存储子系统提交所请求对象的对象复制请求，并且从第二存储子系统独立地接收所请求对象的内容和元数据。 服务器计算机使用接收到的元数据和内容在第一个存储子系统生成对象的新副本，并将对象的新副本的元数据返回给客户端。

公开(公告)号：US08886602B2

公开(公告)日：2014-11-11

申请号：US13022258

申请日：2011-02-07

申请人： Yonatan Zunger ,  Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

发明人： Yonatan Zunger ,  Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

IPC分类号： G06F17/00 ,  G06F7/00 ,  G06F13/10 ,  G06G7/62

CPC分类号： G06F17/30215 ,  G06F11/2094 ,  G06F11/3457 ,  H04L67/1095 ,  H04L67/1097

摘要： A system and method for generating replication requests for objects in a distributed storage system is provided. For a respective object in a distributed storage system the following is performed. Replication policies for the object that have not been satisfied are determined. Replication requests are ranked for the object whose replication policies have not been satisfied based on a number of replicas of the object that need to be created in order to satisfy the replication policies for the object. Replication requests are generated for the object based at least in part on the replication policies for the object that have not been satisfied and on a current state of the distributed storage system. At least a subset of the replication requests for the objects in the distributed storage system are distributed to respective instances of the distributed storage system corresponding to the replication requests for execution.

摘要翻译： 提供了一种用于在分布式存储系统中生成对象的复制请求的系统和方法。 对于分布式存储系统中的相应对象，执行以下操作。 确定尚未满足的对象的复制策略。 基于需要创建的对象的副本的数量，为了满足对象的复制策略，复制请求被排序为其复制策略尚未满足的对象。 至少部分地基于对于尚未满足的对象和分布式存储系统的当前状态的复制策略为该对象生成复制请求。 对分布式存储系统中的对象的复制请求的至少一个子集分配到与复制请求执行相对应的分布式存储系统的相应实例。

公开(公告)号：US08560292B2

公开(公告)日：2013-10-15

申请号：US13022236

申请日：2011-02-07

申请人： Yonatan Zunger ,  Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

发明人： Yonatan Zunger ,  Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

IPC分类号： G06G7/62 ,  G06F17/30

CPC分类号： G06F17/30215 ,  G06F11/2094 ,  G06F11/3457 ,  H04L67/1095 ,  H04L67/1097

摘要： A system and method for simulating a state of a distributed storage system is provided. A current state of a distributed storage system and replication policies for the objects in the distributed storage system is obtained. Proposed modifications to the current state of the distributed storage system are received. The state of the distributed storage system is simulated over time based on the current state of the distributed storage system, the replication policies for the objects in the distributed storage system, and the proposed modifications to the current state of the distributed storage system. Then reports relating to the time evolution of the current state of the distributed storage system are generated based on the simulation.

摘要翻译： 提供了一种用于模拟分布式存储系统的状态的系统和方法。 获得分布式存储系统的当前状态和分布式存储系统中的对象的复制策略。 接收对分布式存储系统的当前状态的修改。 基于分布式存储系统的当前状态，分布式存储系统中对象的复制策略以及对分布式存储系统当前状态的修改，分布式存储系统的状态随着时间的推移而被模拟。 然后根据仿真生成关于分布式存储系统的当前状态的时间演化的报告。

公开(公告)号：US08352424B2

公开(公告)日：2013-01-08

申请号：US13022290

申请日：2011-02-07

申请人： Yonatan Zunger ,  Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

发明人： Yonatan Zunger ,  Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

IPC分类号： G06F7/00 ,  G06F17/00

CPC分类号： G06F17/30215 ,  G06F11/2094 ,  G06F11/3457 ,  H04L67/1095 ,  H04L67/1097

摘要： A system and method for generating replication requests for objects in a distributed storage system is provided. Replication requests for objects in a distributed storage system are generated based at least in part on replication policies for the objects and a current state of the distributed storage system, wherein a respective replication request for a respective object instructs a respective instance of the distributed storage system to replicate the respective object so as to at least partially satisfy a replication policy for the respective object, wherein a respective replication policy includes criteria specifying at least storage device types on which replicas of object are to be stored. At least a subset of the replication requests is then distributed to the respective instances of the distributed storage system for execution.

摘要翻译： 提供了一种用于在分布式存储系统中生成对象的复制请求的系统和方法。 至少部分地基于对象的复制策略和分布式存储系统的当前状态生成对分布式存储系统中的对象的复制请求，其中相应对象的相应复制请求指示分布式存储系统的相应实例 以复制相应的对象以便至少部分地满足相应对象的复制策略，其中相应的复制策略包括至少指定要存储对象的副本的存储设备类型的标准。 至少复制请求的一部分然后被分发到分布式存储系统的相应实例以供执行。

公开(公告)号：US08868508B2

公开(公告)日：2014-10-21

申请号：US13023503

申请日：2011-02-08

申请人： Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

发明人： Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

IPC分类号： G06F7/00 ,  G06F17/00 ,  G06F17/30

CPC分类号： G06F17/30345 ,  G06F3/065 ,  G06F17/30082 ,  G06F17/30554 ,  G06F17/30575

摘要： A distributed storage system has multiple instances. There is a plurality of local instances, and at least some of the local instances are at physically distinct geographic locations. Each local instance is configured to store data for a non-empty set of blobs in a plurality of data stores having a plurality of distinct data store types. In addition, each local instance stores metadata for the respective set of blobs in a metadata store distinct from the data stores. There is also a plurality of global instances. Each global instance is configured to store data for zero or more blobs in zero or more data stores and store metadata for all blobs stored at any local or global instance. The system selects one global instance to run a replication module that replicates blobs between instances according to blob policies.

摘要翻译： 分布式存储系统有多个实例。 存在多个本地实例，并且至少一些本地实例位于物理上不同的地理位置。 每个本地实例被配置为在具有多个不同数据存储类型的多个数据存储器中存储用于非空的一组Blob的数据。 此外，每个本地实例存储与数据存储不同的元数据存储中的相应组的组的元数据。 还有多个全局实例。 每个全局实例被配置为在零个或多个数据存储中存储零个或多个blob的数据，并存储在任何本地或全局实例中存储的所有blob的元数据。 系统选择一个全局实例来运行复制模块，该复制模块根据blob策略在实例之间复制Blob。

公开(公告)号：US08341118B2

公开(公告)日：2012-12-25

申请号：US13022579

申请日：2011-02-07

申请人： Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

发明人： Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

IPC分类号： G06F17/30

CPC分类号： G06F17/30581

摘要： A server computer at a first storage sub-system of a distributed storage system receives from a client a first client request for an object. If the object is not present in the first storage sub-system, the server computer identifies a second storage sub-system of the distributed storage system as having a replica of the requested object, the requested object including content and metadata. The server computer submits an object replication request for the requested object to the second storage sub-system and independently receives the content and metadata of the requested object from the second storage sub-system. The server computer generates a new replica of the object at the first storage sub-system using the received metadata and content and returns the metadata of the new replica of the object to the client.

摘要翻译： 在分布式存储系统的第一存储子系统处的服务器计算机从客户端接收对象的第一客户端请求。 如果对象不存在于第一存储子系统中，则服务器计算机将分布式存储系统的第二存储子系统识别为具有请求对象的副本，所请求的对象包括内容和元数据。 服务器计算机向所述第二存储子系统提交所请求对象的对象复制请求，并且从第二存储子系统独立地接收所请求对象的内容和元数据。 服务器计算机使用接收到的元数据和内容在第一个存储子系统生成对象的新副本，并将对象的新副本的元数据返回给客户端。

公开(公告)号：US20110196900A1

公开(公告)日：2011-08-11

申请号：US13023482

申请日：2011-02-08

申请人： Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

发明人： Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

IPC分类号： G06F7/00

CPC分类号： G06F16/23 ,  G06F3/065 ,  G06F16/122 ,  G06F16/248 ,  G06F16/27

摘要： A distributed storage system stores data for files. A first blob (binary large object) of data is received. The first blob is split into one or more first chunks of data. Content fingerprints for the first chunks of data are computed. The first chunks of data are stored in a chunk store while and their content fingerprints are stored in a store distinct from the chunk store. A second blob of data is received. The second blob is split into one or more second chunks of data. Content fingerprints for the second chunks of data are computed. Then for a second chunk of data whose content fingerprint matches a content fingerprint of a first chunk of data, a second reference to the corresponding first chunk of data that has a matching content fingerprint is stored, but the second chunk of data is not stored.

摘要翻译： 分布式存储系统存储文件数据。 接收到第一个blob（二进制大对象）数据。 第一个blob被分成一个或多个第一批数据。 计算第一批数据的内容指纹。 第一批数据被存储在块存储器中，并且它们的内容指纹被存储在与块存储器不同的存储器中。 接收第二个数据块。 第二个Blob被分成一个或多个第二个数据块。 计算第二批数据的内容指纹。 然后，对于其内容指纹与第一组数据的内容指纹匹配的第二数据块，存储具有匹配内容指纹的对应的第一数据块的第二参考，但不存储第二组数据。

公开(公告)号：US20110196832A1

公开(公告)日：2011-08-11

申请号：US13022258

申请日：2011-02-07

申请人： Yonatan Zunger ,  Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

发明人： Yonatan Zunger ,  Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

IPC分类号： G06F17/30

CPC分类号： G06F17/30215 ,  G06F11/2094 ,  G06F11/3457 ,  H04L67/1095 ,  H04L67/1097

摘要： A system and method for generating replication requests for objects in a distributed storage system is provided. For a respective object in a distributed storage system the following is performed. Replication policies for the object that have not been satisfied are determined. Replication requests are ranked for the object whose replication policies have not been satisfied based on a number of replicas of the object that need to be created in order to satisfy the replication policies for the object. Replication requests are generated for the object based at least in part on the replication policies for the object that have not been satisfied and on a current state of the distributed storage system. At least a subset of the replication requests for the objects in the distributed storage system are distributed to respective instances of the distributed storage system corresponding to the replication requests for execution.

摘要翻译： 提供了一种用于在分布式存储系统中生成对象的复制请求的系统和方法。 对于分布式存储系统中的相应对象，执行以下操作。 确定尚未满足的对象的复制策略。 基于需要创建的对象的副本的数量，为了满足对象的复制策略，复制请求被排序为其复制策略尚未满足的对象。 至少部分地基于对于尚未满足的对象和分布式存储系统的当前状态的复制策略为该对象生成复制请求。 对分布式存储系统中的对象的复制请求的至少一个子集分配到与复制请求执行相对应的分布式存储系统的相应实例。

公开(公告)号：US20110196664A1

公开(公告)日：2011-08-11

申请号：US13022236

申请日：2011-02-07

申请人： Yonatan Zunger ,  Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

发明人： Yonatan Zunger ,  Alexandre Drobychev ,  Alexander Kesselman ,  Rebekah C. Vickrey ,  Frank C. Dachille ,  George Datuashvili

IPC分类号： G06F13/10

CPC分类号： G06F17/30215 ,  G06F11/2094 ,  G06F11/3457 ,  H04L67/1095 ,  H04L67/1097

摘要： A system and method for simulating a state of a distributed storage system is provided. A current state of a distributed storage system and replication policies for the objects in the distributed storage system is obtained. Proposed modifications to the current state of the distributed storage system are received. The state of the distributed storage system is simulated over time based on the current state of the distributed storage system, the replication policies for the objects in the distributed storage system, and the proposed modifications to the current state of the distributed storage system. Then reports relating to the time evolution of the current state of the distributed storage system are generated based on the simulation.

摘要翻译： 提供了一种用于模拟分布式存储系统的状态的系统和方法。 获得分布式存储系统的当前状态和分布式存储系统中的对象的复制策略。 接收对分布式存储系统的当前状态的修改。 基于分布式存储系统的当前状态，分布式存储系统中对象的复制策略以及对分布式存储系统当前状态的修改，分布式存储系统的状态随着时间的推移而被模拟。 然后根据仿真生成关于分布式存储系统的当前状态的时间演化的报告。