公开(公告)号：EP2164005A2

公开(公告)日：2010-03-17

申请号：EP09168481.1

申请日：2009-08-24

申请人： NEC Laboratories America, Inc.

发明人： Ungureanu, Cristian ,  Dubnicki, Cezary

IPC分类号： G06F17/30

CPC分类号： G06F17/30097 ,  G06F17/30138

摘要： In accordance with exemplary embodiments of the present invention, a content addressable data structure system may include directed acyclic graphs (DAGs) of data content that are addressed using both a user-defined search key and content of data blocks. Internal keys of retention roots of the DAGs may be derived from the user-defined search key while the remaining blocks may be content addressed. As opposed to using a content address, the user may provide the search key when retrieving and deleting DAGs retaining the data content. In addition, the internal keys may be implemented using internal content addressable storage operations, such as applying a hash function and employing a distributed hash table.

摘要翻译： 根据本发明的示例性实施例，内容可寻址数据结构系统可以包括使用用户定义的搜索关键字和数据块的内容来寻址的数据内容的有向非循环图（DAG）。 DAG的保留根的内部键可以从用户定义的搜索键导出，而剩余的块可以被内容寻址。 与使用内容地址相反，用户可以在检索和删除保留数据内容的DAG时提供搜索关键字。 此外，内部密钥可以使用诸如应用散列函数和采用分布式散列表的内部可寻址存储操作来实现。

公开(公告)号：EP2164005A3

公开(公告)日：2010-09-29

申请号：EP09168481.1

申请日：2009-08-24

申请人： NEC Laboratories America, Inc.

发明人： Ungureanu, Cristian ,  Dubnicki, Cezary

IPC分类号： G06F17/30

CPC分类号： G06F17/30097 ,  G06F17/30138

摘要： In accordance with exemplary embodiments of the present invention, a content addressable data structure system may include directed acyclic graphs (DAGs) of data content that are addressed using both a user-defined search key and content of data blocks. Internal keys of retention roots of the DAGs may be derived from the user-defined search key while the remaining blocks may be content addressed. As opposed to using a content address, the user may provide the search key when retrieving and deleting DAGs retaining the data content. In addition, the internal keys may be implemented using internal content addressable storage operations, such as applying a hash function and employing a distributed hash table.

摘要翻译： 根据本发明的示例性实施例，内容可寻址数据结构系统可以包括使用用户定义的搜索关键字和数据块的内容来寻址的数据内容的有向无环图（DAG）。 DAG的保留根的内部密钥可以从用户定义的搜索关键字导出，而剩余的块可以是内容寻址的。 与使用内容地址相反，用户可以在检索和删除保留数据内容的DAG时提供搜索关键字。 另外，内部密钥可以使用内部内容可寻址存储操作来实现，例如应用散列函数并采用分布式散列表。

公开(公告)号：EP2164006A2

公开(公告)日：2010-03-17

申请号：EP09168487.8

申请日：2009-08-24

申请人： NEC Laboratories America, Inc.

发明人： Dubnicki, Cezary ,  Ungureanu, Cristian

IPC分类号： G06F17/30

CPC分类号： G06F17/30067 ,  G06F11/14

摘要： Exemplary systems and methods in accordance with embodiments of the present invention may provide a plurality of data services by employing splittable, mergable and transferable redundant chains of data containers. The chains and containers may be automatically split and/or merged in response to changes in storage node network configurations and may be stored in erasure coded fragments distributed across different storage nodes. Data services provided in a distributed secondary storage system utilizing redundant chains of containers may include global deduplication, dynamic scalability, support for multiple redundancy classes, data location, fast reading and writing of data and rebuilding of data due to node or disk failures.

公开(公告)号：EP2164006A3

公开(公告)日：2014-06-11

申请号：EP09168487.8

申请日：2009-08-24

申请人： NEC Laboratories America, Inc.

发明人： Dubnicki, Cezary ,  Ungureanu, Cristian

IPC分类号： G06F17/30

CPC分类号： G06F17/30067 ,  G06F11/14

摘要： Exemplary systems and methods in accordance with embodiments of the present invention may provide a plurality of data services by employing splittable, mergable and transferable redundant chains of data containers. The chains and containers may be automatically split and/or merged in response to changes in storage node network configurations and may be stored in erasure coded fragments distributed across different storage nodes. Data services provided in a distributed secondary storage system utilizing redundant chains of containers may include global deduplication, dynamic scalability, support for multiple redundancy classes, data location, fast reading and writing of data and rebuilding of data due to node or disk failures.

摘要翻译： 根据本发明的实施例的示例性系统和方法可以通过采用可拆分的，可合并且可转移的数据容器冗余链来提供多个数据服务。 响应于存储节点网络配置的变化，链和容器可以被自动分割和/或合并，并且可以存储在分布在不同存储节点上的擦除编码片段中。 使用冗余的容器链的分布式二级存储系统中提供的数据服务可能包括全局重复数据删除，动态可扩展性，对多个冗余类的支持，数据位置，数据的快速读取和写入以及由于节点或磁盘故障而重建数据。

公开(公告)号：EP2178003A2

公开(公告)日：2010-04-21

申请号：EP09167970.4

申请日：2009-08-17

申请人： NEC Laboratories America, Inc.

发明人： Kruss, Erik ,  Ungureanu, Cristian ,  Gokhale, Salil ,  Aranya, Akshat ,  Rago, Stephen A.

IPC分类号： G06F17/30

CPC分类号： G06F17/30091

摘要： A region of a node is searched to find a content-defined split point. A split point of a node is determined based at least in part on hashes of entries in the node and the node is split based on the determined split point. The search region is searched for the first encountered split point and the node is split based on that split point. That split point is based on a predetermined bitmask of the hashes of the entries in the node satisfying a predetermined condition.

摘要翻译： 搜索节点的区域以找到内容定义的分割点。 至少部分地基于节点中的条目的散列来确定节点的分割点，并且基于所确定的分割点来分割节点。 搜索搜索区域的第一个遇到的分割点，并且基于该分割点对该节点进行分割。 该分割点基于满足预定条件的节点中的条目的散列的预定位掩码。