公开(公告)号：US07657581B2

公开(公告)日：2010-02-02

申请号：US11190402

申请日：2005-07-27

申请人： Jack A. Orenstein ,  David E. Chavez

发明人： Jack A. Orenstein ,  David E. Chavez

IPC分类号： G06F17/30

CPC分类号： G06F11/2097 ,  G06F17/30575

摘要： An archival storage cluster of preferably symmetric nodes includes a metadata management system that organizes and provides access to given metadata, preferably in the form of metadata objects. Each metadata object may have a unique name, and metadata objects are organized into regions. Preferably, a region is selected by hashing one or more object attributes (e.g., the object's name) and extracting a given number of bits of the resulting hash value. The number of bits may be controlled by a configuration parameter. Each region is stored redundantly. A region comprises a set of region copies. In particular, there is one authoritative copy of the region, and zero or more backup copies. The number of backup copies may be controlled by a configuration parameter. Region copies are distributed across the nodes of the cluster so as to balance the number of authoritative region copies per node, as well as the number of total region copies per node. Backup region copies are maintained synchronized to their associated authoritative region copy.

摘要翻译： 优选对称节点的归档存储集群包括元数据管理系统，其优选地以元数据对象的形式组织并提供对给定元数据的访问。 每个元数据对象可以具有唯一的名称，元数据对象被组织成区域。 优选地，通过散列一个或多个对象属性（例如，对象的名称）并提取所得到的散列值的给定位数来选择区域。 位数可以由配置参数来控制。 每个区域被冗余地存储。 区域包括一组区域副本。 特别是，该地区有一个权威的副本，零个或多个备份副本。 备份副本的数量可以由配置参数控制。 区域副本分布在群集的节点上，以平衡每个节点的权威区域副本的数量以及每个节点的总区域副本数。 备份区域副本保持与其相关联的权威区域副本同步。

公开(公告)号：US20070189153A1

公开(公告)日：2007-08-16

申请号：US11675224

申请日：2007-02-15

申请人： Robert S. Mason

发明人： Robert S. Mason

IPC分类号： H04J1/16

CPC分类号： G06F21/6209 ,  G06F17/30082 ,  G06F17/30188 ,  G06F17/30197

摘要： An archival storage cluster of preferably symmetric nodes includes a data protection management system that periodically organizes the then-available nodes into one or more protection sets, with each set comprising a set of n nodes, where “n” refers to a configurable “data protection level” (DPL). At the time of its creation, a given protection set is closed in the sense that each then available node is a member of one, and only one, protection set. When an object is to be stored within the archive, the data protection management system stores the object in a given node of a given protection set and then constrains the distribution of copies of that object to other nodes within the given protection set. As a consequence, all DPL copies of an object are all stored within the same protection set, and only that protection set. This scheme significantly improves MTDL for the cluster as a whole, as the data can only be lost if multiple failures occur within nodes of a given protection set. This is far more unlikely than failures occurring across any random distribution of nodes within the cluster.

摘要翻译： 优选对称节点的归档存储集群包括数据保护管理系统，其周期性地将当前可用节点组织到一个或多个保护集中，其中每个集合包括一组n个节点，其中“n”是指可配置的“数据保护 级“（DPL）。 在创建时，给定的保护集是关闭的，因为每个可用节点都是一个成员，只有一个保护集。 当一个对象要存储在归档中时，数据保护管理系统将对象存储在给定保护集的给定节点中，然后将该对象的拷贝的分布约束到给定保护集内的其他节点。 因此，对象的所有DPL副本都存储在同一个保护集中，只有该保护设置。 该方案大大提高了集群整体的MTDL，因为只有在给定保护集的节点内发生多个故障时，数据才能丢失。 这比群集内节点的任何随机分布发生的故障更不可能。

公开(公告)号：US20120246126A1

公开(公告)日：2012-09-27

申请号：US13449368

申请日：2012-04-18

申请人： Andres Rodriguez ,  Jack A. Orenstein ,  David M. Shaw ,  Benjamin K.D. Bernhard

发明人： Andres Rodriguez ,  Jack A. Orenstein ,  David M. Shaw ,  Benjamin K.D. Bernhard

IPC分类号： G06F17/30

CPC分类号： G06F17/30289 ,  G06F11/1469 ,  G06F17/30073 ,  G06F17/30082 ,  G06F17/30117 ,  G06F17/30188 ,  G06F17/30197 ,  G06F17/30221 ,  Y10S707/99932 ,  Y10S707/99944 ,  Y10S707/99956

摘要： An archive cluster application runs across a redundant array of independent nodes. Each node runs an archive cluster application instance comprising a set of software processes: a request manager, a storage manager, a metadata manager, and a policy manager. The request manager manages requests for data, the storage manager manages data read/write functions, and the metadata manager facilitates metadata transactions and recovery. The policy manager implements policies, which are operations that determine the behavior of an “archive object” within the cluster. The archive cluster application provides object-based storage. It associates metadata and policies with the raw archived data, which together comprise an archive object. Object policies govern the object's behavior in the archive. The archive manages itself independently of client applications, acting automatically to ensure that object policies are valid.

摘要翻译： 归档集群应用程序跨独立节点的冗余阵列运行。 每个节点运行包含一组软件过程的归档集群应用程序实例：请求管理器，存储管理器，元数据管理器和策略管理器。 请求管理器管理数据请求，存储管理器管理数据读/写功能，元数据管理器便于元数据事务和恢复。 策略管理器实现策略，这些策略是确定集群中“归档对象”的行为的操作。 归档集群应用程序提供基于对象的存储。 它将元数据和策略与原始归档数据相关联，这些数据共同构成归档对象。 对象策略管理对象在归档中的行为。 归档管理自身独立于客户端应用程序，自动执行以确保对象策略有效。

公开(公告)号：US08165996B2

公开(公告)日：2012-04-24

申请号：US12697375

申请日：2010-02-01

申请人： Andres Rodriguez ,  Jack A. Orenstein ,  David M. Shaw ,  Benjamin K. D. Bernhard

发明人： Andres Rodriguez ,  Jack A. Orenstein ,  David M. Shaw ,  Benjamin K. D. Bernhard

IPC分类号： G06F17/30

CPC分类号： G06F17/30289 ,  G06F11/1469 ,  G06F17/30073 ,  G06F17/30082 ,  G06F17/30117 ,  G06F17/30188 ,  G06F17/30197 ,  G06F17/30221 ,  Y10S707/99932 ,  Y10S707/99944 ,  Y10S707/99956

摘要： An archive cluster application runs in a distributed manner across a redundant array of independent nodes. Each node preferably runs a complete archive cluster application instance. A given nodes provides a data repository, which stores up to a large amount (e.g., a terabyte) of data, while also acting as a portal that enables access to archive files. Each symmetric node has a set of software processes, e.g., a request manager, a storage manager, a metadata manager, and a policy manager. The request manager manages requests to the node for data (i.e., file data), the storage manager manages data read/write functions from a disk associated with the node, and the metadata manager facilitates metadata transactions and recovery across the distributed database. The policy manager implements one or more policies, which are operations that determine the behavior of an “archive object” within the cluster. The archive cluster application provides object-based storage. Preferably, the application permanently associates metadata and policies with the raw archived data, which together comprise an archive object. Object policies govern the object's behavior in the archive. As a result, the archive manages itself independently of client applications, acting automatically to ensure that all object policies are valid.

摘要翻译： 归档集群应用程序通过独立节点的冗余阵列以分布式方式运行。 每个节点最好运行一个完整的归档集群应用实例。 给定的节点提供了一个数据存储库，它可以存储大量数据（例如，一千兆字节）的数据，同时还充当允许访问存档文件的门户。 每个对称节点具有一组软件过程，例如请求管理器，存储管理器，元数据管理器和策略管理器。 请求管理器管理对节点的数据（即文件数据）的请求，存储管理器从与该节点相关联的盘管理数据读/写功能，并且元数据管理器便于跨分布式数据库的元数据事务和恢复。 策略管理器实现一个或多个策略，这些策略是确定集群中“归档对象”的行为的操作。 归档集群应用程序提供基于对象的存储。 优选地，应用程序将元数据和策略永久地关联到原始归档数据，其一起构成归档对象。 对象策略管理对象在归档中的行为。 因此，归档管理自身独立于客户端应用程序，自动执行以确保所有对象策略都有效。

公开(公告)号：US07694181B2

公开(公告)日：2010-04-06

申请号：US11299572

申请日：2005-12-12

申请人： Jesse A. Noller ,  Robert S. Mason, Jr.

发明人： Jesse A. Noller ,  Robert S. Mason, Jr.

IPC分类号： G06F11/00

CPC分类号： G06F11/3688

摘要： A generic testing framework to automatically allocate, install and verify a given version of a system under test, to exercise the system against a series of tests in a “hands-off” objective manner, and then to export information about the tests to one or more developer repositories (such as a query-able database, an email list, a developer web server, a source code version control system, a defect tracking system, or the like). The framework does not “care” or concern itself with the particular implementation language of the test as long as the test can issue directives via a command line or configuration file. During the automated testing of a given test suite having multiple tests, and after a particular test is run, the framework preferably generates an “image” of the system under test and makes that information available to developers, even while additional tests in the suite are being carried out. In this manner, the framework preserves the system “state” to facilitate concurrent or after-the-fact debugging. The framework also will re-install and verify a given version of the system between tests, which may be necessary in the event a given test is destructive or otherwise places the system in an unacceptable condition.

公开(公告)号：US07657586B2

公开(公告)日：2010-02-02

申请号：US11638252

申请日：2006-12-13

申请人： Andres Rodriguez ,  Jack A. Orenstein ,  David M. Shaw ,  Benjamin K. D. Bernhard

发明人： Andres Rodriguez ,  Jack A. Orenstein ,  David M. Shaw ,  Benjamin K. D. Bernhard

IPC分类号： G06F17/30

CPC分类号： G06F17/30289 ,  G06F11/1469 ,  G06F17/30073 ,  G06F17/30082 ,  G06F17/30117 ,  G06F17/30188 ,  G06F17/30197 ,  G06F17/30221 ,  Y10S707/99932 ,  Y10S707/99944 ,  Y10S707/99956

摘要： An archive cluster application runs in a distributed manner across a redundant array of independent nodes. Each node preferably runs a complete archive cluster application instance. A given nodes provides a data repository, which stores up to a large amount (e.g., a terabyte) of data, while also acting as a portal that enables access to archive files. Each symmetric node has a set of software processes, e.g., a request manager, a storage manager, a metadata manager, and a policy manager. The request manager manages requests to the node for data (i.e., file data), the storage manager manages data read/write functions from a disk associated with the node, and the metadata manager facilitates metadata transactions and recovery across the distributed database. The policy manager implements one or more policies, which are operations that determine the behavior of an “archive object” within the cluster. The archive cluster application provides object-based storage. Preferably, the application permanently associates metadata and policies with the raw archived data, which together comprise an archive object. Object policies govern the object's behavior in the archive. As a result, the archive manages itself independently of client applications, acting automatically to ensure that all object policies are valid.

摘要翻译： 归档集群应用程序通过独立节点的冗余阵列以分布式方式运行。 每个节点最好运行一个完整的归档集群应用实例。 给定的节点提供了一个数据存储库，它可以存储大量数据（例如，一千兆字节）的数据，同时还充当允许访问存档文件的门户。 每个对称节点具有一组软件过程，例如请求管理器，存储管理器，元数据管理器和策略管理器。 请求管理器管理对节点的数据（即文件数据）的请求，存储管理器从与该节点相关联的盘管理数据读/写功能，并且元数据管理器便于跨分布式数据库的元数据事务和恢复。 策略管理器实现一个或多个策略，这些策略是确定集群中“归档对象”的行为的操作。 归档集群应用程序提供基于对象的存储。 优选地，应用程序将元数据和策略永久地关联到原始归档数据，其一起构成归档对象。 对象策略管理对象在归档中的行为。 因此，归档管理自身独立于客户端应用程序，自动执行以确保所有对象策略都有效。

公开(公告)号：US07240236B2

公开(公告)日：2007-07-03

申请号：US10806488

申请日：2004-03-23

申请人： Shaun Cutts ,  Andres Rodriguez

发明人： Shaun Cutts ,  Andres Rodriguez

IPC分类号： G06F11/08 ,  H03M13/13 ,  G06F11/10

CPC分类号： G06F11/1076 ,  G06F2211/1028 ,  H03M13/1191 ,  H03M13/151

摘要： A file protection scheme for fixed content in a distributed data archive uses computations that leverage permutation operators of a cyclic code. In an illustrative embodiment, an N+K coding technique is described for use to protect data that is being distributed in a redundant array of independent nodes (RAIN). The data itself may be of any type, and it may also include system metadata. According to the invention, the data to be distributed is encoded by a dispersal operation that uses a group of permutation ring operators. In a preferred embodiment, the dispersal operation is carried out using a matrix of the form [IN—C] where IN is an n×n identity sub-matrix and C is a k×n sub-matrix of code blocks. The identity sub-matrix is used to preserve the data blocks intact. The sub-matrix C preferably comprises a set of permutation ring operators that are used to generate the code blocks. The operators are preferably superpositions that are selected from a group ring of a permutation group with base ring Z2.

摘要翻译： 分布式数据归档中固定内容的文件保护方案使用利用循环码的置换运算符的计算。 在说明性实施例中，描述了用于保护分布在独立节点（RAIN）的冗余阵列中的数据的N + K编码技术。 数据本身可以是任何类型的，并且它也可以包括系统元数据。 根据本发明，要分配的数据通过使用一组置换环操作符的分散操作进行编码。 在一个优选实施例中，使用以下形式的矩阵来执行分散操作：其中I N为N [N 2 是n×n个身份子矩阵，C是代码块的k×n子矩阵。 身份子矩阵用于完整保存数据块。 子矩阵C优选地包括用于生成代码块的一组置换环操作符。 操作者优选地是从具有基环Z 2的置换组的组环中选择的叠加。

公开(公告)号：US20070234293A1

公开(公告)日：2007-10-04

申请号：US11299572

申请日：2005-12-12

申请人： Jesse Noller ,  Robert Mason

发明人： Jesse Noller ,  Robert Mason

IPC分类号： G06F9/44

CPC分类号： G06F11/3688

摘要： A generic testing framework to automatically allocate, install and verify a given version of a system under test, to exercise the system against a series of tests in a “hands-off” objective manner, and then to export information about the tests to one or more developer repositories (such as a query-able database, an email list, a developer web server, a source code version control system, a defect tracking system, or the like). The framework does not “care” or concern itself with the particular implementation language of the test as long as the test can issue directives via a command line or configuration file. During the automated testing of a given test suite having multiple tests, and after a particular test is run, the framework preferably generates an “image” of the system under test and makes that information available to developers, even while additional tests in the suite are being carried out. In this manner, the framework preserves the system “state” to facilitate concurrent or after-the-fact debugging. The framework also will re-install and verify a given version of the system between tests, which may be necessary in the event a given test is destructive or otherwise places the system in an unacceptable condition.

摘要翻译： 一个通用测试框架，用于自动分配，安装和验证被测系统的给定版本，以“手动”客观的方式对系统进行一系列测试，然后将有关测试的信息导出到一个或 更多的开发者存储库（诸如可查询数据库，电子邮件列表，开发者Web服务器，源代码版本控制系统，缺陷跟踪系统等）。 只要测试可以通过命令行或配置文件发出指令，该框架不会“关心”或关心测试的特定实现语言。 在具有多个测试的给定测试套件的自动测试期间，并且在运行特定测试之后，框架优选地生成被测系统的“图像”，并且使得该信息可供开发者使用，即使套件中的附加测试 正在进行。 以这种方式，框架保留系统“状态”以便于并发或事后调试。 该框架还将在测试之间重新安装和验证系统的给定版本，这在给定测试是破坏性的或以其他方式将系统置于不可接受的条件下可能是必需的。

公开(公告)号：US20070162894A1

公开(公告)日：2007-07-12

申请号：US11329631

申请日：2006-01-11

申请人： Jesse Noller ,  Robert Mason

发明人： Jesse Noller ,  Robert Mason

IPC分类号： G06F9/44

CPC分类号： G06F11/3688 ,  G06F11/3684

摘要： An automated system that randomly generates test cases for use in hardware or software quality assurance testing, wherein a given test case comprises a sequence (or “chain”) of discrete, atomic steps (or “building blocks”). A particular test case (i.e., a given sequence) has a variable number of building blocks. The system takes a set of test actions (or even test cases) and links them together in a relevant and useful manner to create a much larger library of test cases or “chains.” The chains comprise a large number of random sequence tests that facilitate “chaos-like” or exploratory testing of the overall system under test. Upon execution in the system under test, the test case is considered successful (i.e., a pass) if each building block in the chain executes successfully; if any building block fails, the test case, in its entirety, is considered a failure. The system adapts and dynamically generates new test cases as underlying data changes (e.g., a building block is added, deleted, modified) or new test cases themselves are generated. The system also is tunable to generate test sequences that have a given (e.g., higher) likelihood of finding bugs or generating errors from which the testing entity can then assess the system operation. Generated chains can be replayed easily to provide test reproducibility.

摘要翻译： 随机生成用于硬件或软件质量保证测试的测试用例的自动系统，其中给定的测试用例包括离散的原子步骤（或“构建块”）的序列（或“链”）。 特定的测试用例（即给定的序列）具有可变数量的构建块。 系统采取一组测试动作（甚至测试用例），并以相关和有用的方式将它们连接在一起，以创建更大的测试用例或“链”库。 链条包含大量随机序列测试，可以帮助整个系统的“混乱”或探索性测试。 在被测系统中执行时，如果链中的每个构建块成功执行，则测试用例被认为是成功的（即，通过） 如果任何构建块失败，则整个测试用例被认为是失败的。 系统适应并动态生成新的测试用例作为基础数据变化（例如，添加，删除，修改构建块）或生成新的测试用例本身。 该系统也是可调整的，以产生测试序列，该测试序列具有发现错误或产生错误的给定（例如，更高）的可能性，测试实体可以随后评估系统操作。 生成的链条可以轻松重放，提供测试重现性。

公开(公告)号：US07155466B2

公开(公告)日：2006-12-26

申请号：US10974443

申请日：2004-10-27

申请人： Andres Rodriguez ,  Jack A. Orenstein ,  David M. Shaw ,  Benjamin K. D. Bernhard

发明人： Andres Rodriguez ,  Jack A. Orenstein ,  David M. Shaw ,  Benjamin K. D. Bernhard

IPC分类号： G06F17/30

CPC分类号： G06F17/30289 ,  G06F11/1469 ,  G06F17/30073 ,  G06F17/30082 ,  G06F17/30117 ,  G06F17/30188 ,  G06F17/30197 ,  G06F17/30221 ,  Y10S707/99932 ,  Y10S707/99944 ,  Y10S707/99956

摘要： An archive cluster application runs in a distributed manner across a redundant array of independent nodes. Each node preferably runs a complete archive cluster application instance. A given nodes provides a data repository, which stores up to a large amount (e.g., a terabyte) of data, while also acting as a portal that enables access to archive files. Each symmetric node has a set of software processes, e.g., a request manager, a storage manager, a metadata manager, and a policy manager. The request manager manages requests to the node for data (i.e., file data), the storage manager manages data read/write functions from a disk associated with the node, and the metadata manager facilitates metadata transactions and recovery across the distributed database. The policy manager implements one or more policies, which are operations that determine the behavior of an “archive object” within the cluster. The archive cluster application provides object-based storage. Preferably, the application permanently associates metadata and policies with the raw archived data, which together comprise an archive object. Object policies govern the object's behavior in the archive. As a result, the archive manages itself independently of client applications, acting automatically to ensure that all object policies are valid.

摘要翻译： 归档集群应用程序通过独立节点的冗余阵列以分布式方式运行。 每个节点最好运行一个完整的归档集群应用实例。 给定的节点提供了一个数据存储库，它可以存储大量数据（例如，一千兆字节）的数据，同时还充当允许访问存档文件的门户。 每个对称节点具有一组软件过程，例如请求管理器，存储管理器，元数据管理器和策略管理器。 请求管理器管理对节点的数据（即文件数据）的请求，存储管理器从与该节点相关联的盘管理数据读/写功能，并且元数据管理器便于跨分布式数据库的元数据事务和恢复。 策略管理器实现一个或多个策略，这些策略是确定集群中“归档对象”的行为的操作。 归档集群应用程序提供基于对象的存储。 优选地，应用程序将元数据和策略永久地关联到原始归档数据，其一起构成归档对象。 对象策略管理对象在归档中的行为。 因此，归档管理自身独立于客户端应用程序，自动执行以确保所有对象策略都有效。