公开(公告)号：US08578204B1

公开(公告)日：2013-11-05

申请号：US12930121

申请日：2010-12-29

申请人： Eugene Ortenberg ,  Bradford B. Glade ,  Dale Hagglund ,  Benjamin Yoder ,  David Meiri ,  Dan Arnon ,  Dharmesh Thakkar

发明人： Eugene Ortenberg ,  Bradford B. Glade ,  Dale Hagglund ,  Benjamin Yoder ,  David Meiri ,  Dan Arnon ,  Dharmesh Thakkar

IPC分类号： G06F11/07

CPC分类号： G06F11/1425

摘要： A system for managing distributed storage includes a collection of one or more compute sites that are connected and that perform a joint computation. A witness node is connected to the one or more compute sites. A membership service allows a change in collection membership, in response to a failure, to continue the joint computation without causing data inconsistency or corruption. If the membership service is unable to reach a decision on the change in collection membership in response to the failure, the witness node controls the decision on the change in collection membership to continue the joint computation. A distributed storage system provided by the system described herein may advantageously meet consistency guarantees and maximize data access even when individual compute sites and/or their interconnects fail.

摘要翻译： 用于管理分布式存储的系统包括连接并执行联合计算的一个或多个计算站点的集合。 证人节点连接到一个或多个计算站点。 会员服务允许更改收集成员资格以响应失败，继续联合计算，而不会导致数据不一致或损坏。 如果会员服务无法就故障对收款成员资格的变更作出决定，则证人节点控制收款成员资格变更的决定，以继续进行联合计算。 由本文描述的系统提供的分布式存储系统可以有利地满足一致性保证，并且即使当各个计算站点和/或其互连失败时也最大化数据访问。

公开(公告)号：US09348627B1

公开(公告)日：2016-05-24

申请号：US13721502

申请日：2012-12-20

申请人： Ashish A. Palekar ,  Dale Hagglund ,  Bradford B. Glade

发明人： Ashish A. Palekar ,  Dale Hagglund ,  Bradford B. Glade

IPC分类号： G06F9/54 ,  G06F9/455

CPC分类号： G06F9/45558 ,  G06F9/45533 ,  G06F9/46 ,  G06F9/5077 ,  G06F2009/4557 ,  G06F2009/45595

摘要： Dynamic mobility of virtual data centers and converged infrastructure components, such as Vblocks, may be provided using a virtual platform product that federates and/or coordinates virtual storage. The system described herein enables sharing of distributed resources between multi-connected virtual platform clusters, such as VPLEX clusters, in a dynamic sharing arrangement. A virtual platform cluster may include one or more pairs of directors that enables failover from one director of the pair(s) to the other director of the pair(s) in a cluster in the case of hardware or path failure.

摘要翻译： 可以使用联合和/或协调虚拟存储的虚拟平台产品来提供虚拟数据中心和融合基础架构组件（例如Vblock）的动态移动性。 本文描述的系统使得能够在动态共享布置中的多连接虚拟平台集群（例如VPLEX集群）之间共享分布式资源。 在硬件或路径故障的情况下，虚拟平台集群可以包括一对或多对导向器，其能够从集群中的一个导向器到该对中的另一个导向器进行故障切换。

公开(公告)号：US08028191B2

公开(公告)日：2011-09-27

申请号：US12775743

申请日：2010-05-07

申请人： William P. Brown ,  Michael B. Matthews ,  Ron Unrau ,  Dale Hagglund

发明人： William P. Brown ,  Michael B. Matthews ,  Ron Unrau ,  Dale Hagglund

IPC分类号： G06F11/00

CPC分类号： G06F11/2097 ,  G06F3/0613 ,  G06F3/065 ,  G06F3/0659 ,  G06F3/067 ,  G06F9/52 ,  G06F11/2089 ,  G06F11/2092

摘要： Multiple Array Management Functions (AMFs) are connected to multiple redundancy groups over a storage area network (SAN), such as a fiber-channel based SAN. The multiple AMFs share management responsibility of the redundancy groups, each of which typically includes multiple resources spread over multiple disks. The AMFs provide concurrent access to the redundancy groups for associated host systems. When a host requests an AMF to perform an operation on a resource, the AMF synchronizes with the other AMFs sharing control of the redundancy group that includes the resource to be operated on, so as to obtain access to the resource. While performing the operation, the AMF send replication data and state information associated with the resource such that if the AMF fails, any of the other AMFs are able to complete the operation and maintain data reliability and coherency.

摘要翻译： 多阵列管理功能（AMF）通过存储区域网络（SAN）（如基于光纤通道的SAN）连接到多个冗余组。 多个AMF共享冗余组的管理责任，每个冗余组通常包括分布在多个磁盘上的多个资源。 AMF提供对相关主机系统的冗余组的并发访问。 当主机请求AMF对资源执行操作时，AMF与共享对包括要操作的资源的冗余组的控制的其他AMF同步，以获得对资源的访问。 在执行操作时，AMF发送与资源相关联的复制数据和状态信息，使得如果AMF发生故障，则任何其他AMF都能够完成操作并保持数据的可靠性和一致性。

公开(公告)号：US07475207B2

公开(公告)日：2009-01-06

申请号：US11486754

申请日：2006-07-14

申请人： Steve Bromling ,  Dale Hagglund ,  Geoff Hayward ,  Roel Van der Goot ,  Wayne Karpoff

发明人： Steve Bromling ,  Dale Hagglund ,  Geoff Hayward ,  Roel Van der Goot ,  Wayne Karpoff

IPC分类号： G06F12/00

CPC分类号： H04L67/1095 ,  G06F11/2058 ,  G06F11/2064 ,  G06F11/2071 ,  G06F11/2074 ,  G06F11/2079 ,  H04L67/1097 ,  H04L67/2842

摘要： Write order fidelity (WOF) is maintained for totally-active implementations wherein a plurality of access nodes at geographically separated sites can concurrently read and/or write data in a “totally active” fashion on a distributed data system. From the hosts' perspective at diverse geographic locations, a synchronous, cache-coherent view of data is provided. Data transfer is asynchronous. A time ordered data image is created and maintained so operations can be restarted after a partial system failure that causes loss of data not yet asynchronously transferred across the network, but that has been write-acknowledged to the originating host. Time ordered asynchronous data transfer is implemented as a pipeline of changes that reflect contributions from all nodes. WOF also improves network performance and lowers bandwidth consumption. Extensions can provide, in a totally-active context, features such as point-in-time snapshots, time firewalls, on-demand backend storage allocation, synchronous/asynchronous distribution of data, and continuous data protection.

摘要翻译： 维持写入顺序保真度（WOF），用于完全有效的实现，其中在地理上分离的站点处的多个接入节点可以在分布式数据系统上以“完全主动”的方式同时读取和/或写入数据。 从主机的角度来看，在不同的地理位置，提供了同步，缓存一致的数据视图。 数据传输是异步的。 创建和维护时间有序的数据映像，以便在部分系统故障之后重新启动操作，导致数据丢失尚未通过网络异步传输，但已被写入确认给始发主机。 时间排序的异步数据传输实现为反映来自所有节点的贡献的变化流水线。 WOF还提高网络性能，降低带宽消耗。 扩展可以在完全活跃的环境中提供诸如时间点快照，时间防火墙，按需后端存储分配，数据的同步/异步分发和连续数据保护等功能。

公开(公告)号：US07266706B2

公开(公告)日：2007-09-04

申请号：US10006929

申请日：2001-12-06

申请人： William P. Brown ,  Michael B. Mathews ,  Ron Unrau ,  Dale Hagglund

发明人： William P. Brown ,  Michael B. Mathews ,  Ron Unrau ,  Dale Hagglund

IPC分类号： G06F13/00

CPC分类号： G06F11/2097 ,  G06F3/0613 ,  G06F3/065 ,  G06F3/0659 ,  G06F3/067 ,  G06F9/52 ,  G06F11/2089 ,  G06F11/2092

摘要： Multiple Array Management Functions (AMFs) are connected to multiple redundancy groups over a storage area network (SAN), such as a fiber-channel based SAN. The multiple AMFs share management responsibility of the redundancy groups, each of which typically includes multiple resources spread over multiple disks. The AMFs provide concurrent access to the redundancy groups for associated host systems. When a host requests an AMF to perform an operation on a resource, the AMF synchronizes with the other AMFs sharing control of the redundancy group that includes the resource to be operated on, so as to obtain access to the resource. While performing the operation, the AMF send replication data and state information associated with the resource such that if the AMF fails, any of the other AMFs are able to complete the operation and maintain data reliability and coherency.

摘要翻译： 多阵列管理功能（AMF）通过存储区域网络（SAN）（如基于光纤通道的SAN）连接到多个冗余组。 多个AMF共享冗余组的管理责任，每个冗余组通常包括分布在多个磁盘上的多个资源。 AMF提供对相关主机系统的冗余组的并发访问。 当主机请求AMF对资源执行操作时，AMF与共享对包括要操作的资源的冗余组的控制的其他AMF同步，以获得对资源的访问。 在执行操作时，AMF发送与资源相关联的复制数据和状态信息，使得如果AMF发生故障，则任何其他AMF都能够完成操作并保持数据的可靠性和一致性。

公开(公告)号：US20070022264A1

公开(公告)日：2007-01-25

申请号：US11486754

申请日：2006-07-14

申请人： Steve Bromling ,  Dale Hagglund ,  Geoff Hayward ,  Roel Van der Goot ,  Wayne Karpoff

发明人： Steve Bromling ,  Dale Hagglund ,  Geoff Hayward ,  Roel Van der Goot ,  Wayne Karpoff

IPC分类号： G06F12/16 ,  G06F13/00 ,  G06F13/28

CPC分类号： H04L67/1095 ,  G06F11/2058 ,  G06F11/2064 ,  G06F11/2071 ,  G06F11/2074 ,  G06F11/2079 ,  H04L67/1097 ,  H04L67/2842

摘要： Write order fidelity (WOF) is maintained for totally-active implementations wherein a plurality of access nodes at geographically separated sites can concurrently read and/or write data in a “totally active” fashion on a distributed data system. From the hosts' perspective at diverse geographic locations, a synchronous, cache-coherent view of data is provided. Data transfer is asynchronous. A time ordered data image is created and maintained so operations can be restarted after a partial system failure that causes loss of data not yet asynchronously transferred across the network, but that has been write-acknowledged to the originating host. Time ordered asynchronous data transfer is implemented as a pipeline of changes that reflect contributions from all nodes. WOF also improves network performance and lowers bandwidth consumption. Extensions can provide, in a totally-active context, features such as point-in-time snapshots, time firewalls, on-demand backend storage allocation, synchronous/asynchronous distribution of data, and continuous data protection.

摘要翻译： 维持写入顺序保真度（WOF），用于完全有效的实现，其中在地理上分离的站点处的多个接入节点可以在分布式数据系统上以“完全主动”的方式同时读取和/或写入数据。 从主机的角度来看，在不同的地理位置，提供了同步，缓存一致的数据视图。 数据传输是异步的。 创建和维护时间排序的数据映像，以便在部分系统故障之后重新启动操作，导致数据丢失尚未通过网络异步传输，但已被写入确认给始发主机。 时间排序的异步数据传输实现为反映来自所有节点的贡献的变化流水线。 WOF还提高网络性能，降低带宽消耗。 扩展可以在完全活跃的环境中提供诸如时间点快照，时间防火墙，按需后端存储分配，数据的同步/异步分发和连续数据保护等功能。

公开(公告)号：US07721144B2

公开(公告)日：2010-05-18

申请号：US11747871

申请日：2007-05-11

申请人： William P. Brown ,  Michael B. Mathews ,  Ron Unrau ,  Dale Hagglund

发明人： William P. Brown ,  Michael B. Mathews ,  Ron Unrau ,  Dale Hagglund

IPC分类号： G06F11/00

CPC分类号： G06F11/2097 ,  G06F3/0613 ,  G06F3/065 ,  G06F3/0659 ,  G06F3/067 ,  G06F9/52 ,  G06F11/2089 ,  G06F11/2092

摘要： Multiple Array Management Functions (AMFs) are connected to multiple redundancy groups over a storage area network (SAN), such as a fiber-channel based SAN. The multiple AMFs share management responsibility of the redundancy groups, each of which typically includes multiple resources spread over multiple disks. The AMFs provide concurrent access to the redundancy groups for associated host systems. When a host requests an AMF to perform an operation on a resource, the AMF synchronizes with the other AMFs sharing control of the redundancy group that includes the resource to be operated on, so as to obtain access to the resource. While performing the operation, the AMF send replication data and state information associated with the resource such that if the AMF fails, any of the other AMFs are able to complete the operation and maintain data reliability and coherency.

摘要翻译： 多阵列管理功能（AMF）通过存储区域网络（SAN）（如基于光纤通道的SAN）连接到多个冗余组。 多个AMF共享冗余组的管理责任，每个冗余组通常包括分布在多个磁盘上的多个资源。 AMF提供对相关主机系统的冗余组的并发访问。 当主机请求AMF对资源执行操作时，AMF与共享对包括要操作的资源的冗余组的控制的其他AMF同步，以获得对资源的访问。 在执行操作时，AMF发送与资源相关联的复制数据和状态信息，使得如果AMF发生故障，则任何其他AMF都能够完成操作并保持数据的可靠性和一致性。

公开(公告)号：US08156195B2

公开(公告)日：2012-04-10

申请号：US11674996

申请日：2007-02-14

申请人： Dale Hagglund ,  Ron Unrau ,  Geoff Hayward ,  Craig Graulich ,  Wayne Karpoff

发明人： Dale Hagglund ,  Ron Unrau ,  Geoff Hayward ,  Craig Graulich ,  Wayne Karpoff

IPC分类号： G06F15/16 ,  G06F15/167

CPC分类号： G06F11/2058 ,  G06F11/201 ,  G06F11/2064 ,  G06F11/2074 ,  G06F11/2079 ,  G06F2201/82 ,  H04L67/1095 ,  H04L67/1097 ,  H04L67/2842 ,  H04L69/40

摘要： Network data storage systems and methods allow computers reading and writing data at a plurality of data centers separated by, potentially, large distances to replicate data between sites such that the data is protected from failures, including complete Site failures, while not allowing network latency to significantly impede the performance of read or write operations. Continued access to all data is provided even after a single failure of any component of the system or after any complete failure of all equipment located at any single geographic region or any failure that isolates access to any single geographic region. Write data is replicated synchronously from Active Sites, e.g., sites where servers are writing data to storage resources, to Protection Sites located sufficiently close to Active Sites such that network latency will not significantly impact performance, but sufficiently far apart such that a regional disaster is unlikely to affect both sites. Write data is then asynchronously copied to other sites, potentially including one or more Active sites, located at greater distances.

摘要翻译： 网络数据存储系统和方法允许计算机在多个数据中心读取和写入数据，这些数据中心可能距离很远，以便在站点之间复制数据，从而保护数据免受故障，包括完整的站点故障，同时不允许网络延迟 显着阻碍了读写操作的执行。 即使在系统的任何组件发生单一故障之后或者位于任何单个地理区域的所有设备发生任何完全故障或者任何将访问隔离在任何单一地理区域的故障之后，仍可继续访问所有数据。 写入数据从Active Sites（例如，服务器正在将数据写入存储资源的站点）同步复制到位于与Active Sites紧密相连的保护站点，以便网络延迟不会对性能造成重大影响，但区域灾难相当遥远 不太可能影响两个网站。 然后将写入数据异步复制到其他站点，可能包括位于更远距离的一个或多个活动站点。

公开(公告)号：US20100218039A1

公开(公告)日：2010-08-26

申请号：US12775743

申请日：2010-05-07

申请人： William P. Brown ,  Michael B. Matthews ,  Ron Unrau ,  Dale Hagglund

发明人： William P. Brown ,  Michael B. Matthews ,  Ron Unrau ,  Dale Hagglund

IPC分类号： G06F11/20 ,  G06F12/08

CPC分类号： G06F11/2097 ,  G06F3/0613 ,  G06F3/065 ,  G06F3/0659 ,  G06F3/067 ,  G06F9/52 ,  G06F11/2089 ,  G06F11/2092

摘要： Multiple Array Management Functions (AMFs) are connected to multiple redundancy groups over a storage area network (SAN), such as a fiber-channel based SAN. The multiple AMFs share management responsibility of the redundancy groups, each of which typically includes multiple resources spread over multiple disks. The AMFs provide concurrent access to the redundancy groups for associated host systems. When a host requests an AMF to perform an operation on a resource, the AMF synchronizes with the other AMFs sharing control of the redundancy group that includes the resource to be operated on, so as to obtain access to the resource. While performing the operation, the AMF send replication data and state information associated with the resource such that if the AMF fails, any of the other AMFs are able to complete the operation and maintain data reliability and coherency.

摘要翻译： 多阵列管理功能（AMF）通过存储区域网络（SAN）（如基于光纤通道的SAN）连接到多个冗余组。 多个AMF共享冗余组的管理责任，每个冗余组通常包括分布在多个磁盘上的多个资源。 AMF提供对相关主机系统的冗余组的并发访问。 当主机请求AMF对资源执行操作时，AMF与共享对包括要操作的资源的冗余组的控制的其他AMF同步，以获得对资源的访问。 在执行操作时，AMF发送与资源相关联的复制数据和状态信息，使得如果AMF发生故障，则任何其他AMF都能够完成操作并保持数据的可靠性和一致性。

公开(公告)号：US20070214383A1

公开(公告)日：2007-09-13

申请号：US11747871

申请日：2007-05-11

申请人： William Brown ,  Michael Mathews ,  Ron Unrau ,  Dale Hagglund

发明人： William Brown ,  Michael Mathews ,  Ron Unrau ,  Dale Hagglund

IPC分类号： G06F11/00

CPC分类号： G06F11/2097 ,  G06F3/0613 ,  G06F3/065 ,  G06F3/0659 ,  G06F3/067 ,  G06F9/52 ,  G06F11/2089 ,  G06F11/2092

摘要： Multiple Array Management Functions (AMFs) are connected to multiple redundancy groups over a storage area network (SAN), such as a fiber-channel based SAN. The multiple AMFs share management responsibility of the redundancy groups, each of which typically includes multiple resources spread over multiple disks. The AMFs provide concurrent access to the redundancy groups for associated host systems. When a host requests an AMF to perform an operation on a resource, the AMF synchronizes with the other AMFs sharing control of the redundancy group that includes the resource to be operated on, so as to obtain access to the resource. While performing the operation, the AMF send replication data and state information associated with the resource such that if the AMF fails, any of the other AMFs are able to complete the operation and maintain data reliability and coherency.

摘要翻译： 多阵列管理功能（AMF）通过存储区域网络（SAN）（如基于光纤通道的SAN）连接到多个冗余组。 多个AMF共享冗余组的管理责任，每个冗余组通常包括分布在多个磁盘上的多个资源。 AMF提供对相关主机系统的冗余组的并发访问。 当主机请求AMF对资源执行操作时，AMF与共享对包括要操作的资源的冗余组的控制的其他AMF同步，以获得对资源的访问。 在执行操作时，AMF发送与资源相关联的复制数据和状态信息，使得如果AMF发生故障，则任何其他AMF都能够完成操作并保持数据的可靠性和一致性。