Extent metadata update logging and checkpointing
    31.
    发明授权
    Extent metadata update logging and checkpointing 有权
    扩展元数据更新记录和检查点

    公开(公告)号:US09268653B2

    公开(公告)日:2016-02-23

    申请号:US14158689

    申请日:2014-01-17

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, a cluster uses an extent store layer and a set of hash tables having a plurality of slots embodying extent metadata that describe write data of one or more write requests organized into one or more extents. One or more non-volatile logs (NVLogs) are maintained in the cluster. The one or more NVLogs include an extent store layer log maintained by the extent store layer. The extent store layer log records changes to the set of hash tables as a plurality of log stream structures, where each log stream structure is associated with a hash table. One or more storage devices of the cluster are organized as a plurality of log streams, where each log stream is associated with a corresponding log stream structure of the extent store layer log.

    Abstract translation: 在一个实施例中,集群使用扩展存储层和具有多个时隙的散列表集合,该多个时隙体现了描述组织成一个或多个扩展区的一个或多个写入请求的写入数据的扩展元数据。 集群中维护一个或多个非易失性日志(NVLogs)。 一个或多个NVLogs包括由扩展存储层维护的扩展存储层日志。 扩展存储层日志将更改作为多个日志流结构记录到哈希表集合,其中每个日志流结构与散列表相关联。 集群的一个或多个存储设备被组织为多个日志流,其中每个日志流与扩展存储层日志的对应日志流结构相关联。

    FILE SYSTEM DRIVEN RAID REBUILD TECHNIQUE
    32.
    发明申请
    FILE SYSTEM DRIVEN RAID REBUILD TECHNIQUE 有权
    文件系统驱动RAID重建技术

    公开(公告)号:US20150205669A1

    公开(公告)日:2015-07-23

    申请号:US14161184

    申请日:2014-01-22

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, a file system driven RAID rebuild technique is provided. A layered file system may organize storage of data as segments spanning one or more sets of storage devices, such as solid state drives (SSDs), of a storage array, wherein each set of SSDs may form a RAID group configured to provide data redundancy for a segment. The file system may then drive (i.e., initiate) rebuild of a RAID configuration of the SSDs on a segment-by-segment basis in response to cleaning of the segment (i.e., segment cleaning). Each segment may include one or more RAID stripes that provide a level of data redundancy (e.g., single parity RAID 5 or double parity RAID 6) as well as RAID organization (i.e., distribution of data and parity) for the segment. Notably, the level of data redundancy and RAID organization may differ among the segments of the array.

    Abstract translation: 在一个实施例中,提供了文件系统驱动的RAID重建技术。 分层文件系统可以将数据的存储组织为跨越存储阵列的一组或多组存储设备(例如固态驱动器(SSD))的段,其中每组SSD可以形成RAID组,其被配置为提供数据冗余 一段 然后文件系统可以响应于段的清除(即,段清除)逐个段地驱动(即,启动)重建SSD的RAID配置。 每个段可以包括一个或多个提供数据冗余级别(例如,单个奇偶校验RAID 5或双奇偶校验RAID 6)的RAID条带以及用于该段的RAID组织(即,数据和奇偶校验的分配)。 值得注意的是,数据冗余和RAID组织的级别可能在阵列的各个部分之间不同。

    FILE SYSTEM DRIVEN RAID REBUILD TECHNIQUE
    33.
    发明申请
    FILE SYSTEM DRIVEN RAID REBUILD TECHNIQUE 有权
    文件系统驱动RAID重建技术

    公开(公告)号:US20150205668A1

    公开(公告)日:2015-07-23

    申请号:US14158448

    申请日:2014-01-17

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, one or more storage arrays of solid state drives (SSDs) that include a plurality of segments are organized as one or more redundant array of independent disks (RAID) groups, where the RAID groups provides data redundancy for the segments. A node executing a layered file system of a storage input/output (I/O) stack performs segment cleaning to clean the segments. It further initiates rebuild of a RAID configuration of the SSDs on a segment-by-segment basis in response to the segment cleaning. In such a configuration, each segment includes one or more RAID stripes that provide a level of data redundancy as well as RAID organization for the segment.

    Abstract translation: 在一个实施例中,包括多个段的固态驱动器(SSD)的一个或多个存储阵列被组织为独立磁盘(RAID)组的一个或多个冗余阵列,其中RAID组为段提供数据冗余。 执行存储输入/输出(I / O)堆栈的分层文件系统的节点执行段清理来清理段。 它还响应于段清理,逐段启动重新构建SSD的RAID配置。 在这样的配置中,每个段包括一个或多个RAID条带,其提供数据冗余级别以及该段的RAID组织。

    Extent hashing technique for distributed storage architecture
    34.
    发明授权
    Extent hashing technique for distributed storage architecture 有权
    分散式存储架构的扩展散列技术

    公开(公告)号:US08996535B1

    公开(公告)日:2015-03-31

    申请号:US14160048

    申请日:2014-01-21

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, an extent hashing technique is used to efficiently distribute data and associated metadata substantially evenly among nodes of a cluster. The data may be write data associated with a write request issued by a host and received at a node of the cluster. The write data may be organized into one or more extents. A hash function may be applied to the extent to generate a result which may be truncated or trimmed to generate a hash value. A hash space of the hash value may be divided into a plurality of buckets representative of the write data, i.e., the extents, and the associated metadata, i.e., extent metadata. A number of buckets may be assigned to each extent store instance of the nodes to distribute ownership of the buckets, along with their extents and extent metadata, across all of the extent store instances of the nodes.

    Abstract translation: 在一个实施例中,使用扩展散列技术来有效地在簇的节点之间均匀地分布数据和相关联的元数据。 数据可以是与由主机发出并在集群的节点处接收的写入请求相关联的写入数据。 写入数据可以被组织成一个或多个范围。 可以将哈希函数应用于生成可能被截断或修剪以生成哈希值的结果的程度。 哈希值的散列空间可以被划分为代表写入数据的多个存储桶,即扩展区以及相关联的元数据,即扩展元数据。 可以将多个桶分配给节点的每个盘区存储实例,以在节点的所有范围存储实例之间分配桶的所有权以及它们的盘区和盘区元数据。

    NVRAM caching and logging in a storage system
    35.
    发明授权
    NVRAM caching and logging in a storage system 有权
    NVRAM缓存并记录在存储系统中

    公开(公告)号:US08898388B1

    公开(公告)日:2014-11-25

    申请号:US14162174

    申请日:2014-01-23

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, non-volatile random access memory (NVRAM) caching and logging delivers low latency acknowledgements of input/output (I/O) requests, such as write requests, while avoiding loss of data. Write data may be stored in a portion of an NVRAM configured as, e.g., a persistent write-back cache, while parameters of the request may be stored in another portion of the NVRAM configured as one or more logs, e.g., NVLogs. The write data may be organized into separate variable length blocks or extents and “written back” out-of-order from the write back cache to storage devices, such as solid state drives (SSDs). The write data may be preserved in the write-back cache until each extent is safely and successfully stored on SSD (i.e., in the event of power loss), or operations associated with the write request are sufficiently logged on NVLog.

    Abstract translation: 在一个实施例中,非易失性随机存取存储器(NVRAM)高速缓存和记录在避免数据丢失的同时提供诸如写请求之类的输入/输出(I / O)请求的低延迟确认。 写入数据可以存储在被配置为例如持久性写回高速缓存的NVRAM的一部分中,而该请求的参数可以存储在被配置为一个或多个日志(例如NVLog)的NVRAM的另一部分中。 写数据可以被组织成单独的可变长度块或扩展区,并且从写回高速缓存“无回写”到诸如固态驱动器(SSD)的存储设备。 写入数据可以保留在回写高速缓存中,直到每个区段安全地并成功地存储在SSD上(即,在断电的情况下),或者与写入请求相关联的操作在NVLog上被充分记录。

    Consistency group management
    36.
    发明授权

    公开(公告)号:US09952767B2

    公开(公告)日:2018-04-24

    申请号:US15142767

    申请日:2016-04-29

    Applicant: NetApp, Inc.

    Abstract: A consistency group is used as a basic unit of data management of storage containers served by a storage input/output (I/O) stack executing on one or more nodes of a cluster. The storage container may be a LUN embodied as parent volume (active volume), a snapshot (represented as an independent volume embodied as read-only copy of the active volume), and a clone (represented as another independent volume embodied as a read-write copy (clone) of the active volume). A consistency group (CG) is a set (i.e., collection) of objects, e.g., LUNs or other CGs (nested CG), which may be managed and operated upon collectively by an administrative command via a Storage Area Network administration layer (SAL) of the storage I/O stack. The SAL may interact with one or more layers of the storage I/O stack to (i) create a clone of a set of object members of the CG; (ii) create one or more snapshots of the set of object members of the CG; (iii) restore the set of object members of the CG from a group of CG snapshots; (iv) replicate the set of object members of the CG as a single entity; and (v) delete a CG and a nested CG according to specific semantics.

    Granular sync/semi-sync architecture

    公开(公告)号:US09848043B2

    公开(公告)日:2017-12-19

    申请号:US15431063

    申请日:2017-02-13

    Applicant: NetApp Inc.

    Abstract: Data consistency and availability can be provided at the granularity of logical storage objects in storage solutions that use storage virtualization in clustered storage environments. To ensure consistency of data across different storage elements, synchronization is performed across the different storage elements. Changes to data are synchronized across storage elements in different clusters by propagating the changes from a primary logical storage object to a secondary logical storage object. To satisfy the strictest RPOs while maintaining performance, change requests are intercepted prior to being sent to a filesystem that hosts the primary logical storage object and propagated to a different managing storage element associated with the secondary logical storage object.

    Snapshot creation workflow
    38.
    发明授权

    公开(公告)号:US09740566B2

    公开(公告)日:2017-08-22

    申请号:US14869340

    申请日:2015-09-29

    Applicant: NetApp, Inc.

    Abstract: A technique efficiently creates a snapshot for a logical unit (LUN) served by a storage input/output (I/O) stack executing on a node of a cluster that organizes data as extents referenced by keys. In addition, the technique efficiently creates one or more snapshots for a group of LUNs organized as a consistency group (CG) and served by storage I/O stacks executing on a plurality of nodes of the cluster. To that end, the technique involves a plurality of indivisible operations (i.e., transactions) of a snapshot creation workflow administered by a Storage Area Network (SAN) administration layer (SAL) of the storage I/O stack in response to a snapshot create request issued by a host. The SAL administers the snapshot creation workflow by initiating a set of transactions that includes, inter alia, (i) installation of barriers for LUNs (volumes) across all nodes in the cluster that participate in snapshot creation, (ii) creation of point-in-time (PIT) markers to record those I/O requests that are included in the snapshot, and (iii) updating of records (entries) in snapshot and volume tables of a cluster database (CDB).

    GRANULAR SYNC/SEMI-SYNC ARCHITECTURE
    39.
    发明申请

    公开(公告)号:US20170155716A1

    公开(公告)日:2017-06-01

    申请号:US15431063

    申请日:2017-02-13

    Applicant: NetApp Inc.

    Abstract: Data consistency and availability can be provided at the granularity of logical storage objects in storage solutions that use storage virtualization in clustered storage environments. To ensure consistency of data across different storage elements, synchronization is performed across the different storage elements. Changes to data are synchronized across storage elements in different clusters by propagating the changes from a primary logical storage object to a secondary logical storage object. To satisfy the strictest RPOs while maintaining performance, change requests are intercepted prior to being sent to a filesystem that hosts the primary logical storage object and propagated to a different managing storage element associated with the secondary logical storage object.

    SNAPSHOT CREATION WORKFLOW
    40.
    发明申请
    SNAPSHOT CREATION WORKFLOW 有权
    SNAPSHOT创作工作流程

    公开(公告)号:US20170031769A1

    公开(公告)日:2017-02-02

    申请号:US14869340

    申请日:2015-09-29

    Applicant: NetApp, Inc.

    Abstract: A technique efficiently creates a snapshot for a logical unit (LUN) served by a storage input/output (I/O) stack executing on a node of a cluster that organizes data as extents referenced by keys. In addition, the technique efficiently creates one or more snapshots for a group of LUNs organized as a consistency group (CG) and served by storage I/O stacks executing on a plurality of nodes of the cluster. To that end, the technique involves a plurality of indivisible operations (i.e., transactions) of a snapshot creation workflow administered by a Storage Area Network (SAN) administration layer (SAL) of the storage I/O stack in response to a snapshot create request issued by a host. The SAL administers the snapshot creation workflow by initiating a set of transactions that includes, inter alia, (i) installation of barriers for LUNs (volumes) across all nodes in the cluster that participate in snapshot creation, (ii) creation of point-in-time (PIT) markers to record those I/O requests that are included in the snapshot, and (iii) updating of records (entries) in snapshot and volume tables of a cluster database (CDB).

    Abstract translation: 一种技术可以有效地创建一个逻辑单元(LUN)的快照,该逻辑单元(LUN)由集群的节点上执行的存储输入/输出(I / O)堆栈提供服务,该集群将数据组织为密钥引用的扩展区。 此外,该技术有效地为被组织为一致性组(CG)并由在集群的多个节点上执行的存储I / O堆栈服务的一组LUN有效地创建一个或多个快照。 为此,该技术涉及响应于快照创建请求,由存储I / O堆栈的存储区域网络(SAN)管理层(SAL)管理的快照创建工作流的多个不可分割的操作(即事务) 由主机发出。 SAL通过启动一组事务来管理快照创建工作流,其中包括(i)在参与快照创建的集群中的所有节点上安装LUN(卷)的障碍,(ii)创建点对点 -time(PIT)标记来记录快照中包含的那些I / O请求,以及(iii)更新群集数据库(CDB)的快照和卷表中的记录(条目)。

Patent Agency Ranking