Global in-line extent-based deduplication
    21.
    发明授权
    Global in-line extent-based deduplication 有权
    全球在线范围重复数据删除

    公开(公告)号:US09529546B2

    公开(公告)日:2016-12-27

    申请号:US14150689

    申请日:2014-01-08

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, a layered file system includes a volume layer and an extent store layer configured to provide sequential log-structured layout of data and metadata on solid state drives (SSDs) of one or more storage arrays. The data is organized as variable-length extents of one or more logical units (LUNs). The metadata includes volume metadata mappings from offset ranges of a LUN to extent keys and extent metadata mappings of the extent keys to storage locations of the extents on the SSDs. The extent store layer maintaining the extent metadata mappings determines whether an extent is stored on a storage array, and, in response to determination that the extent is stored on the storage array, returns an extent key for the stored extent to the volume layer to enable global inline de-duplication that obviates writing a duplicate copy of the extent on the storage array.

    Abstract translation: 在一个实施例中,分层文件系统包括卷层和盘区存储层,其被配置为在一个或多个存储阵列的固态驱动器(SSD)上提供数据和元数据的顺序日志结构布局。 数据被组织为一个或多个逻辑单元(LUN)的可变长度范围。 元数据包括从LUN的偏移范围到扩展密钥的卷元数据映射以及扩展密钥到SSD上的扩展区的存储位置的扩展元数据映射。 维护盘区元数据映射的盘区存储层确定盘区是否存储在存储阵列上,并且响应于确定盘区存储在存储阵列上,将存储的盘区的盘区密钥返回到卷层以启用 全局内联重复数据删除,从而避免在存储阵列上写入扩展区的重复副本。

    LOGICAL REPLICATION MAPPING FOR ASYMMETRIC COMPRESSION
    23.
    发明申请
    LOGICAL REPLICATION MAPPING FOR ASYMMETRIC COMPRESSION 审中-公开
    用于不对称压缩的逻辑复制映射

    公开(公告)号:US20160070495A1

    公开(公告)日:2016-03-10

    申请号:US14929018

    申请日:2015-10-30

    Applicant: NetApp, Inc.

    Abstract: A system and method for logically organizing compressed data. In one aspect, a destination storage server receives a write request that includes multiple data blocks and specifies corresponding file block numbers. An extent-based file system executing on the storage server accesses intermediate block entries that each associates one of the file block numbers with a respective extent block number. The file system, in cooperation with a compression engine, compresses the data blocks into a set of one or more compressed data blocks. The file system stores the compressed data blocks at physical locations corresponding to physical block numbers and allocates, within an extent map, pointers from an extent ID to the extent block numbers, and pointers from the extent ID to the physical block numbers.

    Abstract translation: 一种用于逻辑组织压缩数据的系统和方法。 一方面,目的地存储服务器接收包含多个数据块的写请求,并指定相应的文件块号。 在存储服务器上执行的基于范围的文件系统访问中间块条目,每个条目将文件块号码之一与相应的扩展块号码相关联。 与压缩引擎协作的文件系统将数据块压缩成一组一个或多个压缩数据块。 文件系统将压缩数据块存储在对应于物理块号码的物理位置处,并且在盘区图中分配从盘区ID到块号码的指针,以及从盘区ID到物理块号的指针。

    Dense tree volume metadata organization
    24.
    发明授权
    Dense tree volume metadata organization 有权
    密集树卷元数据组织

    公开(公告)号:US09268502B2

    公开(公告)日:2016-02-23

    申请号:US14027994

    申请日:2013-09-16

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, a node coupled to one or more storage devices executes a storage input/output (I/O) stack having a volume layer. The volume layer manages volume metadata embodied as mappings from offsets of a logical unit (LUN) to extent keys associated with storage locations for extents on the one or more storage devices. Volume metadata is maintained as a dense tree metadata structure representing successive points in time. The dense tree metadata structure has multiple levels, wherein a top level of the dense tree metadata structure represents newer volume metadata changes and descending levels of the dense tree metadata structure represent older volume metadata changes. The node accesses a latest version of changes to the volume metadata by searching from the top level to the descending levels in the dense tree metadata structure.

    Abstract translation: 在一个实施例中,耦合到一个或多个存储设备的节点执行具有体积层的存储输入/输出(I / O)堆栈。 卷层管理体现为从逻辑单元(LUN)的偏移到与一个或多个存储设备上的范围的存储位置相关联的扩展密钥的映射的卷元数据。 卷元数据被保持为表示连续时间点的密集树元数据结构。 密集树元数据结构具有多个层次,其中密集树元数据结构的顶层表示较新的卷元数据更改,密集树元数据结构的下降层表示较旧的卷元数据更改。 节点通过从密级树元数据结构中的顶层到下行级别进行搜索来访问对卷元数据的最新版本的更改。

    Deduplicating data blocks in a storage system
    25.
    发明授权
    Deduplicating data blocks in a storage system 有权
    在存储系统中重复数据删除数据块

    公开(公告)号:US09256378B2

    公开(公告)日:2016-02-09

    申请号:US13901385

    申请日:2013-05-23

    Applicant: NetApp, Inc.

    CPC classification number: G06F3/0641 G06F3/0608 G06F3/0683

    Abstract: A method for sharing data blocks in a hierarchical file system in a storage server includes allocating a plurality of data blocks in the file system, and sharing data blocks in the file system, without using a persistent point-in-time image, to avoid duplication of data blocks. A method for identifying data blocks that can be shared includes computing a fingerprint for each of multiple data blocks to be written to a storage facility and storing the fingerprint with information identifying the data block in an entry in a set of metadata. The set of metadata is used to identify data blocks which are duplicates.

    Abstract translation: 一种用于在存储服务器中的分层文件系统中共享数据块的方法包括在文件系统中分配多个数据块,并且在不使用持久时间点图像的情况下共享文件系统中的数据块,以避免重复 的数据块。 一种用于识别可共享的数据块的方法包括:计算要写入存储设施的多个数据块中的每一个的指纹,以及将标识数据块的信息存储在一组元数据中的条目中。 元数据集用于识别重复的数据块。

    Dense tree volume metadata update logging and checkpointing
    26.
    发明授权
    Dense tree volume metadata update logging and checkpointing 有权
    密集树卷元数据更新记录和检查点

    公开(公告)号:US09201918B2

    公开(公告)日:2015-12-01

    申请号:US14084137

    申请日:2013-11-19

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, a node of a cluster executing a storage input/output (I/O) stack having a volume layer, stores a multi-level dense tree metadata structure. Each level of the dense tree metadata structure includes volume metadata entries for storing volume metadata. One or more non-volatile logs (NVLogs) are updated. The one or more NVLogs including a volume layer log configured to record changes to the volume metadata, wherein volume metadata entries inserted into a top-level of the dense tree metadata structure are recorded in the volume layer log. The node writes volume metadata entries from the volume layer log to one or more storage devices to be stored as extents.

    Abstract translation: 在一个实施例中,执行具有卷层的存储输入/输出(I / O)堆栈的集群的节点存储多级密集树元数据结构。 密集树元数据结构的每一级包括用于存储卷元数据的卷元数据条目。 一个或多个非易失性日志(NVLogs)被更新。 一个或多个NVLog,包括配置为记录卷元数据的更改的卷层日志,其中插入到密集树元数据结构的顶层的卷元数据条目被记录在卷层日志中。 节点将卷元数据条目从卷层日志写入一个或多个存储设备以作为扩展区存储。

    Technique for preserving efficiency for replication between clusters of a network

    公开(公告)号:US10565230B2

    公开(公告)日:2020-02-18

    申请号:US14876460

    申请日:2015-10-06

    Applicant: NetApp, Inc.

    Abstract: A technique preserves efficiency for replication of data between a source node of a source cluster (“source”) and a destination node of a destination cluster (“destination”) of a clustered network. Replication in the clustered network may be effected by leveraging global in-line deduplication at the source to identify and avoid copying duplicate data from the source to the destination. To ensure that the copy of the data on the destination is synchronized with the data received at the source, the source creates a snapshot of the data for use as a baseline copy at the destination. Thereafter, new data received at the source that differs from the baseline snapshot are transmitted and copied to the destination. In addition, the source and destination nodes negotiate to establish a mapping of name-to-data when transferring data (i.e., an extent) between the clusters. Illustratively, the name is an extent key for the extent, such that the negotiated mapping established by the source and destination is based on the extent key associated with the extent.

    Dense tree volume metadata organization
    29.
    发明授权
    Dense tree volume metadata organization 有权
    密集树卷元数据组织

    公开(公告)号:US09563654B2

    公开(公告)日:2017-02-07

    申请号:US14978290

    申请日:2015-12-22

    Applicant: NetApp, Inc.

    Abstract: The embodiments described herein are directed to an organization of metadata managed by a volume layer of a storage input/output (I/O) stack executing on one or more nodes of a cluster. The metadata managed by the volume layer, i.e., the volume metadata, is illustratively embodied as mappings from addresses, i.e., logical block addresses (LBAs), of a logical unit (LUN) accessible by a host to durable extent keys maintained by an extent store layer of the storage I/O stack. In an embodiment, the volume layer organizes the volume metadata as a mapping data structure, i.e., a dense tree metadata structure, which represents successive points in time to enable efficient access to the metadata.

    Abstract translation: 这里描述的实施例涉及由在集群的一个或多个节点上执行的存储输入/输出(I / O)栈的卷层管理的元数据的组织。 由卷层管理的元数据(即卷元数据)被示意性地体现为从主机可访问的逻辑单元(LUN)的地址(即,逻辑块地址(LBA))到可由扩展区维护的持久范围密钥的映射 存储I / O堆栈的存储层。 在一个实施例中,卷层将卷元数据组织为映射数据结构,即密集树元数据结构,其表示连续的时间点以实现对元数据的有效访问。

    Extent hashing technique for distributed storage architecture
    30.
    发明授权
    Extent hashing technique for distributed storage architecture 有权
    分散式存储架构的扩展散列技术

    公开(公告)号:US09405783B2

    公开(公告)日:2016-08-02

    申请号:US14044624

    申请日:2013-10-02

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, a technique is provided for distributing data and associated metadata within a distributed storage architecture. A set of hash tables that embody mappings of cluster-wide identifiers associated with storage locations are stored for write data of write requests organized into extents. A hash value is generated from a hash function applied to each extent. The hash value is overloaded and used for multiple purposes within the distributed storage architecture, including (i) a remainder computation on the hash value to select a bucket of a plurality of buckets representative of the extents, (ii) a hash table selector of the hash value to select a hash table from the set of hash tables, and (iii) a hash table index computed from the hash value to select an entry from a plurality of entries of the selected hash table having a cluster-wide identifier identifying a storage location for the extent.

    Abstract translation: 在一个实施例中,提供了用于在分布式存储架构内分发数据和相关元数据的技术。 存储与存储位置相关联的集群范围标识符的映射的一组哈希表,用于组织到扩展区中的写入请求的写入数据。 从应用于每个区段的散列函数生成哈希值。 散列值被重载并用于分布式存储体系结构中的多个目的,包括(i)散列值的余数计算,以选择代表范围的多个存储桶的桶,(ii)哈希表选择器 散列值以从所述散列表集合中选择散列表,以及(iii)根据所述散列值计算的散列表索引,以从所选择的哈希表的多个条目中选择具有标识存储器的集群范围标识符的标识符 位置的程度。

Patent Agency Ranking