OBJECT FORMAT RESILIENT TO REMOTE OBJECT STORE ERRORS

    公开(公告)号:US20210089387A1

    公开(公告)日:2021-03-25

    申请号:US17100905

    申请日:2020-11-22

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

    MULTI-TIER WRITE ALLOCATION
    52.
    发明申请

    公开(公告)号:US20180314449A1

    公开(公告)日:2018-11-01

    申请号:US15581369

    申请日:2017-04-28

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

    Methods for improved data store migrations and devices thereof

    公开(公告)号:US10031682B1

    公开(公告)日:2018-07-24

    申请号:US15581742

    申请日:2017-04-28

    Applicant: NetApp, Inc.

    Abstract: A method, non-transitory computer readable medium, and computing device that receives metadata for a block associated with an object from a source storage node. The metadata comprises a source object identifier and the object is associated with a source volume of a source aggregate owned by the source storage node. A determination is made when another block associated with the object has been previously received. A destination object identifier is obtained based on the source object identifier, when the determining indicates that the other block associated with the object has been previously received. A new aggregate block number is assigned to the block based on the destination object identifier and another portion of the metadata. Ownership of the source volume is transferred upon receipt of an indication of a cutover from the source storage node in order to migrate the source volume to a destination volume of a destination aggregate.

    SYSTEMS, METHODS AND DEVICES FOR COMPRESSING SNAPSHOT DATA AND FOR BLOCK SHARING ACROSS VOLUMES
    54.
    发明申请
    SYSTEMS, METHODS AND DEVICES FOR COMPRESSING SNAPSHOT DATA AND FOR BLOCK SHARING ACROSS VOLUMES 有权
    用于压缩快照数据并用于块体分组的系统,方法和设备

    公开(公告)号:US20170068472A1

    公开(公告)日:2017-03-09

    申请号:US14848482

    申请日:2015-09-09

    Applicant: NetApp, Inc.

    Abstract: Presented herein are mass data storage systems, file system protocols, non-transitory machine readable devices, and methods for storing data blocks in data file systems. Methods for compressing snapshot data in a data file system are disclosed which include: loading a snapshot file with one or more data blocks, the snapshot representing a state of the data file system at a point in time; determining if at least one of the snapshot data blocks is less than a predetermined byte value; responsive to a snapshot data block having a size that is less than the predetermined byte value, identifying a packed block configured to store data chunks from plural distinct snapshots and having available sufficient storage space to store the snapshot data block; and adding to the packed block the snapshot data block and lost-write context information corresponding to the snapshot data block.

    Abstract translation: 这里提出的是大量数据存储系统,文件系统协议,非暂时性机器可读设备以及用于在数据文件系统中存储数据块的方法。 公开了一种用于压缩数据文件系统中的快照数据的方法,其包括:使用一个或多个数据块加载快照文件,该快照表示数据文件系统在某个时间点的状态; 确定所述快照数据块中的至少一个是否小于预定字节值; 响应于具有小于所述预定字节值的大小的快照数据块,识别被配置为存储来自多个不同快照的数据块的打包块,并且具有可用的足够的存储空间来存储所述快照数据块; 并向打包块添加对应于快照数据块的快照数据块和丢失写入上下文信息。

    Deduplication in an extent-based architecture
    55.
    发明授权
    Deduplication in an extent-based architecture 有权
    基于范围的架构中的重复数据删除

    公开(公告)号:US09043287B2

    公开(公告)日:2015-05-26

    申请号:US14087345

    申请日:2013-11-22

    Applicant: NetApp, Inc.

    CPC classification number: G06F17/30156 G06F3/0608 G06F3/0641

    Abstract: It is determined that a first data block contains the same data as a second data block. The first data block is associated with a first extent and the second data block is associated with a second extent. In response to determining that the first data block contains the same data as the second data block, the second data block is associated with the first extent and the first data block is disassociated with the second extent.

    Abstract translation: 确定第一数据块包含与第二数据块相同的数据。 第一数据块与第一范围相关联,并且第二数据块与第二范围相关联。 响应于确定第一数据块包含与第二数据块相同的数据,第二数据块与第一扩展区相关联,并且第一数据块与第二扩展区分离。

    Freeing pages within persistent memory

    公开(公告)号:US12242428B2

    公开(公告)日:2025-03-04

    申请号:US18514529

    申请日:2023-11-20

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for utilizing a log to free pages from persistent memory. A log is maintained to comprise a list of page block numbers of pages within persistent memory of a node to free. A page block number, of a page, within the log is identified for processing. A reference count, corresponding to a number of references to the page block number, is identified. In response to the reference count being greater than 1, the reference count is decremented and the page block number is removed from the log. In response to the reference count being 1, the page is freed from the persistent memory and the page block number is removed from the log.

    MULTI-TIER WRITE ALLOCATION
    57.
    发明申请

    公开(公告)号:US20250044964A1

    公开(公告)日:2025-02-06

    申请号:US18921156

    申请日:2024-10-21

    Applicant: NetApp, Inc.

    Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

    DYNAMICALLY SCALING APPLICATION AND STORAGE SYSTEM FUNCTIONS BASED ON A HETEROGENEOUS RESOURCE POOL AVAILABLE FOR USE BY A DISTRIBUTED STORAGE SYSTEM

    公开(公告)号:US20240427799A1

    公开(公告)日:2024-12-26

    申请号:US18820543

    申请日:2024-08-30

    Applicant: NetApp, Inc.

    Abstract: Systems and methods for scaling application and/or storage system functions of a distributed storage system based on a heterogeneous resource pool are provided. According to one embodiment, the distributed storage system has a composable, service-based architecture that provides scalability, resiliency, and load balancing. The distributed storage system includes a cluster of nodes each potentially having differing capabilities in terms of processing, memory, and/or storage. The distributed storage system takes advantage of different types of nodes by selectively instating appropriate services (e.g., file and volume services and/or block and storage management services) on the nodes based on their respective capabilities. Furthermore, disaggregation of these services, facilitated by interposing a frictionless layer (e.g., in the form of one or more globally accessible logical disks) therebetween, enables independent and on-demand scaling of either or both of application and storage system functions within the cluster while making use of the heterogeneous resource pool.

    Coordinating snapshot operations across multiple file systems

    公开(公告)号:US12169472B2

    公开(公告)日:2024-12-17

    申请号:US18361966

    申请日:2023-07-31

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for coordinating snapshot operations across multiple file systems. A notification may be received that a snapshot of data stored across a persistent memory file system and a storage file system is to be generated. Forwarding, of modify operations from a persistent memory tier to a file system tier for execution through the storage file system, may be enabled. Framing may be initiated to notify the storage file system of blocks within the persistent memory file system that comprise more up-to-date data than corresponding blocks within the storage file system. In response to the framing completing, a consistency point operation is performed to create the snapshot and to create a snapshot image as part of the snapshot.

    PERSISTENT MEMORY FILE SYSTEM RECONCILIATION

    公开(公告)号:US20240411645A1

    公开(公告)日:2024-12-12

    申请号:US18809170

    申请日:2024-08-19

    Applicant: NetApp, Inc.

    Abstract: Techniques are provided for persistent memory file system reconciliation. As part of the persistent memory file system reconciliation, high level file system metadata associated with a persistent memory file system of persistent memory is reconciled. Client access to the persistent memory file system is inaccessible until reconciliation of the high level file system metadata has completed. A first scanner is executed to traverse pages of the persistent memory in order to fix local inconsistencies associated with the pages. A local inconsistency of a first set of metadata or data of a page is fixed using a second set of metadata or data of the page. The first scanner is executed asynchronously in parallel with processing client I/O directed to the persistent memory file system.

Patent Agency Ranking