JOURNAL REPLAY OPTIMIZATION
    2.
    发明公开

    公开(公告)号:US20240143210A1

    公开(公告)日:2024-05-02

    申请号:US18399555

    申请日:2023-12-28

    申请人: NetApp Inc.

    IPC分类号: G06F3/06

    摘要: Techniques are provided for journal replay optimization. A distributed storage architecture can implement a journal within memory for logging write operations into log records. Latency of executing the write operations is improved because the write operations can be responded back to clients as complete once logged within the journal without having to store the data to higher latency disk storage. If there is a failure, then a replay process is performed to replay the write operations logged within the journal in order to bring a file system up-to-date. The time to complete the replay of the write operations is significantly reduced by caching metadata (e.g., indirect blocks, checksums, buftree identifiers, file block numbers, and consistency point counts) directly into log records. Replay can quickly access this metadata for replaying the write operations because the metadata does not need to be retrieved from the higher latency disk storage into memory.

    MULTI-TIER WRITE ALLOCATION
    3.
    发明公开

    公开(公告)号:US20240012571A1

    公开(公告)日:2024-01-11

    申请号:US18357206

    申请日:2023-07-24

    申请人: NetApp Inc.

    IPC分类号: G06F11/10 G06F11/14 G06F21/60

    摘要: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

    Block allocation for persistent memory during aggregate transition

    公开(公告)号:US11836363B2

    公开(公告)日:2023-12-05

    申请号:US17750793

    申请日:2022-05-23

    申请人: NetApp Inc.

    IPC分类号: G06F3/06

    摘要: Techniques are provided for block allocation for persistent memory during aggregate transition. In a high availability pair including first and second nodes, the first node makes a determination that control of a first aggregate is to transition from the first node to the second node. A portion of available free storage space is allocated from a first persistent memory of the first node as allocated pages within the first persistent memory. Metadata information for the allocated pages is updated with an identifier of the first aggregate to create updated metadata information reserving the allocated pages for the first aggregate. The updated metadata information is mirrored to the second node, so that the second node also reserves those pages. Control of the first aggregate is transitioned to the second node. As a result, the nodes do not attempt allocating the same free pages to different aggregates during a transition.

    JOURNAL REPLAY OPTIMIZATION
    7.
    发明公开

    公开(公告)号:US20230342053A1

    公开(公告)日:2023-10-26

    申请号:US17728441

    申请日:2022-04-25

    申请人: NetApp Inc.

    IPC分类号: G06F3/06

    摘要: Techniques are provided for journal replay optimization. A distributed storage architecture can implement a journal within memory for logging write operations into log records. Latency of executing the write operations is improved because the write operations can be responded back to clients as complete once logged within the journal without having to store the data to higher latency disk storage. If there is a failure, then a replay process is performed to replay the write operations logged within the journal in order to bring a file system up-to-date. The time to complete the replay of the write operations is significantly reduced by caching metadata (e.g., indirect blocks, checksums, buftree identifiers, file block numbers, and consistency point counts) directly into log records. Replay can quickly access this metadata for replaying the write operations because the metadata does not need to be retrieved from the higher latency disk storage into memory.

    PERSISTENT MEMORY FILE SYSTEM RECONCILIATION

    公开(公告)号:US20230251932A1

    公开(公告)日:2023-08-10

    申请号:US18302212

    申请日:2023-04-18

    申请人: NetApp Inc.

    摘要: Techniques are provided for persistent memory file system reconciliation. As part of the persistent memory file system reconciliation, high level file system metadata associated with a persistent memory file system of persistent memory is reconciled. Client access to the persistent memory file system is inaccessible until reconciliation of the high level file system metadata has completed. A first scanner is executed to traverse pages of the persistent memory in order to fix local inconsistencies associated with the pages. A local inconsistency of a first set of metadata or data of a page is fixed using a second set of metadata or data of the page. The first scanner is executed asynchronously in parallel with processing client I/O directed to the persistent memory file system.

    Multi-tier write allocation
    9.
    发明授权

    公开(公告)号:US11709603B2

    公开(公告)日:2023-07-25

    申请号:US17833046

    申请日:2022-06-06

    申请人: NetApp Inc.

    IPC分类号: G06F3/06

    摘要: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

    FORWARDING OPERATIONS TO BYPASS PERSISTENT MEMORY

    公开(公告)号:US20230139582A1

    公开(公告)日:2023-05-04

    申请号:US18089633

    申请日:2022-12-28

    申请人: NetApp Inc.

    IPC分类号: G06F3/06 G06F15/173

    摘要: Techniques are provided for forwarding operations to bypass persistent memory. A modify operation, targeting an object, may be received at a persistent memory tier of a node. If a forwarding policy indicates that forwarding is not enabled for the modify operation and the target object, then the modify operation is executed through a persistent memory file system. If the forwarding policy indicates that forwarding is enabled for the modify operation and the target object, then the modify operation is forwarded to a file system tier as a forwarded operation for execution through a storage file system.