公开(公告)号：US20250068600A1

公开(公告)日：2025-02-27

申请号：US18942186

申请日：2024-11-08

Applicant: NetApp, Inc.

Inventor： Ananthan Subramanian ,  Daniel McCarthy ,  Arindam Banerjee

IPC: G06F16/182 ,  G06F16/16 ,  G06F16/188 ,  H04L67/00

Abstract: A method for reducing write latency in a distributed file system. A write request that includes a volume identifier is received at a data management subsystem deployed on a node within a distributed storage system. The data management subsystem maps the volume identifier to a file system volume and maps the file system volume to a set of logical block addresses in a logical block device in a storage management subsystem deployed on the node. The storage management subsystem maps the logical block device to a metadata object for the logical block device on the node that is used to process the write request. The mapping of the file system volume to the set of logical block addresses in the logical block device enables co-locating the metadata object with the file system volume on the node, which reduces the write latency associated with processing the write request.

公开(公告)号：US20250038756A1

公开(公告)日：2025-01-30

申请号：US18914423

申请日：2024-10-14

Applicant: NetApp, Inc.

Inventor： Ram Kesavan ,  Matthew Fontaine Curtis-Maury ,  Abdul Basit ,  Vinay Devadas ,  Ananthan Subramanian ,  Mark Smith

IPC: H03M1/06 ,  G06F3/06 ,  G06F16/901

Abstract: Techniques are provided for implementing a file system format for persistent memory. A node, comprising persistent memory, receives an operation comprising a file identifier and file system instance information. A list of file system info objects are evaluated to identify a file system info object matching the file system instance information. An inofile, identified by the file system info object as being associated with inodes of files within an instance of the file system targeted by the operation, is traversed to identify an inode matching the file identifier. If the inode comprises an indicator that the file is tiered into the persistent memory, then the inode it utilized to facilitate execution of the operation upon the persistent memory. Otherwise, the operation is routed to a storage file system tier for execution by a storage file system upon storage associated with the node.

公开(公告)号：US12124716B2

公开(公告)日：2024-10-22

申请号：US18357206

申请日：2023-07-24

Applicant: NetApp Inc.

Inventor： Ganga Bhavani Kondapalli ,  Kevin Daniel Varghese ,  Ananthan Subramanian ,  Cheryl Marie Thompson ,  Anil Paul Thoppil

IPC: G06F3/06

CPC classification number: G06F3/0631 ,  G06F3/061 ,  G06F3/0665 ,  G06F3/067

Abstract: Techniques are provided for multi-tier write allocation. A storage system may store data within a multi-tier storage environment comprising a first storage tier (e.g., storage devices maintained by the storage system), a second storage tier (e.g., a remote object store provided by a third party storage provider), and/or other storage tiers. A determination is made that data (e.g., data of a write request received by the storage system) is to be stored within the second storage tier. The data is stored into a staging area of the first storage tier. A second storage tier location identifier, for referencing the data according to a format utilized by the second storage tier, is assigned to the data and provided to a file system hosting the data. The data is then destaged from the staging area into the second storage tier, such as within an object stored within the remote object store.

公开(公告)号：US20240303198A1

公开(公告)日：2024-09-12

申请号：US18669907

申请日：2024-05-21

Applicant: NetApp, Inc

Inventor： Matthew Fontaine Curtis-Maury ,  Vinay Devadas ,  Ananthan Subramanian ,  Ram Kesavan

IPC: G06F12/0882 ,  G06F12/02 ,  G06F12/0871 ,  G06F16/182 ,  G06F16/22

CPC classification number: G06F12/0882 ,  G06F12/0246 ,  G06F12/0871 ,  G06F16/182 ,  G06F16/2246

Abstract: Techniques are provided for atomic writes for persistent memory. In response to receiving a write operation, a new per-page structure with a new page block number is allocated. New data of the write operation is persisted to a new page of the persistent memory having the new page block number, and the new per-page structure is persisted to the persistent memory. If the write operation targets a hole after the new data and the new per-page structure have been persisted, then a new per-page structure identifier of the new per-page structure is inserted into a parent indirect page of a page comprising the new data. If the write operation targets old data after the new data and the new per-page structure have been persisted, then an old per-page structure of the old data is updated with the new page block number.

公开(公告)号：US12014056B2

公开(公告)日：2024-06-18

申请号：US17893511

申请日：2022-08-23

Applicant: NetApp Inc.

Inventor： Bharadwaj Vellore Ramesh ,  Daniel McCarthy ,  Christopher Lee Cason ,  Ananthan Subramanian

IPC: G06F3/06

CPC classification number: G06F3/0619 ,  G06F3/064 ,  G06F3/067

Abstract: Techniques are provided for repairing a primary slice file, affected by a storage device error, by using one or more dead replica slice files. The primary slice file is used by a node of a distributed storage architecture as an indirection layer between storage containers (e.g., a volume or LUN) and physical storage where data is physically stored. To improve resiliency of the distributed storage architecture, changes to the primary slice file are replicated to replica slice files hosted by other nodes. If a replica slice file falls out of sync with the primary slice file, then the replica slice file is considered dead (out of sync) and could potentially comprise stale data. If a storage device error affects blocks storing data of the primary slice file, then the techniques provided herein can repair the primary slice file using non-stale data from one or more dead replica slice files.

公开(公告)号：US20240103744A1

公开(公告)日：2024-03-28

申请号：US18528556

申请日：2023-12-04

Applicant: NetApp Inc.

Inventor： Abdul Basit ,  Ananthan Subramanian ,  Ram Kesavan ,  Matthew Fontaine Curtis-Maury

IPC: G06F3/06

CPC classification number: G06F3/0631 ,  G06F3/0604 ,  G06F3/064 ,  G06F3/065 ,  G06F3/0679

Abstract: Techniques are provided for block allocation for persistent memory during aggregate transition. In a high availability pair including first and second nodes, the first node makes a determination that control of a first aggregate is to transition from the first node to the second node. A portion of available free storage space is allocated from a first persistent memory of the first node as allocated pages within the first persistent memory. Metadata information for the allocated pages is updated with an identifier of the first aggregate to create updated metadata information reserving the allocated pages for the first aggregate. The updated metadata information is mirrored to the second node, so that the second node also reserves those pages. Control of the first aggregate is transitioned to the second node. As a result, the nodes do not attempt allocating the same free pages to different aggregates during a transition.

公开(公告)号：US11934262B2

公开(公告)日：2024-03-19

申请号：US18165077

申请日：2023-02-06

Applicant: NetApp Inc.

Inventor： Ananthan Subramanian ,  Ganga Bhavani Kondapalli ,  Cheryl Marie Thompson ,  Kevin Daniel Varghese ,  Anil Paul Thoppil ,  Qinghua Zheng

IPC: G06F11/10 ,  G06F3/06 ,  G06F12/08 ,  G06F16/178

CPC classification number: G06F11/1004 ,  G06F3/0619 ,  G06F12/08 ,  G06F16/178

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

公开(公告)号：US20240086116A1

公开(公告)日：2024-03-14

申请号：US18513894

申请日：2023-11-20

Applicant: NetApp Inc.

Inventor： Ram Kesavan ,  Matthew Fontaine Curtis-Maury ,  Abdul Basit ,  Vinay Devadas ,  Ananthan Subramanian

IPC: G06F3/06 ,  G06F11/14

CPC classification number: G06F3/0659 ,  G06F3/0619 ,  G06F3/0644 ,  G06F3/0653 ,  G06F3/067 ,  G06F3/0683 ,  G06F11/1417 ,  G06F11/1464 ,  G06F11/1469

Abstract: Techniques are provided for implementing write ordering for persistent memory. A set of actions are identified for commitment to persistent memory of a node for executing an operation upon the persistent memory. An episode is created to comprise a first subset of actions of the set of actions that can be committed to the persistent memory in any order with respect to one another such that a consistent state of the persistent memory can be reconstructed in the event of a crash of the node during execution of the operation. The first subset of actions within the episode are committed to the persistent memory and further execution of the operation is blocked until the episode completes.

公开(公告)号：US20240061603A1

公开(公告)日：2024-02-22

申请号：US18497925

申请日：2023-10-30

Applicant: NetApp, Inc.

Inventor： Kevin Daniel Varghese ,  Ananthan Subramanian ,  Parag Sarfare ,  Sandeep Yadav ,  Suhas Urkude ,  Rajesh Khandelwal

IPC: G06F3/06

CPC classification number: G06F3/0644 ,  G06F3/064 ,  G06F3/067 ,  G06F3/0613 ,  G06F3/0623 ,  G06F3/0659

Abstract: Methods and systems for co-locating journaling and data storage are provided. Separate journal and volume partitions may be maintained within each logical storage unit (e.g., Logical Unit Number (LUN)) of a distributed storage system. Journaling of metadata associated with write requests received from one or more clients may be distributed by identifying a destination logical storage unit to which data associated with a given write request is to be stored and causing the data and metadata to be persisted to disk by journaling the metadata and the data to respective portions of an active log within the journal partition of the destination logical storage unit. By using the same logical storage unit for both journaling of write requests and writing the data associated with such write requests, the bottleneck due to there being only a single device or storage unit handling all metadata for all write requests can be avoided.

公开(公告)号：US11861198B2

公开(公告)日：2024-01-02

申请号：US17728441

申请日：2022-04-25

Applicant: NetApp Inc.

Inventor： Kevin Daniel Varghese ,  Ananthan Subramanian ,  Asif Imtiyaz Pathan

IPC: G06F3/06

CPC classification number: G06F3/064 ,  G06F3/067 ,  G06F3/0619 ,  G06F3/0656 ,  G06F3/0659

Abstract: Techniques are provided for journal replay optimization. A distributed storage architecture can implement a journal within memory for logging write operations into log records. Latency of executing the write operations is improved because the write operations can be responded back to clients as complete once logged within the journal without having to store the data to higher latency disk storage. If there is a failure, then a replay process is performed to replay the write operations logged within the journal in order to bring a file system up-to-date. The time to complete the replay of the write operations is significantly reduced by caching metadata (e.g., indirect blocks, checksums, buftree identifiers, file block numbers, and consistency point counts) directly into log records. Replay can quickly access this metadata for replaying the write operations because the metadata does not need to be retrieved from the higher latency disk storage into memory.