-
公开(公告)号:US12045207B2
公开(公告)日:2024-07-23
申请号:US17449758
申请日:2021-10-01
Applicant: NetApp, Inc.
Inventor: Ravikanth Dronamraju , Ananthan Subramanian , Daniel McCarthy , Christopher Cason , Arindam Banerjee
IPC: G06F16/18 , G06F9/50 , G06F16/182 , G06F16/188
CPC classification number: G06F16/188 , G06F9/5077 , G06F16/182
Abstract: A distributed storage management system comprising nodes that form a cluster, a distributed block layer that spans the nodes in the cluster, and file system instances deployed on the nodes. Each file system instance comprises a data management subsystem and a storage management subsystem disaggregated from the data management subsystem. The storage management subsystem comprises a node block store that forms a portion of the distributed block layer and a storage manager that manages a key-value store and virtualized storage supporting the node block store. A file system volume hosted by the data management subsystem maps to a logical block device hosted by the virtualized storage in the storage management subsystem. The key-value store includes, for a data block of the logical block device, a key that comprises a block identifier for the logical block device and a value that comprises the data block.
-
公开(公告)号:US12038886B2
公开(公告)日:2024-07-16
申请号:US18359192
申请日:2023-07-26
Applicant: NetApp, Inc.
Inventor: Ravikanth Dronamraju , Ananthan Subramanian , Daniel McCarthy , Christopher Cason , Arindam Banerjee
IPC: G06F16/18 , G06F9/50 , G06F16/182 , G06F16/188
CPC classification number: G06F16/188 , G06F9/5077 , G06F16/182
Abstract: In various examples, data storage is managed using a distributed storage management system that is resilient. Data blocks of a logical block device may be distributed across multiple nodes in a cluster. The logical block device may correspond to a file system volume associated with a file system instance deployed on a selected node within a distributed block layer of a distributed file system. Each data block may have a location in the cluster identified by a block identifier associated with each data block. Each data block may be replicated on at least one other node in the cluster. A metadata object corresponding to a logical block device that maps to the file system volume may be replicated on at least another node in the cluster. Each data block and the metadata object may be hosted on virtualized storage that is protected using redundant array independent disks (RAID).
-
公开(公告)号:US12001724B2
公开(公告)日:2024-06-04
申请号:US18089633
申请日:2022-12-28
Applicant: NetApp Inc.
Inventor: Ananthan Subramanian , Matthew Fontaine Curtis-Maury , Vinay Devadas , Bulli Venkata Rajesh Vipperla
IPC: G06F12/00 , G06F3/06 , G06F15/173
CPC classification number: G06F3/0659 , G06F3/0619 , G06F3/064 , G06F3/067 , G06F15/17331
Abstract: Techniques are provided for forwarding operations to bypass persistent memory. A modify operation, targeting an object, may be received at a persistent memory tier of a node. If a forwarding policy indicates that forwarding is not enabled for the modify operation and the target object, then the modify operation is executed through a persistent memory file system. If the forwarding policy indicates that forwarding is enabled for the modify operation and the target object, then the modify operation is forwarded to a file system tier as a forwarded operation for execution through a storage file system.
-
公开(公告)号:US11994998B2
公开(公告)日:2024-05-28
申请号:US17750707
申请日:2022-05-23
Applicant: NetApp Inc.
Inventor: Matthew Fontaine Curtis-Maury , Vinay Devadas , Ananthan Subramanian , Ram Kesavan
IPC: G06F12/0882 , G06F12/02 , G06F12/0871 , G06F16/182 , G06F16/22
CPC classification number: G06F12/0882 , G06F12/0246 , G06F12/0871 , G06F16/182 , G06F16/2246
Abstract: Techniques are provided for atomic writes for persistent memory. In response to receiving a write operation, a new per-page structure with a new page block number is allocated. New data of the write operation is persisted to a new page of the persistent memory having the new page block number, and the new per-page structure is persisted to the persistent memory. If the write operation targets a hole after the new data and the new per-page structure have been persisted, then a new per-page structure identifier of the new per-page structure is inserted into a parent indirect page of a page comprising the new data. If the write operation targets old data after the new data and the new per-page structure have been persisted, then an old per-page structure of the old data is updated with the new page block number.
-
公开(公告)号:US20240118981A1
公开(公告)日:2024-04-11
申请号:US18089192
申请日:2022-12-27
Applicant: NetApp Inc.
Inventor: Yash Hetal Trivedi , Daniel McCarthy , Ananthan Subramanian , William Arthur Gutknecht , Kevin Daniel Varghese , Swaroop Vikram Choudhari , Abdul Basit , Christopher Clark Corey , Chad Edmund Schneider
CPC classification number: G06F11/2025 , G06F11/1662
Abstract: Techniques are provided for failing over an aggregate from one file system instance to a different file system instance of a distributed scale-out storage system. The aggregate may be stored within distributed storage that is accessible to a plurality of file system instances of the distributed scale-out storage system. When the aggregate is failed over from a first file system instance to a second file system instance, the first file system instance may still have a valid read lease that allows the first file system instance to serve client I/O, directed to the aggregate, using a cache. In order to prevent the first file system instance from serving stale data from the cache before the read lease expires, state machines and a set of control data are used to ensure that the second file system instance attaches to the aggregate only after the read lease has expired.
-
公开(公告)号:US11947430B2
公开(公告)日:2024-04-02
申请号:US17892175
申请日:2022-08-22
Applicant: NetApp Inc.
Inventor: Ananthan Subramanian , Matthew Fontaine Curtis-Maury , Vinay Devadas
IPC: G06F11/00 , G06F11/07 , G06F11/14 , G06F11/30 , G06F12/02 , G06F12/0817 , G06F12/0882
CPC classification number: G06F11/1471 , G06F11/0772 , G06F11/3037 , G06F12/0246 , G06F12/0824 , G06F12/0882
Abstract: Techniques are provided for maintaining and recomputing reference counts in a persistent memory file system of a node. Primary reference counts are maintained for pages within persistent memory of the node. In response to receiving a first operation to link a page into a persistent memory file system of the persistent memory, a primary reference count of the page is incremented before linking the page into the persistent memory file system. In response to receiving a second operation to unlink the page from the persistent memory file system, the page is unlinked from the persistent memory file system before the primary reference count is decremented. Upon the node recovering from a crash, the persistent memory file system is traversed in order to update shadow reference counts for the pages with correct reference count values, which are used to overwrite the primary reference counts with the correct reference count values.
-
公开(公告)号:US20240045848A1
公开(公告)日:2024-02-08
申请号:US18491940
申请日:2023-10-23
Applicant: NetApp Inc.
Inventor: Sanjay Subramanian Seshadri , Arindam Banerjee , Manan Dahyabhai Patel , Raymond Jordan Go , Anil Paul Thoppil , Ananthan Subramanian , Santhosh Selvaraj , Nikul Y. Patel , Vikhyath Rao , Meera Odugoudar , Kevin Daniel Varghese
IPC: G06F16/22 , G06F16/21 , G06F16/248 , G06F16/2457 , G06F16/2455 , G06F16/215
CPC classification number: G06F16/2246 , G06F16/217 , G06F16/248 , G06F16/24573 , G06F16/24553 , G06F16/215
Abstract: Techniques are provided for key-value store and file system integration to optimize key value store operations. A key-value store is integrated within a file system of a node. A log structured merge tree of the key-value store may be populated with a key corresponding to a content hash of a value data item stored separate from the key. A random distribution search may be performed upon a sorted log of the log structured merge tree to identify the key for accessing the value data item. A starting location for the random distribution search is derived from key information, a log size of the sorted log, and/or a keyspace size of a keyspace associated with the key.
-
公开(公告)号:US11880578B2
公开(公告)日:2024-01-23
申请号:US17536249
申请日:2021-11-29
Applicant: NetApp Inc.
Inventor: Ananthan Subramanian , Sriram Venketaraman , Ravikanth Dronamraju , Mohit Gupta
CPC classification number: G06F3/0643 , G06F3/061 , G06F3/067 , G06F3/0653 , G06F3/0683 , G06F3/0685 , G06F12/0253 , G06F12/1408 , G06F16/148 , G06F2212/402
Abstract: Techniques are provided for providing a storage abstraction layer for a composite aggregate architecture. A storage abstraction layer is utilized as an indirection layer between a file system and a storage environment. The storage abstraction layer obtains characteristic of a plurality of storage providers that provide access to heterogeneous types of storage of the storage environment (e.g., solid state storage, high availability storage, object storage, hard disk drive storage, etc.). The storage abstraction layer generates storage bins to manage storage of each storage provider. The storage abstraction layer generates a storage aggregate from the heterogeneous types of storage as a single storage container. The storage aggregate is exposed to the file system as the single storage container that abstracts away from the file system the management and physical storage details of data of the storage aggregate.
-
公开(公告)号:US20230376455A1
公开(公告)日:2023-11-23
申请号:US18361966
申请日:2023-07-31
Applicant: NetApp Inc.
Inventor: Ananthan Subramanian , Matthew Fontaine Curtis-Maury , Ram Kesavan , Rupa Natarajan , Vinay Devadas
IPC: G06F16/11
CPC classification number: G06F16/128
Abstract: Techniques are provided for coordinating snapshot operations across multiple file systems. A notification may be received that a snapshot of data stored across a persistent memory file system and a storage file system is to be generated. Forwarding, of modify operations from a persistent memory tier to a file system tier for execution through the storage file system, may be enabled. Framing may be initiated to notify the storage file system of blocks within the persistent memory file system that comprise more up-to-date data than corresponding blocks within the storage file system. In response to the framing completing, a consistency point operation is performed to create the snapshot and to create a snapshot image as part of the snapshot.
-
公开(公告)号:US11803315B2
公开(公告)日:2023-10-31
申请号:US17849290
申请日:2022-06-24
Applicant: NetApp, Inc.
Inventor: Kevin Daniel Varghese , Ananthan Subramanian , Parag Sarfare , Sandeep Yadav , Suhas Urkude , Rajesh Khandelwal
IPC: G06F3/06
CPC classification number: G06F3/0644 , G06F3/064 , G06F3/067 , G06F3/0613 , G06F3/0623 , G06F3/0659
Abstract: A method and system for co-locating journaling and data storage based on write requests. A write request that includes metadata and data is received from a client. A logical storage unit for storing the metadata and the data is identified. The logical storage unit is divided into a journal partition and a volume partition. The journal partition includes a first log and a second log. Which of the first log and the second log is an active log and which of the first log and the second log is an inactive log are identified. The metadata is recorded in a first location in the active log and the data is recorded in a second location in the active log during a single I/O operation. A reply is sent to the client after the metadata and the data are recorded in the journal partition.
-
-
-
-
-
-
-
-
-