-
公开(公告)号:US12079242B2
公开(公告)日:2024-09-03
申请号:US18047774
申请日:2022-10-19
Applicant: NetApp, Inc.
Inventor: Arindam Banerjee , Daniel McCarthy , Christopher Cason , Ananthan Subramanian
CPC classification number: G06F16/27
Abstract: Systems and methods for scaling application and/or storage system functions of a distributed storage system based on a heterogeneous resource pool are provided. According to one embodiment, the distributed storage system has a composable, service-based architecture that provides scalability, resiliency, and load balancing. The distributed storage system includes a cluster of nodes each potentially having differing capabilities in terms of processing, memory, and/or storage. The distributed storage system takes advantage of different types of nodes by selectively instating appropriate services (e.g., file and volume services and/or block and storage management services) on the nodes based on their respective capabilities. Furthermore, disaggregation of these services, facilitated by interposing a frictionless layer (e.g., in the form of one or more globally accessible logical disks) therebetween, enables independent and on-demand scaling of either or both of application and storage system functions within the cluster while making use of the heterogeneous resource pool.
-
公开(公告)号:US12073123B2
公开(公告)日:2024-08-27
申请号:US17963077
申请日:2022-10-10
Applicant: NetApp Inc.
Inventor: Ananthan Subramanian , Kumaran Nagappan , Sriram Venketaraman , Szu-Wen Kuo , Yong Eun Cho
CPC classification number: G06F3/0661 , G06F3/0608 , G06F3/064 , G06F3/0673
Abstract: Techniques are provided for compacting indirect blocks. For example, an object is represented as a structure comprising data blocks within which data of the object is stored and indirect blocks comprising block numbers of where the data blocks are located in storage. Block numbers within a set of indirect blocks are compacted into a compacted indirect block comprising a base block number, a count of additional block numbers after the base block number in the compacted indirect block, and a pattern of the block numbers in the compacted indirect block. The compacted indirect block is stored into memory for processing access operations to the object. Storing compacted indirect blocks into memory allows for more block numbers to be stored within memory. In this way, the block numbers are read from memory is faster than loading the block numbers from disk.
-
公开(公告)号:US12066897B2
公开(公告)日:2024-08-20
申请号:US18302212
申请日:2023-04-18
Applicant: NetApp Inc.
Inventor: Matthew Fontaine Curtis-Maury , Ram Kesavan , Ananthan Subramanian , Abdul Basit , Vinay Devadas , Yash Hetal Trivedi
IPC: G06F11/00 , G06F11/14 , G06F13/16 , G06F16/182
CPC classification number: G06F11/1435 , G06F13/1668 , G06F16/183
Abstract: Techniques are provided for persistent memory file system reconciliation. As part of the persistent memory file system reconciliation, high level file system metadata associated with a persistent memory file system of persistent memory is reconciled. Client access to the persistent memory file system is inaccessible until reconciliation of the high level file system metadata has completed. A first scanner is executed to traverse pages of the persistent memory in order to fix local inconsistencies associated with the pages. A local inconsistency of a first set of metadata or data of a page is fixed using a second set of metadata or data of the page. The first scanner is executed asynchronously in parallel with processing client I/O directed to the persistent memory file system.
-
公开(公告)号:US20240241801A1
公开(公告)日:2024-07-18
申请号:US18623387
申请日:2024-04-01
Applicant: NetApp Inc.
Inventor: Ananthan Subramanian , Matthew Fontaine Curtis-Maury , Vinay Devadas
IPC: G06F11/14 , G06F11/07 , G06F11/30 , G06F12/02 , G06F12/0817 , G06F12/0882
CPC classification number: G06F11/1471 , G06F11/0772 , G06F11/3037 , G06F12/0246 , G06F12/0824 , G06F12/0882
Abstract: Techniques are provided for maintaining and recomputing reference counts in a persistent memory file system of a node. Primary reference counts are maintained for pages within persistent memory of the node. In response to receiving a first operation to link a page into a persistent memory file system of the persistent memory, a primary reference count of the page is incremented before linking the page into the persistent memory file system. In response to receiving a second operation to unlink the page from the persistent memory file system, the page is unlinked from the persistent memory file system before the primary reference count is decremented. Upon the node recovering from a crash, the persistent memory file system is traversed in order to update shadow reference counts for the pages with correct reference count values, which are used to overwrite the primary reference counts with the correct reference count values.
-
公开(公告)号:US20240086374A1
公开(公告)日:2024-03-14
申请号:US18514529
申请日:2023-11-20
Applicant: NetApp Inc.
Inventor: Rupa Natarajan , Ananthan Subramanian
CPC classification number: G06F16/1805 , G06F16/162 , G06F16/2246
Abstract: Techniques are provided for utilizing a log to free pages from persistent memory. A log is maintained to comprise a list of page block numbers of pages within persistent memory of a node to free. A page block number, of a page, within the log is identified for processing. A reference count, corresponding to a number of references to the page block number, is identified. In response to the reference count being greater than 1, the reference count is decremented and the page block number is removed from the log. In response to the reference count being 1, the page is freed from the persistent memory and the page block number is removed from the log.
-
公开(公告)号:US20230376392A1
公开(公告)日:2023-11-23
申请号:US18229107
申请日:2023-08-01
Applicant: NETAPP, INC.
Inventor: Asif Imtiyaz Pathan , Parag Sarfare , Ananthan Subramanian , Szu-Wen Kuo , Santhosh Selvaraj , Nikhil Mattankot
CPC classification number: G06F11/2069 , G06F11/1435 , G06F16/1824 , G06F11/3034 , G06F16/1734 , G06F11/0787
Abstract: Failover methods and systems for a networked storage environment are provided. In one aspect, a read request associated with a first storage object is received, during a replay of entries of a log stored in a non-volatile memory of a second storage node for a failover operation initiated in response to a failure at a first storage node. The second storage node operates as a partner node of the first storage node. The read request is processed using a filtering data structure that is generated from the log prior to the replay and identifies each log entry. The read request is processed when the log does not have an entry associated with the read request, and when the filtering data structure includes an entry associated with the read request, the requested data is located at the non-volatile memory.
-
公开(公告)号:US20230336183A1
公开(公告)日:2023-10-19
申请号:US18186657
申请日:2023-03-20
Applicant: NetApp Inc.
Inventor: Ram Kesavan , Matthew Fontaine Curtis-Maury , Abdul Basit , Vinay Devadas , Ananthan Subramanian , Mark Smith
IPC: H03M1/06 , G06F3/06 , G06F16/901
CPC classification number: H03M1/0687 , G06F3/0604 , G06F3/0653 , G06F3/0685 , G06F16/9027 , H03M1/0695
Abstract: Techniques are provided for implementing a file system format for persistent memory. A node, comprising persistent memory, receives an operation comprising a file identifier and file system instance information. A list of file system info objects are evaluated to identify a file system info object matching the file system instance information. An inofile, identified by the file system info object as being associated with inodes of files within an instance of the file system targeted by the operation, is traversed to identify an inode matching the file identifier. If the inode comprises an indicator that the file is tiered into the persistent memory, then the inode it utilized to facilitate execution of the operation upon the persistent memory. Otherwise, the operation is routed to a storage file system tier for execution by a storage file system upon storage associated with the node.
-
公开(公告)号:US11748208B2
公开(公告)日:2023-09-05
申请号:US17576981
申请日:2022-01-16
Applicant: NetApp Inc.
Inventor: Ananthan Subramanian , Ram Kesavan , Matthew Fontaine Curtis-Maury , Mark Smith
CPC classification number: G06F11/1464 , G06F3/067 , G06F3/0619 , G06F3/0641 , G06F3/0659 , G06F11/1451 , G06F11/1453 , G06F11/1469 , G06F11/2056 , G06F2201/84
Abstract: Techniques are provided for implementing a persistent memory storage tier to manage persistent memory of a node. The persistent memory is managed by the persistent memory storage tier at a higher level within a storage operating system storage stack than a level at which a storage file system of the node is managed. The persistent memory storage tier intercepts an operation targeting the storage file system. The persistent memory storage tier retargets the operation from targeting the storage file system to targeting the persistent memory. The operation is transmitted to the persistent memory.
-
公开(公告)号:US11630733B2
公开(公告)日:2023-04-18
申请号:US17018176
申请日:2020-09-11
Applicant: NetApp Inc.
Inventor: Matthew Fontaine Curtis-Maury , Ram Kesavan , Ananthan Subramanian , Abdul Basit , Vinay Devadas , Yash Hetal Trivedi
IPC: G06F11/00 , G06F11/14 , G06F13/16 , G06F16/182
Abstract: Techniques are provided for persistent memory file system reconciliation. As part of the persistent memory file system reconciliation, high level file system metadata associated with a persistent memory file system of persistent memory is reconciled. Client access to the persistent memory file system is inaccessible until reconciliation of the high level file system metadata has completed. A first scanner is executed to traverse pages of the persistent memory in order to fix local inconsistencies associated with the pages. A local inconsistency of a first set of metadata or data of a page is fixed using a second set of metadata or data of the page. The first scanner is executed asynchronously in parallel with processing client I/O directed to the persistent memory file system.
-
公开(公告)号:US20230052732A1
公开(公告)日:2023-02-16
申请号:US17976946
申请日:2022-10-31
Applicant: NetApp Inc.
Inventor: Ananthan Subramanian , Sridevi Jantli , Anil Paul Thoppil , Cheryl Marie Thompson , Qinghua Zheng
IPC: G06F16/215 , G06F16/22 , G06F16/23
Abstract: Techniques are provided for orphan object detection, invalid sequence number detection, and asynchronous object cleanup. A storage system may store data within one or more tiers of storage, such as a storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Orphan objects, within the remote object store, that are no longer used by the storage system may be detected and/or deleted. When an aggregate of volumes is deleted, corresponding objects, within the remote object store, may be identified and/or deleted. Invalid sequence numbers (e.g., lost or corrupt sequence numbers locally maintained in a metafile) assigned to objects within the remote object store may be identified, deleted, and/or fixed.
-
-
-
-
-
-
-
-
-