公开(公告)号：US12126502B1

公开(公告)日：2024-10-22

申请号：US18307103

申请日：2023-04-26

Applicant: NetApp Inc.

Inventor： Abdul Basit ,  Daniel McCarthy ,  Christopher Lee Cason ,  Jian Hu

IPC: G06F15/173 ,  G06F9/50 ,  H04L41/5067

CPC classification number: H04L41/5067 ,  G06F9/5072 ,  G06F2209/501 ,  G06F2209/5011 ,  G06F2209/503 ,  G06F2209/505

Abstract: Techniques are provided for dynamically implementing quality of service policies using a configurable quality of service provider pipeline. A quality of service policy is defined for throttling I/O operations received by a node based upon whether resources of the node have become over utilized. The quality of service policy is used to dynamically construct a quality of service provider pipeline with select quality of service providers that improve the ability to efficiently utilize resources compared to conventional static polices that cannot adequately react to changing considerations and resource utilization/saturation. With conventional static policies, an administrator manually defines a minimum amount of guaranteed resources and/or a maximum resource usage cap that could be set to values that result in inefficient operation and resource starvation. Dynamically constructing and utilizing the quality of service provider pipeline results in more efficient operation and mitigates resource starvation.

公开(公告)号：US20250060881A1

公开(公告)日：2025-02-20

申请号：US18935813

申请日：2024-11-04

Applicant: NetApp, Inc.

Inventor： Abdul Basit ,  Daniel McCarthy ,  Christopher Lee Cason ,  Jian Hu

IPC: G06F3/06

Abstract: Techniques are provided for dynamically implementing quality of service policies for a distributed storage system based upon resources saturation. A quality of service policy is defined for throttling I/O operations received by a node of the distributed storage system based upon whether resources of the node have become saturated. The quality of service policy is dynamically implemented based upon ever changing resource utilization and saturation. Dynamically implementing the quality of service policy improves the ability to efficiently utilize resources of the node compared to conventional static polices that cannot adequately react to such changing considerations and resource utilization/saturation. With conventional static policies, an administrator manually defines a minimum amount of guaranteed resources and/or a maximum resource usage cap that could be set to values that result in inefficient operation and resource starvation. Dynamically implementing the quality of service policy results in more efficient operation and mitigates resource starvation.

公开(公告)号：US20240069743A1

公开(公告)日：2024-02-29

申请号：US17893511

申请日：2022-08-23

Applicant: NetApp Inc.

Inventor： Bharadwaj Vellore Ramesh ,  Daniel McCarthy ,  Christopher Lee Cason ,  Ananthan Subramanian

IPC: G06F3/06

CPC classification number: G06F3/0619 ,  G06F3/064 ,  G06F3/067

Abstract: Techniques are provided for repairing a primary slice file, affected by a storage device error, by using one or more dead replica slice files. The primary slice file is used by a node of a distributed storage architecture as an indirection layer between storage containers (e.g., a volume or LUN) and physical storage where data is physically stored. To improve resiliency of the distributed storage architecture, changes to the primary slice file are replicated to replica slice files hosted by other nodes. If a replica slice file falls out of sync with the primary slice file, then the replica slice file is considered dead (out of sync) and could potentially comprise stale data. If a storage device error affects blocks storing data of the primary slice file, then the techniques provided herein can repair the primary slice file using non-stale data from one or more dead replica slice files.

公开(公告)号：US20230367746A1

公开(公告)日：2023-11-16

申请号：US18359192

申请日：2023-07-26

Applicant: NetApp, Inc.

Inventor： Ravikanth Dronamraju ,  Ananthan Subramanian ,  Daniel McCarthy ,  Christopher Cason ,  Arindam Banerjee

IPC: G06F16/188 ,  G06F16/182 ,  G06F9/50

CPC classification number: G06F16/188 ,  G06F16/182 ,  G06F9/5077

Abstract: In various examples, data storage is managed using a distributed storage management system that is resilient. Data blocks of a logical block device may be distributed across multiple nodes in a cluster. The logical block device may correspond to a file system volume associated with a file system instance deployed on a selected node within a distributed block layer of a distributed file system. Each data block may have a location in the cluster identified by a block identifier associated with each data block. Each data block may be replicated on at least one other node in the cluster. A metadata object corresponding to a logical block device that maps to the file system volume may be replicated on at least another node in the cluster. Each data block and the metadata object may be hosted on virtualized storage that is protected using redundant array independent disks (RAID).

公开(公告)号：US20230121460A1

公开(公告)日：2023-04-20

申请号：US18047774

申请日：2022-10-19

Applicant: NetApp, Inc.

Inventor： Arindam Banerjee ,  Daniel McCarthy ,  Christopher Cason ,  Ananthan Subramanian

IPC: G06F16/27

Abstract: Systems and methods for scaling application and/or storage system functions of a distributed storage system based on a heterogeneous resource pool are provided. According to one embodiment, the distributed storage system has a composable, service-based architecture that provides scalability, resiliency, and load balancing. The distributed storage system includes a cluster of nodes each potentially having differing capabilities in terms of processing, memory, and/or storage. The distributed storage system takes advantage of different types of nodes by selectively instating appropriate services (e.g., file and volume services and/or block and storage management services) on the nodes based on their respective capabilities. Furthermore, disaggregation of these services, facilitated by interposing a frictionless layer (e.g., in the form of one or more globally accessible logical disks) therebetween, enables independent and on-demand scaling of either or both of application and storage system functions within the cluster while making use of the heterogeneous resource pool.

公开(公告)号：US11627097B2

公开(公告)日：2023-04-11

申请号：US17187336

申请日：2021-02-26

Applicant: NetApp, Inc.

Inventor： Austino Longo ,  Christopher Cason ,  Daniel McCarthy

IPC: H04L47/80 ,  H04L43/0876 ,  H04L67/1097 ,  H04L67/125

Abstract: Systems and methods for quality of service management are provided. According to one embodiment, a non-transitory computer-readable medium comprises instructions that when executed by the processing resource cause the processing resource to receive, in a normalizing agent, one or more compute load parameters from one or more background compute processes executing on the one or more computer systems and one or more Quality of Service (QoS) parameters for one or more client compute processes executing on the one or more computer systems, convert the one or more compute load parameters to one or more normalized utilization metrics, and execute instructions that cause a processor to adjust a compute resource allocation dedicated to the one or more background compute processes based at least in part on the one or more normalized utilization metrics and the one or more QoS parameters.

公开(公告)号：US20220391359A1

公开(公告)日：2022-12-08

申请号：US17449758

申请日：2021-10-01

Applicant: NetApp, Inc.

Inventor： Ravikanth Dronamraju ,  Ananthan Subramanian ,  Daniel McCarthy ,  Christopher Cason ,  Arindam Banerjee

IPC: G06F16/188 ,  G06F16/182 ,  G06F9/50

Abstract: A distributed storage management system comprising nodes that form a cluster, a distributed block layer that spans the nodes in the cluster, and file system instances deployed on the nodes. Each file system instance comprises a data management subsystem and a storage management subsystem disaggregated from the data management subsystem. The storage management subsystem comprises a node block store that forms a portion of the distributed block layer and a storage manager that manages a key-value store and virtualized storage supporting the node block store. A file system volume hosted by the data management subsystem maps to a logical block device hosted by the virtualized storage in the storage management subsystem. The key-value store includes, for a data block of the logical block device, a key that comprises a block identifier for the logical block device and a value that comprises the data block.

公开(公告)号：US20170364704A1

公开(公告)日：2017-12-21

申请号：US15186787

申请日：2016-06-20

Applicant: NETAPP, INC.

Inventor： David D. Wright ,  Daniel McCarthy

IPC: G06F21/62 ,  G06F21/60 ,  H04L9/06

CPC classification number: G06F21/6227 ,  G06F21/602 ,  H04L9/3239 ,  H04L2209/30

Abstract: A server node with one or more processors is configured to receive a request to write data to a storage medium and compress the data to yield compressed data. The one or more processors are further configured to encrypt the compressed data according to an encryption key to yield compressed and encrypted data. The one or more processors are further configured to hash the compressed and encrypted data to yield one or more block identifiers that uniquely represent the compressed and encrypted data.

公开(公告)号：US20250047575A1

公开(公告)日：2025-02-06

申请号：US18921168

申请日：2024-10-21

Applicant: NetApp, Inc.

Inventor： Abdul Basit ,  Daniel McCarthy ,  Christopher Lee Cason ,  Jian Hu

IPC: H04L41/5067 ,  G06F9/50

Abstract: Techniques are provided for dynamically implementing quality of service policies using a configurable quality of service provider pipeline. A quality of service policy is defined for throttling I/O operations received by a node based upon whether resources of the node have become over utilized. The quality of service policy is used to dynamically construct a quality of service provider pipeline with select quality of service providers that improve the ability to efficiently utilize resources compared to conventional static polices that cannot adequately react to changing considerations and resource utilization/saturation. With conventional static policies, an administrator manually defines a minimum amount of guaranteed resources and/or a maximum resource usage cap that could be set to values that result in inefficient operation and resource starvation. Dynamically constructing and utilizing the quality of service provider pipeline results in more efficient operation and mitigates resource starvation.

公开(公告)号：US20250013614A1

公开(公告)日：2025-01-09

申请号：US18780353

申请日：2024-07-22

Applicant: NetApp, Inc.

Inventor： Ravikanth Dronamraju ,  Ananthan Subramanian ,  Daniel McCarthy ,  Christopher Cason ,  Arindam Banerjee

IPC: G06F16/188 ,  G06F9/50 ,  G06F16/182

Abstract: A distributed storage management system comprising nodes that form a cluster, a distributed block layer that spans the nodes in the cluster, and file system instances deployed on the nodes. Each file system instance comprises a data management subsystem and a storage management subsystem disaggregated from the data management subsystem. The storage management subsystem comprises a node block store that forms a portion of the distributed block layer and a storage manager that manages a key-value store and virtualized storage supporting the node block store. A file system volume hosted by the data management subsystem maps to a logical block device hosted by the virtualized storage in the storage management subsystem. The key-value store includes, for a data block of the logical block device, a key that comprises a block identifier for the logical block device and a value that comprises the data block.