Proportional quality of service based on client usage and system metrics

    公开(公告)号:US12250129B2

    公开(公告)日:2025-03-11

    申请号:US17549417

    申请日:2021-12-13

    Applicant: NetApp, Inc.

    Abstract: Examples described herein are generally directed to providing a fair amount of throughput to multiple clients of a storage system. According to one example, the storage system determines system metrics based upon use of the storage system by the clients. A system load value is calculated based upon the system metrics. The system load value quantifies a load on the storage system by the clients. Client loads, each representing a contribution to the use of the storage system by an individual client, are calculated and expressed as a relative degree or amount of the system load value. A target performance value for a client is calculated based on the client load for the client and a quality of service parameter value provisioned for the client to access the storage system. Based on the target performance value, latency for the client is introduced or removed.

    Maintaining and recomputing reference counts in a persistent memory file system

    公开(公告)号:US12248376B2

    公开(公告)日:2025-03-11

    申请号:US18623387

    申请日:2024-04-01

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for maintaining and recomputing reference counts in a persistent memory file system of a node. Primary reference counts are maintained for pages within persistent memory of the node. In response to receiving a first operation to link a page into a persistent memory file system of the persistent memory, a primary reference count of the page is incremented before linking the page into the persistent memory file system. In response to receiving a second operation to unlink the page from the persistent memory file system, the page is unlinked from the persistent memory file system before the primary reference count is decremented. Upon the node recovering from a crash, the persistent memory file system is traversed in order to update shadow reference counts for the pages with correct reference count values, which are used to overwrite the primary reference counts with the correct reference count values.

    Distributed File System with Reduced Write and Read Latencies

    公开(公告)号:US20250068600A1

    公开(公告)日:2025-02-27

    申请号:US18942186

    申请日:2024-11-08

    Applicant: NetApp, Inc.

    Abstract: A method for reducing write latency in a distributed file system. A write request that includes a volume identifier is received at a data management subsystem deployed on a node within a distributed storage system. The data management subsystem maps the volume identifier to a file system volume and maps the file system volume to a set of logical block addresses in a logical block device in a storage management subsystem deployed on the node. The storage management subsystem maps the logical block device to a metadata object for the logical block device on the node that is used to process the write request. The mapping of the file system volume to the set of logical block addresses in the logical block device enables co-locating the metadata object with the file system volume on the node, which reduces the write latency associated with processing the write request.

    Community generation based on a common set of attributes

    公开(公告)号:US12235904B2

    公开(公告)日:2025-02-25

    申请号:US17901628

    申请日:2022-09-01

    Applicant: NETAPP, INC.

    Abstract: A system, method, and machine-readable storage medium for forming a community based on a common set of attributes are provided. In some embodiments, the method includes creating a list of entities associated with a plurality of users, each entity included in the list of entities being accessed by a user of the plurality of users. The method also includes identifying a first entity accessed by a group of users of the plurality of users. The method further includes determining a first set of entities accessed by each user of the group of users, the first set of entities being included in the list of entities. The method also includes removing the first entity and the first set of entities from the list of entities. The method further includes forming a first community including the group of users, the first entity, and the first set of entities.

    Proactively taking action responsive to events within a cluster based on a range of normal behavior learned for various user roles

    公开(公告)号:US12231449B2

    公开(公告)日:2025-02-18

    申请号:US17727538

    申请日:2022-04-22

    Applicant: NetApp, Inc.

    Inventor: Tyler W. Cady

    Abstract: Systems and methods are provided for learning normal behavior for user roles of an application running within a cluster of container orchestration platform and based thereon proactively taking action responsive to suspicious events. According to one embodiment, an event data stream is created by an API server of the cluster. The data for each event includes information regarding a request made to an API exposed by the API server with which the event is associated and a user of the application by which the event was initiated. The data is augmented with a role associated with the user and an anomaly threshold for the role. Normal behavior is learned by an ML algorithm of respective user roles by processing the augmented data. When an anomaly score associated with a particular event is output by the ML algorithm that exceeds the anomaly threshold, a predefined or configurable action is triggered.

    Rebalancing engine for use in rebalancing files in a distributed storage systems

    公开(公告)号:US12229084B2

    公开(公告)日:2025-02-18

    申请号:US18194860

    申请日:2023-04-03

    Applicant: NetApp, Inc.

    Abstract: Redistribution of files in a containerized distributed file system is disclosed. Containers each have an engine and a scanner and each of the containers stores files and parameters for characteristics of files stored on the container. A first engine in a first container monitors characteristics of files stored on the first container and, responsive to determining that the parameters for files on the first container exceed one or more predetermined thresholds, communicates with a second engine in a second container to determine a destination container for one or more files from the first container. The second engine in the second container indicates to the first engine in the first container whether the second container is available to receive one or more files from the first container. The first engine triggers file system scanning by the scanner of the first container to identify files to be moved to the second container.

    Flexible tiering of snapshots to archival storage in remote object stores

    公开(公告)号:US12229082B2

    公开(公告)日:2025-02-18

    申请号:US18366053

    申请日:2023-08-07

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for tiering snapshots to archival storage in remote object stores. A restore time metric, indicating that objects comprising snapshot data of snapshots created within a threshold timespan are to be available within a storage tier of a remote object store for performing restore operations, may be identified. A scanner may be executed to evaluate snapshots using the restore time metric to identify a set of candidate snapshots for archival from the storage tier to an archival storage tier of the remote object store. For each candidate snapshot within the set of candidate snapshots, the scanner may evaluate metadata associated with the candidate snapshot to identity one or more objects eligible for archival from the storage tier to the archival storage tier, and may archive the one or more objects from the storage tier to the archival storage tier.

    AUTOMATED TUNING OF A QUALITY OF SERVICE SETTING FOR A DISTRIBUTED STORAGE SYSTEM BASED ON INTERNAL MONITORING

    公开(公告)号:US20250053303A1

    公开(公告)日:2025-02-13

    申请号:US18929400

    申请日:2024-10-28

    Applicant: NetApp, Inc.

    Abstract: Systems and methods for automated tuning of Quality of Service (QoS) settings of volumes in a distributed storage system are provided. According to one embodiment, one or more characteristics of a workload of a client to which a storage node of multiple storage nodes of the distributed storage system is exposed are monitored. After a determination has been made that a characteristic meets or exceeds a threshold, (i) information regarding multiple QoS settings assigned to a volume of the storage node utilized by the client is obtained, (ii) a new value of a burst IOPS setting of the multiple QoS settings is calculated by increasing a current value of the burst IOPS setting by a factor dependent upon a first and a second QoS setting of the multiple QoS settings, and (iii) the new value of the burst IOPS setting is assigned to the volume for the client.

    PRESERVING STORAGE EFFICIENCY DURING RESTORATION OF DATA FROM THE CLOUD TO A DATA STORAGE SYSTEM

    公开(公告)号:US20250045168A1

    公开(公告)日:2025-02-06

    申请号:US18923440

    申请日:2024-10-22

    Applicant: NetApp, Inc.

    Abstract: Systems and methods for preserving storage efficiency during restoration of data from the cloud are provided. In one embodiment, a CBMAP is maintained that maps cloud block numbers (CBNs) to respective corresponding block numbers of a volume of a data storage system in which previously restored data has been stored by a previously restored file. By making use of the CBMAP during the restoration process, storage of duplicate file data blocks on the volume may be avoided by sharing with a current file being restored a reference to the corresponding file data block previously stored on the volume and associated with the previously restored file. In addition to preserving storage efficiency, use of the CBMAP facilitates avoidance of repeated GET operations for data associated with CBNs previously retrieved from the cloud and stored to the volume, thereby reducing data access costs as well as latency of the restore operation.

Patent Agency Ranking