LOW OVERHEAD RESYNCHRONIZATION SNAPSHOT CREATION AND UTILIZATION

    公开(公告)号:US20250053316A1

    公开(公告)日:2025-02-13

    申请号:US18810870

    申请日:2024-08-21

    Applicant: NetApp, Inc.

    Abstract: One or more techniques and/or computing devices are provided for resynchronization. For example, a request may be received to create pseudo snapshots of a first consistency group, hosted by a first storage controller, and a second consistency group, hosted by a second storage controller, having a synchronous replication relationship with the first consistency group. Incoming client write requests are logged within an intercept tracking log at the first storage controller. After a first drain without hold of incoming write requests is performed, a first pseudo common snapshot of the second consistency group is created. After a second drain without hold of incoming write operations is performed, a second pseudo common snapshot of the first consistency group and the intercept tracking log is created. The pseudo snapshots and the intercept tracking log (e.g., indicating a delta between the pseudo snapshots) are used to resynchronize the first and second consistency groups.

    Cost-effective, failure-aware resource allocation and reservation in the cloud

    公开(公告)号:US12222827B2

    公开(公告)日:2025-02-11

    申请号:US17898824

    申请日:2022-08-30

    Applicant: NetApp, Inc.

    Abstract: Systems and methods for an improved High-Availability (HA) resource reservation approach are provided. According to one embodiment, for a given cluster of greater than two nodes in which a number (f) of concurrent node failures are to be tolerated, more efficient utilization of resources for an HA system may be achieved by distributing HA reserved capacity across more than f nodes of the cluster rather than naively concentrating the HA reserved capacity in f nodes. As node failures are not a common occurrence, those of the nodes of the cluster having HA reserved capacity may allow for some bursting of one or more units of compute executing thereon unless or until f concurrent node failures occur, thereby promoting more efficient utilization of node resources.

    Data Storage System Drive Utilization

    公开(公告)号:US20250045163A1

    公开(公告)日:2025-02-06

    申请号:US18799034

    申请日:2024-08-09

    Applicant: NetApp, Inc.

    Abstract: One or more systems, devices, computer program products, and/or computer-implemented methods provided herein to use a redundant array of disks. A system can comprise a memory that stores computer executable components, and a processor that executes the computer executable components stored in the memory, wherein the computer executable components can comprise a control component that directs, for n physical drives of a redundant array of disks (RAID) storing data for at least n logical volumes, log-structured writing of data of each logical volume of the at least n logical volumes vertically across chunks of only a single physical drive of the n physical drives, wherein the control component further directs writing of parity data at each of the physical drives, which parity data at each physical drive of the subset respectively corresponds to other ones of the physical drives of the n physical drives.

    Quality of service management mechanism

    公开(公告)号:US12210747B2

    公开(公告)日:2025-01-28

    申请号:US17218217

    申请日:2021-03-31

    Applicant: NetApp, Inc.

    Abstract: A system is described. The system includes a processing resource and a non-transitory computer-readable medium, coupled to the processing resource, having stored therein instructions that when executed by the processing resource cause the processing resource to receive a plurality of quality of service (QoS) parameters and client preferences from a client device and manage a QoS policy based on a plurality of QoS objectives included in the received QoS parameters, wherein the plurality of QoS objectives comprise input output operations per second (IOPS), throughput and latency.

    Automatically tuning a quality of service setting for a distributed storage system with a deep reinforcement learning agent

    公开(公告)号:US12204791B2

    公开(公告)日:2025-01-21

    申请号:US18364199

    申请日:2023-08-02

    Applicant: NetApp, Inc.

    Inventor: Tyler W. Cady

    Abstract: Systems and methods are described for using a Deep Reinforcement Learning (DRL) agent to automatically tune Quality of Service (QoS) settings of a distributed storage system (DSS). According to one embodiment, a DRL agent is trained in a simulated environment to select QoS settings (e.g., a value of one or more of a minimum IOPS parameter, a maximum IOPS parameter, and a burst IOPS parameter). The training may involve placing the DRL agent into every feasible state representing combinations of QoS settings, workload conditions, and system metrics for a period of time for multiple iterations, and rewarding the DRL agent for selecting QoS settings that minimize an objective function based on a selected measure of system load. The trained DRL agent may then be deployed to one or more DSSs to constantly update QoS settings so as to minimize the selected measure of system load.

    Zero-copy volume move within a distributed storage system

    公开(公告)号:US12204784B1

    公开(公告)日:2025-01-21

    申请号:US18649906

    申请日:2024-04-29

    Applicant: NetApp, Inc.

    Abstract: Systems and methods for performing a zero-copy volume move between nodes of a distributed storage system are provided. In one example, an approach for performing a zero-copy volume move is proposed in which volume data may be maintained in place within a storage pod and need not be copied to move a given volume between the source node and the destination node. In one embodiment, metadata (e.g., a top-most physical volume block number (PVBN) of a node tree representing the volume at issue) of a write-anywhere file system is copied from the source node to the destination node. Since the storage pod is associated with a global PVBN space that is visible and accessible to all nodes of the distributed storage system, as a result of copying the top-mode PVBN of the volume to the destination node, anything below the top-most PVBN will automatically be visible to the destination node.

    Efficient parity determination in zoned solid-state drives of a storage system

    公开(公告)号:US12204403B2

    公开(公告)日:2025-01-21

    申请号:US18377441

    申请日:2023-10-06

    Applicant: NETAPP, INC.

    Abstract: Methods and systems for a storage environment are provided. One method includes copying a data unit from a first temporary storage location corresponding to each zoned solid-state drive (ZNS SSD) of a first ZNS SSD set of a storage system to a first XOR module, while determining a first partial horizontal parity using the data unit stored in the first temporary storage location; and determining a vertical parity for each ZNS SSD of the first ZNS SSD set using the data unit provided to the first XOR module in a current cycle and vertical parity determined from a previous cycle.

    Managing Volume Snapshots in the Cloud

    公开(公告)号:US20250004986A1

    公开(公告)日:2025-01-02

    申请号:US18432243

    申请日:2024-02-05

    Applicant: NetApp, Inc.

    Abstract: Systems, methods, and machine-readable media for creating, deleting, and restoring volume snapshots in a remote data store are disclosed. A storage volume and a storage operating system are implemented in a software container. Through a user interface, a user may create a snapshot of the volume to a cloud storage. A user may also delete individual snapshots from the cloud storage. Further, deletion of a most recent snapshot may occur by awaiting deletion (though marking as deleted to the user) until a next snapshot is received. Snapshots in the cloud storage are manipulatable even after destruction of the source volume (by destruction of the container, for example). A controller outside the container is used by implementing the same API as the controller in the container had. Full restores of snapshots in the cloud are also possible even when the original container and volume have been destroyed.

    RECOVERY MECHANISM WITH SELECTIVE ORDERING AND CONCURRENT OPERATIONS

    公开(公告)号:US20250004887A1

    公开(公告)日:2025-01-02

    申请号:US18828089

    申请日:2024-09-09

    Applicant: NetApp, Inc.

    Abstract: Techniques are provided for a recovery process with selective ordering and concurrent operations in order to recover from a failure. Representations of active log structures are rebuilt within memory according to ordering values assigned to I/O operations logged within the active log structures. Representation of certain active log structures may be concurrently rebuilt based upon the active log structures comprising I/O operations that are non-overlapping within a distributed file system, have no dependencies, relate to different services, and/or target independent files. Representation of stale log structures are concurrently rebuilt within memory. While rebuilding the log structures and executing the I/O operations, a key value map is concurrently rebuilt within the memory for locating data of the I/O operations. Concurrent operations during the recovery process reduces the time to complete the recovery process, and thus reduces client downtime during the recovery process.

    LOCK RESERVATIONS FOR SHARED STORAGE

    公开(公告)号:US20250004665A1

    公开(公告)日:2025-01-02

    申请号:US18344948

    申请日:2023-06-30

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for lock reservations for shared storage. A reserve command to reserve a storage structure is received by a driver from a node. The reserve command is formatted according to a storage protocol. The driver translates the reserve command into a lease acquire command formatted according to an object store protocol and targeting an object stored within an object store and corresponding to the storage structure. A lease identifier derived from a node identifier of the node is inserted into the lease acquire command. The lease acquire command is routed to the object store for obtaining a lease on the object for granting the node exclusive write access to the object.

Patent Agency Ranking