Quality of service for cloud based storage system using a workload identifier

    公开(公告)号:US12141603B2

    公开(公告)日:2024-11-12

    申请号:US17389987

    申请日:2021-07-30

    Applicant: NETAPP, INC.

    Abstract: Methods and systems for providing Quality of Service (QoS) in a cloud-based system are provided. One method includes assigning, by a micro-service, a workload identifier to a cloud volume created by a storage operating system in a cloud-based system; mapping, by the micro-service, the workload identifier to a volume identifier, the volume identifier generated by the storage operating system to identify the cloud volume; associating, by the micro-service, a policy with the cloud volume for providing QoS for the cloud volume; determining, by the micro-service, the workload identifier for the cloud volume from the volume identifier included in a request to store or retrieve data using the cloud volume; and assigning, by the micro-service, the workload identifier to a processing thread deployed by the storage operating system to process the request.

    Distributed File System that Provides Scalability and Resiliency

    公开(公告)号:US20240370410A1

    公开(公告)日:2024-11-07

    申请号:US18773483

    申请日:2024-07-15

    Applicant: NetApp, Inc.

    Abstract: In various examples, data storage is managed using a distributed storage management system that is resilient. Data blocks of a logical block device may be distributed across multiple nodes in a cluster. The logical block device may correspond to a file system volume associated with a file system instance deployed on a selected node within a distributed block layer of a distributed file system. Each data block may have a location in the cluster identified by a block identifier associated with each data block. Each data block may be replicated on at least one other node in the cluster. A metadata object corresponding to a logical block device that maps to the file system volume may be replicated on at least another node in the cluster. Each data block and the metadata object may be hosted on virtualized storage that is protected using redundant array independent disks (RAID).

    Scalable solid-state storage system and methods thereof

    公开(公告)号:US12135905B2

    公开(公告)日:2024-11-05

    申请号:US18474988

    申请日:2023-09-26

    Applicant: NETAPP, INC.

    Abstract: Methods and systems for solid state drives are provided, including assigning a first namespace to a first instance of a storage operating system and a second instance of the storage operating system for enabling read access to a first portion of a flash storage system by the first instance, and read and write access to the second instance; allocating a second namespace to the first instance for exclusive read and write access within a second portion of the flash storage system; generating, by the first instance, a request for the second instance to transfer a data object from the second portion owned by the first instance to the first portion; storing, by the second instance, the data object at the first portion; and updating metadata of the data object at the second portion, the metadata indicating a storage location at the second portion where the data object is stored.

    Workload analysis for long-term management via performance service levels

    公开(公告)号:US12135877B2

    公开(公告)日:2024-11-05

    申请号:US17241887

    申请日:2021-04-27

    Applicant: NetApp, Inc.

    Abstract: Systems, methods, and machine-readable media for monitoring a storage system and assigning performance service levels to workloads running on nodes within a cluster are disclosed. A performance manager may estimate the performance demands of each workload within the cluster and assign a performance service level to each workload according to the performance requirements of the workload, and further taking into account an overall budgeting framework. The estimates are performed using historical performance data for each workload. A performance service level may include a service level object, a service level agreement, and latency parameters. These parameters may provide a ceiling to the number of operations per second that a workload may use without guaranteeing the use of the operations per second, a guaranteed number of operations per second that a workload may use before being throttled, and define the permitted delay in completing a request to the workload.

    Acceleration Of Data Transmission Between Producers And Consumers Of A Distributed-Clustered Application

    公开(公告)号:US20240362182A1

    公开(公告)日:2024-10-31

    申请号:US18308876

    申请日:2023-04-28

    Applicant: NetApp, Inc.

    CPC classification number: G06F16/122 G06F16/183

    Abstract: The technology disclosed herein enables accelerated data transmission between producers and consumers. In a particular example, a method includes receiving a first request from a producer-connector component of a producer component to store a payload to a storage repository. In response to the first request, the method includes providing a unique identifier to the connector component. The connector component provides the unique identifier to the distributed-clustered application. The method further includes storing the payload in association with the unique identifier to the storage repository. The method also includes retrieving the payload from the storage repository using the unique identifier to identify the payload in the storage repository. The method includes receiving a second request from a consumer-connector component of the consumer component to retrieve the payload. In response to the second request, the method includes supplying the payload to the consumer component.

    MIRRORING OBJECTS BETWEEN DIFFERENT CLOUD PROVIDERS WITH DIFFERENT DATA LAYOUT REQUIREMENTS

    公开(公告)号:US20240362124A1

    公开(公告)日:2024-10-31

    申请号:US18308337

    申请日:2023-04-27

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for mirroring objects between object stores hosted by cloud providers that have different data layout requirements. An object may be stored within a first object store that supports a fix offset format where uncompressed data is stored according to fixed offsets and boundaries within fixed size objects. A mirroring operation may be used to mirror the object to a second object store that supports a unified object format where compressed data can be stored at non-fixed offsets and boundaries within variable sized objects. The mirroring operation selects a compression algorithm and compresses the object on the fly to create a mirrored object having the unified object format. The mirrored object, populated with the compressed data and slot header metadata comprising compression information for how to locate and decompress the data in the mirrored object, is stored into the second object store.

    READ ACCESS DURING CLONE VOLUME SPLIT OPERATION

    公开(公告)号:US20240361944A1

    公开(公告)日:2024-10-31

    申请号:US18308704

    申请日:2023-04-28

    Applicant: NetApp Inc.

    CPC classification number: G06F3/065 G06F3/0619 G06F3/0659 G06F3/0673

    Abstract: Techniques are provided for processing read operations while splitting a clone volume from a parent volume whose data is stored within objects of an object store. A transfer map is created to track mappings of child object identifiers to parent object identifiers of the parent objects to copy as child objects having the child object identifiers. The transfer map for the object store is traversed to copy the parent objects as the child objects for the split clone operation. The child objects are verified as being successfully created with valid data. In response to determining that the parent object has been copied as the child object, a context check is performed using the reverse map to verify a block within the child object. In response a successful context check, the read operation is processed using the block of the child object.

    DYNAMIC QUALITY OF SERVICE IMPLEMENTATION BASED UPON RESOURCE SATURATION

    公开(公告)号:US20240361912A1

    公开(公告)日:2024-10-31

    申请号:US18307097

    申请日:2023-04-26

    Applicant: NetApp Inc.

    CPC classification number: G06F3/0613 G06F3/0659 G06F3/0683

    Abstract: Techniques are provided for dynamically implementing quality of service policies for a distributed storage system based upon resources saturation. A quality of service policy is defined for throttling I/O operations received by a node of the distributed storage system based upon whether resources of the node have become saturated. The quality of service policy is dynamically implemented based upon ever changing resource utilization and saturation. Dynamically implementing the quality of service policy improves the ability to efficiently utilize resources of the node compared to conventional static polices that cannot adequately react to such changing considerations and resource utilization/saturation. With conventional static policies, an administrator manually defines a minimum amount of guaranteed resources and/or a maximum resource usage cap that could be set to values that result in inefficient operation and resource starvation. Dynamically implementing the quality of service policy results in more efficient operation and mitigates resource starvation.

    PRESERVING STORAGE EFFICIENCY DURING RESTORATION OF DATA FROM THE CLOUD TO A DATA STORAGE SYSTEM

    公开(公告)号:US20240354198A1

    公开(公告)日:2024-10-24

    申请号:US18304583

    申请日:2023-04-21

    Applicant: NetApp, Inc.

    CPC classification number: G06F11/1451

    Abstract: Systems and methods for preserving storage efficiency during restoration of data from the cloud are provided. In one embodiment, a CBMAP is maintained that maps cloud block numbers (CBNs) to respective corresponding block numbers of a volume of a data storage system in which previously restored data has been stored by a previously restored file. By making use of the CBMAP during the restoration process, storage of duplicate file data blocks on the volume may be avoided by sharing with a current file being restored a reference to the corresponding file data block previously stored on the volume and associated with the previously restored file. In addition to preserving storage efficiency, use of the CBMAP facilitates avoidance of repeated GET operations for data associated with CBNs previously retrieved from the cloud and stored to the volume, thereby reducing data access costs as well as latency of the restore operation.

Patent Agency Ranking