Synchronous object placement for information lifecycle management

    公开(公告)号:US11531642B2

    公开(公告)日:2022-12-20

    申请号:US16677565

    申请日:2019-11-07

    Applicant: NetApp, Inc.

    Abstract: A distributed storage system may synchronously apply an Information Lifecycle Management (ILM) policy to objects at ingest. In one embodiment of synchronous ILM, three options are available for a user: balanced, strict, and dual commit. Dual commit refers to the behavior where one will always create two replicated copies in the same site and then apply ILM asynchronously. Strict refers to the behavior where the storage system attempts to apply the ILM policy synchronously on ingest, and if the storage system cannot the ingest of the object will fail. This ensures that the storage system can guarantee that ILM has been applied to recently ingested objects. Balanced refers to the behavior where the storage system attempts to apply ILM synchronously, but if the storage system cannot the storage system may fall-back to dual-commit.

    Methods and systems for self-healing in connected computing environments

    公开(公告)号:US11531583B2

    公开(公告)日:2022-12-20

    申请号:US17525161

    申请日:2021-11-12

    Applicant: NETAPP, INC.

    Inventor: Kausik Ghatak

    Abstract: Methods and systems for networked systems are provided. A reinforcement learning (RL) agent is deployed during runtime of a networked system having at least a first component and a second component. The RL agent detects a first degradation signal in response to an error associated with the first component and a second degradation signal from the second component, the second degradation signal generated in response to the error. The RL agent identifies from a learned data structure an action for fixing degradation, at both the first component and the second component; and continues to update the learned data structure, upon successful and unsuccessful attempts to fix degradation associated with the first component and the second component.

    Distributed File System with Reduced Write and Read Latencies

    公开(公告)号:US20220391361A1

    公开(公告)日:2022-12-08

    申请号:US17449760

    申请日:2021-10-01

    Applicant: NetApp, Inc.

    Abstract: A method for reducing write latency in a distributed file system. A write request that includes a volume identifier is received at a data management subsystem deployed on a node within a distributed storage system. The data management subsystem maps the volume identifier to a file system volume and maps the file system volume to a set of logical block addresses in a logical block device in a storage management subsystem deployed on the node. The storage management subsystem maps the logical block device to a metadata object for the logical block device on the node that is used to process the write request. The mapping of the file system volume to the set of logical block addresses in the logical block device enables co-locating the metadata object with the file system volume on the node, which reduces the write latency associated with processing the write request.

    Hierarchical consistency group for storage and associated methods thereof

    公开(公告)号:US11520490B2

    公开(公告)日:2022-12-06

    申请号:US17218520

    申请日:2021-03-31

    Applicant: NETAPP, INC.

    Abstract: Methods and systems for using a hierarchical consistency group (CG) in a storage system are provided. A parent CG is associated with at least a first child CG having a plurality of storage volumes. An atomic application programming interface (API) provisions the parent CG and the first child CG by allocating storage and storing policies for the parent CG and the first CG. A storage service selected from a backup service, a replication service and a cloning service for the parent CG and the first CG is executed based on the stored policies.

    Methods and systems for managing networked storage system resources

    公开(公告)号:US11500750B2

    公开(公告)日:2022-11-15

    申请号:US16562713

    申请日:2019-09-06

    Applicant: NetApp Inc.

    Abstract: Methods and systems for a networked storage environment are provided. One method includes maintaining by a processor of a management console, a plurality of structured objects representing a plurality of resources in a networked storage system for storing and retrieving client data from a plurality of storage devices; receiving by the processor unstructured data from an application programming interface (API) associated with a resource of the networked storage system; parsing by the processor, the unstructured data and generating an identifier hash value based on uniquely identifying fields of the unstructured data for an unstructured object; and generating by the processor a logical index with a configuration index and a performance index for the unstructured object identified by the identifier hash value for responding to user requests for performance information regarding the unstructured object.

    USAGE OF OP LOGS TO SYNCHRONIZE ACROSS PRIMARY AND SECONDARY STORAGE CLUSTERS OF A CROSS-SITE DISTRIBUTED STORAGE SYSTEM AND LIGHTWEIGHT OP LOGGING

    公开(公告)号:US20220357854A1

    公开(公告)日:2022-11-10

    申请号:US17510788

    申请日:2021-10-26

    Applicant: NetApp, Inc.

    Abstract: In one embodiment, a method comprises maintaining state information regarding a data synchronous replication status for a storage object of a primary storage cluster and a replicated storage object of a secondary storage cluster. The method includes temporarily disallowing input/output (I/O) operations for the storage object when the storage object of the primary storage cluster has a failure, which causes an internal state as out of sync for the storage object while maintaining an external state as in sync for external entities. The method performs persistent inflight tracking and reconciliation of I/O operations with a first Op log of the primary storage cluster and a second Op log of the secondary storage cluster and performs a resynchronization between the storage object and the replicated storage object based on the persistent inflight tracking and reconciliation of I/O operations.

    UNIVERSAL RETURN TO FACTORY IMAGE PROCESS

    公开(公告)号:US20220350584A1

    公开(公告)日:2022-11-03

    申请号:US17243974

    申请日:2021-04-29

    Applicant: NetApp,Inc.

    Abstract: Systems and methods for file system management are provided. According to one embodiment, a non-transitory computer-readable medium comprises instructions that when executed by the processing resource cause the processing resource to implement, in a storage node, a multi-tiered file system comprising a read-only layer that contains a base configuration for the storage node and a read-write layer that contains modifications to the base configuration; and combine the read-only layer and the read-write layer into an overlay file system to be presented to an operating system.

    CLOUD BASED INTERFACE FOR PROTECTING AND MANAGING DATA STORED IN NETWORKED STORAGE SYSTEMS

    公开(公告)号:US20220350496A1

    公开(公告)日:2022-11-03

    申请号:US17242816

    申请日:2021-04-28

    Applicant: NETAPP, INC.

    Abstract: Methods and systems for managing storage is provided. One method includes initializing, a storage service user interface (“SSUI”) within a cloud manager user interface (“CMUI”), the SSUI enables a storage service operation selected from a backup operation, a restore operation and a cloning operation associated with a storage object stored at a cloud volume presented by a cloud layer, the CMUI presented by a cloud provider; transmitting, by the SSUI, an authorization token to a Software As a Service (“SaaS”) layer for authenticating deployment of the SSUI; upon validating the authorization token, initializing a SSUI agent to interface with a deployed storage micro-service layer offered by the cloud layer to execute the storage service operation; transmitting, by the SSUI, an application programming interface (API) request for the SSUI agent for executing the storage service operation; and executing, by the deployed storage micro-service layer, the storage service operation.

    Mediator assisted switchover between clusters

    公开(公告)号:US11487635B2

    公开(公告)日:2022-11-01

    申请号:US17160706

    申请日:2021-01-28

    Applicant: NetApp inc.

    Abstract: Techniques are provided for metadata management for enabling automated switchover. An initial quorum vote may be performed before a node executes an operation associated with metadata comprising operational information and switchover information. After the initial quorum vote is performed, the node executes the operation upon one or more mailbox storage devices. Once the operation has executed, a final quorum vote is performed. The final quorum vote and the initial quorum vote are compared to determine whether the operation is to be designated as successful or failed, and whether any additional actions are to be performed.

    AUTOMATICALLY TUNING A QUALITY OF SERVICE SETTING FOR A DISTRIBUTED STORAGE SYSTEM WITH A DEEP REINFORCEMENT LEARNING AGENT

    公开(公告)号:US20220342592A1

    公开(公告)日:2022-10-27

    申请号:US17841903

    申请日:2022-06-16

    Applicant: NetApp, Inc.

    Inventor: Tyler W. Cady

    Abstract: Systems and methods are described for using a Deep Reinforcement Learning (DRL) agent to automatically tune Quality of Service (QoS) settings of a distributed storage system (DSS). According to one embodiment, a DRL agent is trained in a simulated environment to select QoS settings (e.g., a value of one or more of a minimum IOPS parameter, a maximum IOPS parameter, and a burst IOPS parameter). The training may involve placing the DRL agent into every feasible state representing combinations of QoS settings, workload conditions, and system metrics for a period of time for multiple iterations, and rewarding the DRL agent for selecting QoS settings that minimize an objective function based on a selected measure of system load. The trained DRL agent may then be deployed to one or more DSSs to constantly update QoS settings so as to minimize the selected measure of system load.

Patent Agency Ranking