Balanced, Opportunistic Multicore I/O Scheduling From Non-SMP Applications

    公开(公告)号:US20180113738A1

    公开(公告)日:2018-04-26

    申请号:US15497744

    申请日:2017-04-26

    Applicant: NETAPP, INC.

    CPC classification number: G06F9/5027

    Abstract: A system for dynamically configuring and scheduling input/output (I/O) workloads among processing cores is disclosed. Resources for an application that are related to each other and/or not multicore safe are grouped together into work nodes. When these need to be executed, the work nodes are added to a global queue that is accessible by all of the processing cores. Any processing core that becomes available can pull and process the next available work node through to completion, so that the work associated with that work node software object is all completed by the same core, without requiring additional protections for resources that are not multicore safe. Indexes track the location of both the next work node in the global queue for processing and the next location in the global queue for new work nodes to be added for subsequent processing.

    Methods and systems for offloading RAID parity reconstruction

    公开(公告)号:US09940196B2

    公开(公告)日:2018-04-10

    申请号:US15135265

    申请日:2016-04-21

    Applicant: NETAPP, INC.

    CPC classification number: G06F11/1088

    Abstract: Methods and systems for a storage environment are provided. For example, one method includes receiving a request from a storage server at an offload engine for reconstructing data lost due to a failed storage device of a parity group having a plurality of storage devices; retrieving data and parity by the offload engine from the parity group storage devices that are operational; determining by the offload engine XOR of the retrieved data and parity; presenting XOR of data and parity by the offload engine to the storage server with context information associated with the retrieved data; and reconstructing lost data by the storage server using the XOR of data and parity and the context information provided by the offload engine.

    CLUSTER CONFIGURATION INFORMATION REPLICATION
    334.
    发明申请

    公开(公告)号:US20180095671A1

    公开(公告)日:2018-04-05

    申请号:US15820910

    申请日:2017-11-22

    Applicant: NetApp Inc.

    CPC classification number: G06F3/067 G06F3/0617 G06F3/0629

    Abstract: One or more techniques and/or systems are provided for cluster configuration information replication, managing cluster-wide service agents, and/or for cluster-wide outage detection. In an example of cluster configuration information replication, a replication workflow corresponding to a storage operation implemented for a storage object (e.g., renaming of a volume) of a first cluster may be transferred to a second storage cluster for selectively implementation. In an example of managing cluster-wide service agents, cluster-wide service agents are deployed to nodes of a cluster storage environment, where a master agent actively processes cluster service calls and standby agents passively wait for reassignment as a failover master in the event the master agent fails. In an example of cluster-wide outage detection, a cluster-wide outage may be determined for a cluster storage environment based upon a number of inaccessible nodes satisfying a cluster outage detection metric.

    DEDUPLICATED HOST CACHE FLUSH TO REMOTE STORAGE

    公开(公告)号:US20180074968A1

    公开(公告)日:2018-03-15

    申请号:US15816029

    申请日:2017-11-17

    Applicant: NetApp, Inc.

    Abstract: In addition to caching I/O operations at a host, at least some data management can migrate to the host. With host side caching, data sharing or deduplication can be implemented with the cached writes before those writes are supplied to front end storage elements. When a host cache flush to distributed storage trigger is detected, the host deduplicates the cached writes. The host aggregates data based on the deduplication into a “change set file” (i.e., a file that includes the aggregation of unique data from the cached writes). The host supplies the change set file to the distributed storage system. The host then sends commands to the distributed storage system. Each of the commands identifies a part of the change set file to be used for a target of the cached writes.

    SYSTEMS AND METHODS FOR RESYNCHRONIZING MIRRORING PARTNERS IN A STORAGE SYSTEM

    公开(公告)号:US20180074925A1

    公开(公告)日:2018-03-15

    申请号:US15804028

    申请日:2017-11-06

    Applicant: NetApp Inc.

    CPC classification number: G06F11/2082 G06F11/2058 G06F11/2074 G06F12/0868

    Abstract: Systems and methods which provide for managing multiple mirror resources in a storage distribution network are provided. In some embodiments, a system provides for both high availability and disaster recovery functionality at different mirroring locations. Other embodiments may provide for multiple high availability and/or multiple disaster recovery mirror resources. These mirror resources are operated in a heterogeneous manner in the sense that each have its own transport, protocol, and the like, but are configured function cooperatively or as a single mirror with respect to mirroring a primary node. Embodiments may provide for the mirroring and resynchronization of mirrored resources in the event of a communication loss with a particular resource without ceasing the mirroring operations to other resources.

    THIRD VOTE CONSENSUS IN A CLUSTER USING SHARED STORAGE DEVICES

    公开(公告)号:US20180074924A1

    公开(公告)日:2018-03-15

    申请号:US15813941

    申请日:2017-11-15

    Applicant: NetApp, Inc.

    CPC classification number: G06F11/2033 G06F11/1425 G06F11/2046 G06F2201/805

    Abstract: A third vote consensus technique enables a first node, i.e., a surviving node, of a two-node cluster to establish a quorum and continue to operate in response to failure of a second node of the cluster. Each node maintains configuration information organized as a cluster database (CDB) which may be changed according to a consensus-based protocol. Changes to the CDB are logged on a third copy file system (TCFS) stored on a local copy of TCFS (L-TCFS). A shared copy of the TCFS (i.e., S-TCFS) may be stored on shared storage devices of one or more storage arrays coupled to the nodes. The local copy of the TCFS (i.e., L-TCFS) represents a quorum vote for each node of the cluster, while the S-TCFS represents an additional “tie-breaker” vote of a consensus-based protocol. The additional vote may be obtained from the shared storage devices by the surviving node as a third vote to establish the quorum and enable the surviving node to cast two of three votes (i.e., a majority of votes) needed to continue operation of the cluster. That is, the majority of votes allows the surviving node to update the CDB with the configuration information changes so as to continue proper operation of the cluster.

    Methods and systems for determining performance capacity of a resource of a networked storage environment

    公开(公告)号:US09912565B2

    公开(公告)日:2018-03-06

    申请号:US14805804

    申请日:2015-07-22

    Applicant: NETAPP, INC.

    CPC classification number: H04L43/0888 H04L43/028 H04L43/0852

    Abstract: Methods and systems for a networked storage system are provided. One method includes filtering performance data associated with a resource used in a networked storage environment for reading and writing data at a storage device; and determining available performance capacity of the resource using the filtered performance data. The available performance capacity is based on optimum utilization of the resource and actual utilization of the resource, where utilization of the resource is an indicator of an extent the resource is being used at any given time, the optimum utilization is an indicator of resource utilization beyond which throughput gains for a workload is smaller than increase in latency and latency is an indicator of delay at the resource in processing the workload.

    LOAD BALANCING AND FAULT TOLERANT SERVICE IN A DISTRIBUTED DATA SYSTEM

    公开(公告)号:US20180032382A1

    公开(公告)日:2018-02-01

    申请号:US15727713

    申请日:2017-10-09

    Applicant: NetApp Inc.

    Abstract: Techniques for load balancing and fault tolerant service are described. An apparatus may comprise load balancing and fault tolerant component operative to execute a load balancing and fault tolerant service in a distributed data system. The load balancing and fault tolerant service distributes a load of a task to a first node in a cluster of nodes using a routing table. The load balancing and fault tolerant service stores information to indicate the first node from the cluster of nodes is assigned to perform the task. The load balancing and fault tolerant service detects a failure condition for the first node. The load balancing and fault tolerant service moves the task to a second node from the cluster of nodes to perform the task for the first node upon occurrence of the failure condition.

Patent Agency Ranking