Building stable storage area networks for compute clusters

    公开(公告)号:US11301139B2

    公开(公告)日:2022-04-12

    申请号:US16722270

    申请日:2019-12-20

    Applicant: NetApp, Inc.

    Abstract: Systems and methods that result in a stable storage system are provided. In the storage system, the latency spikes may be reduced when multiple volumes are aggregated into transfer sets according to system characteristics. The storage system transfers ownership of volumes in each transfer set as a single transaction. In the storage system, connectivity between the host and the storage controller is re-established based on the connectivity in a physical transport layer and a single path. In the storage system, pre-mature failback is also avoided when ownership of volumes is transferred back to a preferred storage controller when the same number of paths existed between the host and the preferred storage controller before and after a failover operation. Further, the storage system generates connectivity reports that display connectivity paths between hosts, storage controllers, and volumes.

    RESILIENT IMPLEMENTATION OF CLIENT FILE OPERATIONS AND REPLICATION

    公开(公告)号:US20220091749A1

    公开(公告)日:2022-03-24

    申请号:US17543351

    申请日:2021-12-06

    Applicant: NetApp Inc.

    Abstract: One or more techniques and/or computing devices are provided for resilient replication of storage operations. For example, a first storage controller may host first storage having a replication relationship with second storage hosted by a second storage controller. To improve resiliency against transient network issues of a network between the storage controllers, the first storage controller may implement a queue and retry mechanism to retry replication operations not acknowledge back by the second storage controller within a threshold time. The second storage controller may maintain a cumulative sequence number of a latest replication operation performed in order, an operation response map of replication operations performed out of order, and an operation finder map identifying currently implemented replication operations, which may be used to process incoming replication operations. Single write semantics, write order consistency, and reduction of write amplification may be provided.

    METHODS AND SYSTEMS FOR SELF-HEALING IN CONNECTED COMPUTING ENVIRONMENTS

    公开(公告)号:US20220075683A1

    公开(公告)日:2022-03-10

    申请号:US17525161

    申请日:2021-11-12

    Applicant: NETAPP, INC.

    Inventor: Kausik Ghatak

    Abstract: Methods and systems for networked systems are provided. A reinforcement learning (RL) agent is deployed during runtime of a networked system having at least a first component and a second component. The RL agent detects a first degradation signal in response to an error associated with the first component and a second degradation signal from the second component, the second degradation signal generated in response to the error. The RL agent identifies from a learned data structure an action for fixing degradation, at both the first component and the second component; and continues to update the learned data structure, upon successful and unsuccessful attempts to fix degradation associated with the first component and the second component.

    VIRTUAL MACHINE REDEPLOYMENT
    175.
    发明申请

    公开(公告)号:US20220075642A1

    公开(公告)日:2022-03-10

    申请号:US17526385

    申请日:2021-11-15

    Applicant: NetApp Inc.

    Abstract: One or more techniques and/or systems are disclosed for redeploying a baseline VM (BVM) to one or more child VMs (CVMs) by merely cloning virtual drives of the BVM, instead of the entirety of the parent BVM. A temporary directory is created in a datastore that has the target CVMs that are targeted for virtual drive replacement (e.g., are to be “re-baselined”). One or more replacement virtual drives (RVDs) are created in the temporary directory, where the RVDs comprise a clone of a virtual drive of the source BVM. The one or more RVDs are moved from the temporary directory to a directory of the target CVMs, replacing existing virtual drives of the target CVMs so that the target CVMs are thus re-baselined to the state of the parent BVM.

    METHODS FOR ACCELERATING STORAGE OPERATIONS USING COMPUTATIONAL NETWORK AND STORAGE COMPONENTS AND DEVICES THEREOF

    公开(公告)号:US20220075557A1

    公开(公告)日:2022-03-10

    申请号:US17012652

    申请日:2020-09-04

    Applicant: NetApp, Inc.

    Inventor: DAVID SLIK

    Abstract: Methods, non-transitory machine readable media, and computing devices that accelerate storage operations are disclosed. With this technology, computational storage devices are assigned by a NIC processor of a computational network interface controller (NIC) to storage locations corresponding to respective partitions of an n-dimensional space. One of the storage locations to which a data location in the n-dimensional space maps is then identified by the NIC processor. The data location is determined based on a hash for data associated with a received storage operation. The NIC processor subsequently communicates via a system bus with a storage processor of one of the computational storage device to service the storage operation. The storage processor is coupled directly to flash media of the one of the computational storage device that is assigned to the one of the storage locations and maintains a key/value store comprising the data.

    CLONED VIRTUAL MACHINE DISK REPLICATION

    公开(公告)号:US20220058159A1

    公开(公告)日:2022-02-24

    申请号:US17516343

    申请日:2021-11-01

    Applicant: NetApp Inc.

    Abstract: One or more techniques and/or computing devices are provided for replicating virtual machine disk clones. For example, a first storage controller, hosting first storage, may have a synchronous replication relationship with a second storage controller hosting second storage. A virtual machine, within the first storage, may be specified as having synchronous replication protection. Accordingly, virtual machine disk clones of a virtual machine disk of the virtual machine may be replicated from the first storage to the second storage. For example, virtual machine disk clones may be synchronous replicated, replicated by a resync process invoked by a hypervisor agent, and/or stored and replicated from a clone backup directory.

    DEDUPLICATED HOST CACHE FLUSH TO REMOTE STORAGE

    公开(公告)号:US20220058131A1

    公开(公告)日:2022-02-24

    申请号:US17516414

    申请日:2021-11-01

    Applicant: NetApp Inc.

    Abstract: In addition to caching I/O operations at a host, at least some data management can migrate to the host. With host side caching, data sharing or deduplication can be implemented with the cached writes before those writes are supplied to front end storage elements. When a host cache flush to distributed storage trigger is detected, the host deduplicates the cached writes. The host aggregates data based on the deduplication into a “change set file” (i.e., a file that includes the aggregation of unique data from the cached writes). The host supplies the change set file to the distributed storage system. The host then sends commands to the distributed storage system. Each of the commands identifies a part of the change set file to be used for a target of the cached writes.

    Reducing write tail latency in storage systems

    公开(公告)号:US11256424B2

    公开(公告)日:2022-02-22

    申请号:US16532817

    申请日:2019-08-06

    Applicant: NetApp, Inc.

    Abstract: In order to reduce write tail latency, a storage system generates redundant write requests when performing a storage operation for an object. The storage operation is determined to be effectively complete when a minimum number of write requests have completed. For example, the storage system may generate twelve write requests and also generate four redundant write requests for a total of sixteen write requests. The storage system considers the object successfully stored once twelve of the sixteen writes complete successfully. To generate the redundant writes, the storage system may use replication or erasure coding. For replication, the storage system may issue a redundant write request for each of n chunks being written. For erasure coding, the storage system may use rateless codes which can generate unlimited number of parity chunks or use an n+k+k′ erasure code which generates an additional k′ encoded chunks, in place of an n+k erasure code.

    Methods for improved data replication across hybrid cloud volumes using data tagging and devices thereof

    公开(公告)号:US11249671B2

    公开(公告)日:2022-02-15

    申请号:US15581730

    申请日:2017-04-28

    Applicant: NetApp, Inc.

    Abstract: Methods, non-transitory computer readable media, and computing devices that receive data from a primary storage node. The data is stored in a primary volume within a primary composite aggregate hosted by the primary storage node. A determination is made when the data is tagged to indicate that the data is stored in the primary volume on a remote data storage device of the primary composite aggregate. The data is stored on another remote data storage device without storing the data in a local data storage device, when the determining indicates that the data is tagged to indicate that the data is stored in the primary volume on a remote data storage device of the primary composite aggregate. Accordingly, this technology allows data placement to remain consistent across primary and secondary volumes and facilitates efficient operation of secondary storage nodes by eliminating two-phase writes for data stored on cloud storage devices.

Patent Agency Ranking