Prioritized data recovery from an object storage service and concurrent data backup

    公开(公告)号:US10180885B2

    公开(公告)日:2019-01-15

    申请号:US14937192

    申请日:2015-11-10

    Applicant: NetApp, Inc.

    Abstract: A system and method are provided for backing up and recovering data that allows the data to be modified and backed up even while recovery is still in progress. In some embodiments, the method includes performing a data recovery procedure on a computing system. The data recovery procedure includes identifying a set of data objects stored on a recovery system; retrieving the set of data objects; and storing data of the retrieved set of data objects to at least one storage device. Data objects may be prioritized so that data that is in demand is retrieved first. Data that is modified during the data recovery procedure is tracked and backed up to an object-storage system during the data recovery procedure. In some embodiments, backing up the modified data is part of an incremental backup procedure that excludes data objects that contains only unmodified data.

    METHODS FOR HANDLING STORAGE ELEMENT FAILURES TO REDUCE STORAGE DEVICE FAILURE RATES AND DEVICES THEREOF

    公开(公告)号:US20180341554A1

    公开(公告)日:2018-11-29

    申请号:US15606379

    申请日:2017-05-26

    Applicant: NetApp, Inc.

    Abstract: Methods, non-transitory computer readable media, and computing devices that determine when a storage element of a data storage device has failed. Address(es) mapped to the failed storage element are identified, when the determining indicates that the storage element has failed. Data corresponding to the address(es) is regenerated according to a data loss protection and recovery scheme (e.g., a RAID scheme). The regenerated data is written to other storage element(s) of the data storage device in order to remap the address(es) to the other storage element(s). This technology allows a data storage device (e.g., an SSD) to be repaired in-place following a failure of storage element(s) (e.g., a die) of the data storage device. Advantageously, entire data storage devices do not have to be failed with this technology as a result of a failure of an individual storage element, thereby reducing data storage device failure rates and associated overhead.

    Write-Ahead Log Maintenance and Recovery
    25.
    发明申请

    公开(公告)号:US20170300250A1

    公开(公告)日:2017-10-19

    申请号:US15131658

    申请日:2016-04-18

    Applicant: NetApp, Inc.

    Abstract: A system for tracking metadata changes and recovering from system interruptions is provided. With host I/O, corresponding metadata incremental changes are aggregated and stored in a write-ahead log before being performed to their in-memory buffers. As those buffers are flushed, checkpoints are created and stored in the log. As the log wraps to the start, older entries are overwritten after they are freed from any remaining dependencies by newer checkpoints. If metadata entities have not created new checkpoints, they are instructed to in order to free up space for new aggregated batches and checkpoints. After an interruption, the wrap point is located in the log. From the wrap point, the log is scanned backwards to provide checkpoints to metadata entities. The log is then scanned forwards to perform changes specified by aggregated batches. The metadata entities' volatile memory states are recovered to what they were before the interruption.

    Online Backup to an Object Service Using Bulk Export

    公开(公告)号:US20170220423A1

    公开(公告)日:2017-08-03

    申请号:US15010101

    申请日:2016-01-29

    Applicant: NetApp, Inc.

    Abstract: A system and method for improving storage system performance by maintaining data integrity during bulk export to a cloud system is provided. A backup host reads a selected volume from the storage system via an I/O channel. The storage system remains online during bulk export and tracks I/O to the selected volume in a tracking log. The backup host compresses, encrypts, and calculates a checksum for each data block of the volume before writing a corresponding data object to export devices and sending a checksum data object to the cloud system. The devices are shipped to the cloud system, which imports the data objects and calculates a checksum for each. The storage system compares the imported checksums with the checksums in the checksum data object, and adds data blocks to the tracking log when errors are detected. An incremental backup is performed based on the contents of the tracking log.

    Dynamically Growing and Shrinking Snapshot Repositories Without Impacting Performance or Latency
    27.
    发明申请
    Dynamically Growing and Shrinking Snapshot Repositories Without Impacting Performance or Latency 审中-公开
    动态增长和收缩快照存储库,而不影响性能或延迟

    公开(公告)号:US20170031771A1

    公开(公告)日:2017-02-02

    申请号:US14813832

    申请日:2015-07-30

    Applicant: NetApp, Inc.

    Abstract: A system, method, and computer program product for the provision of a snapshot repository that grows and shrinks over time. The snapshot repository stores snapshot images. When the used capacity of the repository reaches an upper bound of the repository, the image may be wrapped to the start of the repository if the image stored there previously has been deleted. Otherwise another stripe volume is added from a pool of available volumes and the image continues storage there. As older images are deleted according to a retention policy, stripe volumes that become empty may be dis-associated from their associated LBA range and released to the pool or re-mapped to a lower LBA range of the repository. When the empty stripe volume is at the end of the repository, the ending LBA may be adjusted to the end of the last allocated stripe volume as the volume is released.

    Abstract translation: 一种用于提供随时间增长和缩小的快照存储库的系统,方法和计算机程序产品。 快照存储库存储快照映像。 当存储库的使用容量达到存储库的上限时,如果先前存储的映像已经被删除,则映像可以被包装到存储库的开头。 否则,从可用卷池中添加另一个条带卷,并且图像继续存储在那里。 随着旧图像根据保留策略被删除,变空的条带卷可能与其关联的LBA范围不相关,并释放到池中或重新映射到存储库的较低LBA范围。 当空条带卷位于存储库的末尾时,结束的LBA可能会在卷释放后调整到最后分配的条带卷的末尾。

    Systems and methods for allocating data compression activities in a storage system

    公开(公告)号:US11500592B2

    公开(公告)日:2022-11-15

    申请号:US16707651

    申请日:2019-12-09

    Applicant: NetApp, Inc.

    Abstract: A method, a computing device, and a non-transitory machine-readable medium for allocating data compression activities in a storage system are provided. A method includes tracking, by a storage controller, computing resources corresponding to a storage server. The storage controller processes one or more host read requests to access data requested by one or more hosts, the processing of the one or more host read requests including decompressing the data requested by the one or more hosts from the storage server and providing the decompressed data to the one or more hosts. The storage controller determines an amount of available computing resources after processing the one or more host read requests. Based on the amount of available computing resources, the storage controller performs inline compression of a first portion of host write requests and background compression of a second portion of the host write requests.

    Read and write load sharing in a storage array via partitioned ownership of data blocks

    公开(公告)号:US11175831B2

    公开(公告)日:2021-11-16

    申请号:US15496841

    申请日:2017-04-25

    Applicant: NETAPP, INC.

    Abstract: A system shares I/O load between controllers in a high availability system. For writes, a controller determines based on one or more factors which controller will flush batches of data from write-back cache to better distribute the I/O burden. The determination occurs after the local storage controller caches the data, mirrors it, and confirms write complete to the host. Once it is determined which storage controller will flush the cache, the flush occurs and the corresponding metadata at a second layer of indirection is updated by that determined storage controller (whether or not it is identified as the owner of the corresponding volume to the host, while the volume owner updates metadata at a first layer of indirection). For a host read, the controller that owns the volume accesses the metadata from whichever controller(s) flushed the data previously and reads the data, regardless of which controller had performed the flush.

Patent Agency Ranking