Online backup to an object service using bulk export

    公开(公告)号:US10127117B2

    公开(公告)日:2018-11-13

    申请号:US15820586

    申请日:2017-11-22

    Applicant: NetApp, Inc.

    Abstract: A system and method for improving storage system performance by maintaining data integrity during bulk export to a cloud system is provided. A backup host reads a selected volume from the storage system via an I/O channel. The storage system remains online during bulk export and tracks I/O to the selected volume in a tracking log. The backup host compresses, encrypts, and calculates a checksum for each data block of the volume before writing a corresponding data object to export devices and sending a checksum data object to the cloud system. The devices are shipped to the cloud system, which imports the data objects and calculates a checksum for each. The storage system compares the imported checksums with the checksums in the checksum data object, and adds data blocks to the tracking log when errors are detected. An incremental backup is performed based on the contents of the tracking log.

    Data backup technique for backing up data to an object storage service

    公开(公告)号:US11544151B2

    公开(公告)日:2023-01-03

    申请号:US17408018

    申请日:2021-08-20

    Applicant: NETAPP, INC.

    Abstract: A system, method, and computer program product for a block-based backing up a storage device to an object storage service is provided. This includes the generation of a data object that encapsulates a data of a data extent. The data extent covers a block address range of the storage device. The data object is named with a base name that represents a logical block address (LBA) of the data extent. The base name is appended with an identifier that deterministically identifies a recovery point that the data object is associated with. The base name combined with the identifier represents a data object name for the data object. The named data object is then transmitted to the object storage service for backup of the data extent. At an initial backup, the full storage device is copied. In incremental backups afterwards, only those data extents that changed are backed up.

    Data recovery technique for recovering data from an object storage service

    公开(公告)号:US09703645B2

    公开(公告)日:2017-07-11

    申请号:US14523550

    申请日:2014-10-24

    Applicant: NetApp, Inc.

    CPC classification number: G06F11/1469 G06F11/1451 G06F2201/835

    Abstract: A system and method for recovering data backed up to an object store are provided. In some embodiments, the method includes identifying an address space of a data set to be recovered. A set of data objects stored by an object-based system is identified that corresponds to the address space and a selected recovery point. The identified set of data objects is retrieved, and data contained in the retrieved set of data objects is stored to at least one storage device at a block address determined by the retrieved set of data objects to recreate the address space. In some embodiments, the set of data objects is retrieved by providing an HTTP request and receiving the set of data objects as an HTTP response. In some embodiments, the set of data objects are retrieved based on the data objects being the target of a data transaction.

    Hierarchical coherency log for managing a distributed data storage system

    公开(公告)号:US09607065B2

    公开(公告)日:2017-03-28

    申请号:US13871518

    申请日:2013-04-26

    Applicant: NetApp, Inc.

    CPC classification number: G06F17/30575 G06F17/30324 G06F17/30368

    Abstract: A system and method for managing distributed coherent datasets using a hierarchical change log is provided. In some embodiments, a distributed storage system is provided that includes a primary storage device containing a primary dataset and a mirror storage device containing a mirror dataset. The mirror dataset includes a coherent copy of the primary dataset. The distributed storage system further includes a hierarchical change log tracking a coherence state for the mirror dataset. The hierarchical change log includes a first sub-log and a second sub-log, and a block range of the first sub-log overlaps a block range of the second sub-log. The hierarchical change log may define a priority relationship between the first sub-log and the second sub-log governing the overlap. The first sub-log and the second sub-log may be independently configured and may be different in one of a representation and a block size.

    Data Backup Technique for Backing Up Data to an Object Storage Service

    公开(公告)号:US20210382791A1

    公开(公告)日:2021-12-09

    申请号:US17408018

    申请日:2021-08-20

    Applicant: NETAPP, INC.

    Abstract: A system, method, and computer program product for a block-based backing up a storage device to an object storage service is provided. This includes the generation of a data object that encapsulates a data of a data extent. The data extent covers a block address range of the storage device. The data object is named with a base name that represents a logical block address (LBA) of the data extent. The base name is appended with an identifier that deterministically identifies a recovery point that the data object is associated with. The base name combined with the identifier represents a data object name for the data object. The named data object is then transmitted to the object storage service for backup of the data extent. At an initial backup, the full storage device is copied. In incremental backups afterwards, only those data extents that changed are backed up.

    Hierarchical coherency log for managing a distributed data storage system

    公开(公告)号:US10423641B2

    公开(公告)日:2019-09-24

    申请号:US15446813

    申请日:2017-03-01

    Applicant: NetApp, Inc.

    Abstract: A system and method for managing distributed coherent datasets using a hierarchical change log is provided. In some embodiments, a distributed storage system is provided that includes a primary storage device containing a primary dataset and a mirror storage device containing a mirror dataset. The mirror dataset includes a coherent copy of the primary dataset. The distributed storage system further includes a hierarchical change log tracking a coherence state for the mirror dataset. The hierarchical change log includes a first sub-log and a second sub-log, and a block range of the first sub-log overlaps a block range of the second sub-log. The hierarchical change log may define a priority relationship between the first sub-log and the second sub-log governing the overlap. The first sub-log and the second sub-log may be independently configured and may be different in one of a representation and a block size.

    Online Backup to an Object Service Using Bulk Export

    公开(公告)号:US20170220423A1

    公开(公告)日:2017-08-03

    申请号:US15010101

    申请日:2016-01-29

    Applicant: NetApp, Inc.

    Abstract: A system and method for improving storage system performance by maintaining data integrity during bulk export to a cloud system is provided. A backup host reads a selected volume from the storage system via an I/O channel. The storage system remains online during bulk export and tracks I/O to the selected volume in a tracking log. The backup host compresses, encrypts, and calculates a checksum for each data block of the volume before writing a corresponding data object to export devices and sending a checksum data object to the cloud system. The devices are shipped to the cloud system, which imports the data objects and calculates a checksum for each. The storage system compares the imported checksums with the checksums in the checksum data object, and adds data blocks to the tracking log when errors are detected. An incremental backup is performed based on the contents of the tracking log.

    DATA RECOVERY TECHNIQUE FOR RECOVERING DATA FROM AN OBJECT STORAGE SERVICE
    9.
    发明申请
    DATA RECOVERY TECHNIQUE FOR RECOVERING DATA FROM AN OBJECT STORAGE SERVICE 有权
    用于从对象存储服务恢复数据的数据恢复技术

    公开(公告)号:US20160117227A1

    公开(公告)日:2016-04-28

    申请号:US14523550

    申请日:2014-10-24

    Applicant: NetApp, Inc.

    CPC classification number: G06F11/1469 G06F11/1451 G06F2201/835

    Abstract: A system and method for recovering data backed up to an object store are provided. In some embodiments, the method includes identifying an address space of a data set to be recovered. A set of data objects stored by an object-based system is identified that corresponds to the address space and a selected recovery point. The identified set of data objects is retrieved, and data contained in the retrieved set of data objects is stored to at least one storage device at a block address determined by the retrieved set of data objects to recreate the address space. In some embodiments, the set of data objects is retrieved by providing an HTTP request and receiving the set of data objects as an HTTP response. In some embodiments, the set of data objects are retrieved based on the data objects being the target of a data transaction.

    Abstract translation: 提供了用于恢复备份到对象存储的数据的系统和方法。 在一些实施例中,该方法包括识别要恢复的数据集的地址空间。 识别由基于对象的系统存储的一组数据对象,其对应于地址空间和选择的恢复点。 检索所识别的一组数据对象,并且将包含在所检索的数据对象集合中的数据以由所检索的数据对象组确定的块地址存储到至少一个存储设备,以重新创建地址空间。 在一些实施例中,通过提供HTTP请求并接收作为HTTP响应的一组数据对象来检索数据对象集合。 在一些实施例中,基于作为数据事务的目标的数据对象来检索数据对象集合。

    Online Backup to an Object Service Using Bulk Export

    公开(公告)号:US20180095839A1

    公开(公告)日:2018-04-05

    申请号:US15820586

    申请日:2017-11-22

    Applicant: NetApp, Inc.

    Abstract: A system and method for improving storage system performance by maintaining data integrity during bulk export to a cloud system is provided. A backup host reads a selected volume from the storage system via an I/O channel. The storage system remains online during bulk export and tracks I/O to the selected volume in a tracking log. The backup host compresses, encrypts, and calculates a checksum for each data block of the volume before writing a corresponding data object to export devices and sending a checksum data object to the cloud system. The devices are shipped to the cloud system, which imports the data objects and calculates a checksum for each. The storage system compares the imported checksums with the checksums in the checksum data object, and adds data blocks to the tracking log when errors are detected. An incremental backup is performed based on the contents of the tracking log.

Patent Agency Ranking