Automatic verification of asynchronously replicated data

    公开(公告)号:US10437855B1

    公开(公告)日:2019-10-08

    申请号:US15662809

    申请日:2017-07-28

    Abstract: An apparatus in one embodiment comprises a storage system having a plurality of storage devices. The storage system is associated with a target site and configured to participate in a cycle-based asynchronous replication process with a storage system of a source site. The storage system of the target site is configured to receive from the storage system of the source site, in respective ones of a plurality of cycles of the cycle-based asynchronous replication process, corresponding sets of differential data representing respective deltas between pairs of source site snapshots for respective pairs of the cycles. The storage system of the target site utilizes the sets of differential data received in the respective ones of the cycles to update respective target site snapshots for those cycles. Over multiple cycles, the storage system of the target site verifies that respective different portions of designated target site and source site snapshots are equivalent.

    SIGNATURE GENERATOR FOR USE IN COMPARING SETS OF DATA IN A CONTENT ADDRESSABLE STORAGE SYSTEM

    公开(公告)号:US20190286358A1

    公开(公告)日:2019-09-19

    申请号:US16433807

    申请日:2019-06-06

    Abstract: An apparatus in one embodiment comprises a storage system having a plurality of storage devices configured to store at least a first set of data. The storage system is configured to generate a first signature for the first set of data and to verify equivalence between the first set of data and a second set of data by comparing the first signature to a second signature generated for the second set of data. The first and second sets of data comprise respective first and second sets of pages with each page having a content-based page identifier and a page address, and the first and second signatures are generated as respective functions of the page identifiers and page addresses of the respective first and second sets of pages. The first and second sets of data may comprise respective first and second storage volumes, respective first and second sets of multiple storage volumes, or other sets of data.

    Replication link smoothing using historical data

    公开(公告)号:US11226868B2

    公开(公告)日:2022-01-18

    申请号:US16669823

    申请日:2019-10-31

    Abstract: An aspect includes determining a host write rate based on a number of chunks written to a storage volume during a first replication cycle and determining a target rate based on an estimated number of chunks written during a second replication cycle. The target rate is determined by dividing the number of chunks written during the second replication cycle by a recovery point objective (RPO) period. An aspect also includes transmitting chunks written during the second replication cycle at the target rate.

    REPLICATION LINK SMOOTHING USING HISTORICAL DATA

    公开(公告)号:US20200065197A1

    公开(公告)日:2020-02-27

    申请号:US16669823

    申请日:2019-10-31

    Abstract: An aspect includes determining a host write rate based on a number of chunks written to a storage volume during a first replication cycle and determining a target rate based on an estimated number of chunks written during a second replication cycle. The target rate is determined by dividing the number of chunks written during the second replication cycle by a recovery point objective (RPO) period. An aspect also includes transmitting chunks written during the second replication cycle at the target rate.

    Modifying Data of Activated Target-less Point-In-Time Images of Storage Volumes

    公开(公告)号:US20220350491A1

    公开(公告)日:2022-11-03

    申请号:US17306424

    申请日:2021-05-03

    Abstract: A target-less point in time image (snapshot) of a storage volume is allowed to be built after activation, by enabling the snapshot data to be modified to create a crash-consistent replica of the source data after the snapshot has been activated. The data of the snapshot remains immutable from a user standpoint, but the snapshot is able to be quickly activated before all of the data of the snapshot has been included in the snapshot, to thus reduce an amount of time IO operations on the source volume are quiesced. A first snapshot of a storage volume is created on a primary storage system and a corresponding second snapshot of the storage volume is activated on a backup storage system before all the data of the first snapshot is received at the backup storage system. Entries of the activated second snapshot are then changed to point to correct back-end allocations.

    Opportunistic compression of replicated data in a content addressable storage system

    公开(公告)号:US10884650B1

    公开(公告)日:2021-01-05

    申请号:US15793121

    申请日:2017-10-25

    Abstract: An apparatus in one embodiment comprises a first storage system having a plurality of storage devices. The first storage system is configured to participate in a replication process with a second storage system. The first storage system comprises a replication engine configured to request from a data module of the first storage system at least one data page to be replicated to the second storage system as part of the replication process. If the requested data page is already available in compressed form in the data module, the replication engine receives the requested data page in compressed form and transmits it to the second storage system along with at least a portion of a content-based signature of the requested data page. If the requested data page is not already available in compressed form in the data module, the replication engine receives the requested data page in uncompressed form and transmits it to the second storage system.

    Replication of content-based storage using address space slices

    公开(公告)号:US10409520B1

    公开(公告)日:2019-09-10

    申请号:US15499226

    申请日:2017-04-27

    Abstract: A computer program product, system, and method for determining one or more slices of a logical address space assigned to replication processor; determining an elapsed time since a start of a replication cycle; determining an expected number of slices that should have been replicated based on the elapsed time; and replicating one or more slices of the logical address space in response to determining the expected number of slices that should have been replicated is less than an actual number of slices replicated by the replication processor within the replication cycle.

    Modifying data of activated target-less point-in-time images of storage volumes

    公开(公告)号:US11467757B1

    公开(公告)日:2022-10-11

    申请号:US17306424

    申请日:2021-05-03

    Abstract: A target-less point in time image (snapshot) of a storage volume is allowed to be built after activation, by enabling the snapshot data to be modified to create a crash-consistent replica of the source data after the snapshot has been activated. The data of the snapshot remains immutable from a user standpoint, but the snapshot is able to be quickly activated before all of the data of the snapshot has been included in the snapshot, to thus reduce an amount of time IO operations on the source volume are quiesced. A first snapshot of a storage volume is created on a primary storage system and a corresponding second snapshot of the storage volume is activated on a backup storage system before all the data of the first snapshot is received at the backup storage system. Entries of the activated second snapshot are then changed to point to correct back-end allocations.

    Signature generator for use in comparing sets of data in a content addressable storage system

    公开(公告)号:US10860234B2

    公开(公告)日:2020-12-08

    申请号:US16433807

    申请日:2019-06-06

    Abstract: An apparatus in one embodiment comprises a storage system having a plurality of storage devices configured to store at least a first set of data. The storage system is configured to generate a first signature for the first set of data and to verify equivalence between the first set of data and a second set of data by comparing the first signature to a second signature generated for the second set of data. The first and second sets of data comprise respective first and second sets of pages with each page having a content-based page identifier and a page address, and the first and second signatures are generated as respective functions of the page identifiers and page addresses of the respective first and second sets of pages. The first and second sets of data may comprise respective first and second storage volumes, respective first and second sets of multiple storage volumes, or other sets of data.

    Signature generator for use in comparing sets of data in a content addressable storage system

    公开(公告)号:US10359965B1

    公开(公告)日:2019-07-23

    申请号:US15662833

    申请日:2017-07-28

    Abstract: An apparatus in one embodiment comprises a storage system having a plurality of storage devices configured to store at least a first set of data. The storage system is configured to generate a first signature for the first set of data and to verify equivalence between the first set of data and a second set of data by comparing the first signature to a second signature generated for the second set of data. The first and second sets of data comprise respective first and second sets of pages with each page having a content-based page identifier and a page address, and the first and second signatures are generated as respective functions of the page identifiers and page addresses of the respective first and second sets of pages. The first and second sets of data may comprise respective first and second storage volumes, respective first and second sets of multiple storage volumes, or other sets of data.

Patent Agency Ranking