Restoring data from a storage device to a cloud

    公开(公告)号:US10579481B1

    公开(公告)日:2020-03-03

    申请号:US15885008

    申请日:2018-01-31

    IPC分类号: G06F11/14 H04L29/08 G06F3/06

    摘要: Restoring data from a storage device to a cloud service includes initializing each of a plurality of flags for each of portions of the data when the data is initially recalled from the cloud service to the storage device, the flags indicating whether a corresponding portion of the data has been modified while being stored on the storage device, modifying a particular one of the flags in response to a corresponding one of the portions being modified, transferring only portions of the data having corresponding flags that have been modified to migrate, and merging the portions of the data with remaining data at the cloud service. Data that is recalled from the cloud service to the storage device may be maintained on the cloud service. The portions of data that are transferred from the storage device to the cloud service may overwrite data maintained at the cloud service.

    Selective data replication
    12.
    发明授权

    公开(公告)号:US09971529B1

    公开(公告)日:2018-05-15

    申请号:US15198684

    申请日:2016-06-30

    IPC分类号: G06F12/00 G06F3/06 G06F13/00

    摘要: Described are data replication techniques that may include receiving, on a host, a write operation that writes first data to a target location on a first logical device having storage provisioned on a first data storage system; determining, on the host and in accordance with one or more criteria, whether the first data is to be replicated on a second logical device on a second data storage system; and issuing the write operation from the host to the first data storage system, wherein the write operation denotes whether to disable replication of the first data to the second logical device on the second data storage system. Such techniques may include partitioning a single write operation into multiple write operations and setting an indicator in each of the multiple writes denoting whether remote replication of the write operation is enabled or disabled.

    Incremental continuous data protection

    公开(公告)号:US09892002B1

    公开(公告)日:2018-02-13

    申请号:US15496032

    申请日:2017-04-25

    IPC分类号: G06F3/06 G06F11/14

    摘要: Systems and techniques are provided for incremental Continuous Data Protection (iCDP) as a process to secure frequent, and space efficient, versions of consistent point-in-time images of a group of volumes using snapshot technology. The system described herein provides for automation to create and manage frequent snapshots of defined groups of volumes. The incremental approach of the system described herein provides a convenient way to roll back to prior point-in-time versions to investigate data damage due to processing errors or other forms of corruption. The intervals between versions may be controlled. The system beneficially provides for identifying, monitoring, and reclaiming use of log space in log devices in connection with managing recovery and roll back capabilities of the system to desired data versions for purposes of data protection.

    PERFORMANCE SCALE TESTING WITH I/O REUSE

    公开(公告)号:US20220334947A1

    公开(公告)日:2022-10-20

    申请号:US17234017

    申请日:2021-04-19

    IPC分类号: G06F11/34 G06F11/30 G06F3/06

    摘要: A host performs benchmark I/O operations for a storage system by an application on the host formulating a performance test command, providing the performance test command to a channel subsystem layer of the host that actuates communication hardware that provides signals to the storage system, and performing a plurality of benchmark I/O operations at the channel subsystem layer in response to a single performance test command by actuating the communication hardware that provides signals to the storage system. The single performance test command may result in actuating the communication hardware to read and write data at a plurality of addresses of the storage system. The channel subsystem layer may perform the plurality of benchmark I/O operations without receiving any additional data or commands from any applications on the host. A dispatch program that runs on the channel subsystem layer may receive operational data and may actuate the communication hardware.

    RUNNING AN INDEPENDENT TASK IN CONNECTION WITH SYNCHRONOUS I/O OPERATIONS

    公开(公告)号:US20220334766A1

    公开(公告)日:2022-10-20

    申请号:US17234380

    申请日:2021-04-19

    IPC分类号: G06F3/06

    摘要: Running an independent task in connection with a synchronous I/O operation between a storage system and a host includes starting the synchronous I/O operation, setting a timer for the synchronous I/O operation, starting the independent task that runs while waiting for completion of the synchronous I/O operation, and aborting the synchronous I/O operation in response to the timer expiring prior to completion of the synchronous I/O operation. The independent task may be ended in response to the timer expiring. The independent task may be ended in response to the I/O operation completing. The synchronous I/O operation may be performed using a high speed connection between the storage system and the host, which may be coupled to a smart network interface controller provided on a director board in the storage system. The smart network interface controller may include a system on a chip having a processor, memory, and non-volatile storage.

    SYNCHRONOUS TO SEMI-SYNCHRONOUS OUT-OF-BAND I/O

    公开(公告)号:US20220334728A1

    公开(公告)日:2022-10-20

    申请号:US17235323

    申请日:2021-04-20

    IPC分类号: G06F3/06

    摘要: Handling I/O operations between a storage system and a host includes initiating a direct data transfer for each of the I/O operations that initially excludes other processes from using a CPU of the host, setting a first timer for each of the direct data transfers, converting at least some of the direct transfers to semi-synchronous I/O operations that release the CPU for use by other processes and transfer data directly between the storage system and the host in response to the first timer expiring prior to completion of a corresponding one of the direct data transfers, and setting a second timer that corresponds to an expected completion of the semi-synchronous I/O operation. The direct data transfers may exchange data between the host and cache memory of the storage system. The direct data transfers may be performed using a high speed connection between the storage system and the host.

    COPYING DATA BETWEEN STORAGE SYSTEMS

    公开(公告)号:US20220236881A1

    公开(公告)日:2022-07-28

    申请号:US17160465

    申请日:2021-01-28

    IPC分类号: G06F3/06

    摘要: Copying data from a source storage system to a target storage system includes resetting a write tracker on the source storage system to track writes to the source storage system by one or more host computing systems, copying data from the source storage system to the target storage system after resetting the write tracker, suspending writes to the source storage system after copying the data, and copying data portions of the source storage system to the target storage system that are indicated as being written by the write tracker after suspending writes to the source storage system. Applications that write data to the source storage system may be quiesced in connection with suspending writes to the source storage system. Data portions may be repeatedly copied from the source storage system to the target storage system until an end condition is reached.

    FILE LEVEL INCREMENTAL CONTINUOUS DATA PROTECTION

    公开(公告)号:US20220138149A1

    公开(公告)日:2022-05-05

    申请号:US17084153

    申请日:2020-10-29

    摘要: Creating point-in-time versions of files for applications at a storage system includes maintaining at the storage system a data structure correlating each of a plurality of applications with files for each of the applications and correlating each of the files with portions of the data storage system, using the data structure to determine specific files for a particular one of the applications for which a point-in-time version is being created, using the data structure to determine specific portions of the storage system corresponding to the specific files, suspending writes to the specific portions, completing previous writes to the specific portions following suspending writes, and performing a snapshot of the specific files following completing previous writes. The portions of the data storage may be extents. A host may provide information to the storage system to correlate applications with files and to correlate files with portions of the data storage system.

    Storage boost
    19.
    发明授权

    公开(公告)号:US11163644B2

    公开(公告)日:2021-11-02

    申请号:US16558562

    申请日:2019-09-03

    摘要: Adapting a storage system in response to operation of a corresponding host includes determining whether the host is performing a boot up operation, determining whether the host is performing a shutdown operation, and adapting operation of the storage system in response to the host performing one of: a boot up operation or a shutdown operation. Adapting operation of the storage system may include suspending low-priority housekeeping tasks, decreasing work queue scan times to be more responsive to incoming work, moving cores from other emulations, increasing thread counts, and/or preloading specified files into cache memory of the storage system. Determining whether the host is performing a boot up operation may include making a call from the storage system to the host that causes the host to return an indication thereof. Operations that are characteristic of booting up may be determined by machine learning.

    Concurrent copy emulation
    20.
    发明授权

    公开(公告)号:US11163477B2

    公开(公告)日:2021-11-02

    申请号:US16667197

    申请日:2019-10-29

    IPC分类号: G06F3/06

    摘要: Causing an application on a host to access a point-in-time image on a storage system includes the application generating concurrent copy commands that are designed to cause data to be copied from a first location to a second location independent of whether the data is accessed by the host following initiating creation of a concurrent copy, intercepting concurrent copy commands and data generated by the application prior to sending the commands and data from the host to the storage system, transforming the concurrent copy commands and data to revised commands and data that are used to access the point-in-time image. Transforming the concurrent copy commands may include allocating temporary space on the storage system. The revised commands and data are sent from the host to the storage system. All commands generated by the application may be intercepted by the drivers layer. Only concurrent copy commands may be transformed.