Disaster recovery with distributed erasure coding

    公开(公告)号:US10572191B1

    公开(公告)日:2020-02-25

    申请号:US15792714

    申请日:2017-10-24

    摘要: Processing load for remote zones and inter-zone network traffic during geographically distributed (GEO) erasure coding can be reduced. In one aspect, GEO erasure coding can be performed in two phases, wherein each phase can be distributed between zones. Moreover, during a first phase, partially-finished coding chunks can be generated and provided to the remote zones. Further, during a second phase the remote zones can combine the received partially-finished coding chunks independently, to generate a complete coding chunk that can be utilized for data recovery.

    IMMEDIATE REPLICATION FOR DEDICATED DATA BLOCKS

    公开(公告)号:US20200042179A1

    公开(公告)日:2020-02-06

    申请号:US16053872

    申请日:2018-08-03

    IPC分类号: G06F3/06 H03M13/15

    摘要: The systems and methods disclosed herein relate to immediate replication for protected dedicated chunk. In one embodiment, a method comprises generating an encoded portion of data of a dedicated chunk in a node device of a first group of node devices in a first zone of a distributed storage system. The method further comprises, in immediate response to the generating, transferring the encoded portion of data of the dedicated chunk from the node device of the first group of node devices in the first zone of the distributed storage system to a second zone of the distributed storage system. The method further comprises dividing, by the system, the encoded portion of data in the second zone across second node devices.

    Opportunistic ‘XOR’ of data for geographically diverse storage

    公开(公告)号:US10528260B1

    公开(公告)日:2020-01-07

    申请号:US15794950

    申请日:2017-10-26

    IPC分类号: G06F12/00 G06F3/06 G06F11/14

    摘要: Opportunistic combining of data chunks is disclosed. Data chunks stored in storage devices of different zones of a zone storage system can be convolved to conserve memory. The zone storage system can be a geographically diverse storage system. A convolved chunk can be stored at a zone that does not contribute a local data chunk to the data represented in the convolved chunk. A zone storage component can be androgynous, rather than being explicitly configured to act as a front/back end storage device. This androgyny can enable the zone storage system to store a complete chunk at a zone based on real time use. In an aspect, an androgynous zone storage component can take on, or transition between, a de facto front-end storage device character or de facto back-end storage device character in response to deployment of the androgynous zone storage component in the storage system.

    Facilitation of data deletion for distributed erasure coding

    公开(公告)号:US10284234B1

    公开(公告)日:2019-05-07

    申请号:US15654109

    申请日:2017-07-19

    摘要: Although a distributed storage device can recover data from multiple failures this process produces excessive inter-zone network traffic when a chunk with user data is deleted. This disclosure employs an un-encoding erasure coding and partial coding chunks to facilitate data deletes while reducing inter-zone network traffic. Therefore a data chunk representative of partitioned disk space associated with a first zone of a data store can be determined to be marked for deletion. Consequently, the data chunk can be copied, resulting in a copied data chunk, to a second zone of the data store associated with a coding chunk comprising the data chunk. Based on the copied data chunk and the coding chunk, a partial coding chunk can be generated via un-encoding, wherein the partial coding chunk is a subset of the coding chunk.

    SYSTEM AND METHOD FOR XOR CHAIN
    46.
    发明申请

    公开(公告)号:US20180181612A1

    公开(公告)日:2018-06-28

    申请号:US15636435

    申请日:2017-06-28

    IPC分类号: G06F17/30

    CPC分类号: G06F16/2365 G06F16/27

    摘要: One embodiment is related to a method for creating a redundancy data chunk for data protection with a chain topology, comprising: transmitting a data chunk of a first frontend zone of a data storage system to a second frontend zone of the data storage system; creating a redundancy data chunk at the second frontend zone of the data storage system based on the data chunk of the first frontend zone and a data chunk of the second frontend zone; passing the redundancy data chunk onto one or more subsequent frontend zones of the data storage system from the second frontend zone, wherein at each subsequent frontend zone the redundancy data chunk is updated based on the received redundancy data chunk and a data chunk of the respective subsequent frontend zone, and wherein the redundancy data chunk is passed through each subsequent frontend zone exactly once; and at a last subsequent frontend zone of the data storage system, forwarding the updated redundancy data chunk to a backend zone of the data storage system for final storage.

    STORAGE TIERING WITH EFFICIENT ALLOCATION OF REDUNDANT DATA

    公开(公告)号:US20180173453A1

    公开(公告)日:2018-06-21

    申请号:US15631572

    申请日:2017-06-23

    IPC分类号: G06F3/06

    摘要: Described is a system that allows for the efficient management of reallocating data between tiers of an automated storage tiering system. In certain configurations, protected data that is stored within the storage system may include a user data portion and a redundant data portion. Accordingly, to conserve space on higher storage tiers, the system may separate user data from the redundant data when reallocating data between tiers. For example, the system may only allocate the user data portion to higher storage tiers thereby conserving the space that would otherwise be taken by the redundant data, which remains, or is demoted to a lower tier. Moreover, the reallocation may occur during scheduled reallocation cycles, and accordingly, the reallocation of the separated protected data may occur without any additional tiering overhead.

    Demoted data retention via a tiered ordered event stream data storage system

    公开(公告)号:US11971850B2

    公开(公告)日:2024-04-30

    申请号:US17503024

    申请日:2021-10-15

    摘要: Data retention for a tiered ordered event stream (OES) data storage system is disclosed. Data retention can be applied to demoted data, e.g., data demoted from a first tier to a second tier of data storage devices. The data retention disclosed can avoid demoted events, generally aggregated via a chunk object, file object, etc., from being subject to both a stream-cut operation and a retention period. In embodiments, where a stream-cut instance corresponds to events occurring later in time than a retention end time (RET), all demoted events, e.g., as aggregated by a chunk, file, etc., can be affiliated with the RET. However, where the stream-cut instance corresponds to events occurring earlier in time than the RET, then a portion of the events, e.g., those that will be truncated by performing the stream-cut instance, can be demoted and affiliated with the RET.