-
公开(公告)号:US10572191B1
公开(公告)日:2020-02-25
申请号:US15792714
申请日:2017-10-24
发明人: Mikhail Danilov , Kirill Zakharov
摘要: Processing load for remote zones and inter-zone network traffic during geographically distributed (GEO) erasure coding can be reduced. In one aspect, GEO erasure coding can be performed in two phases, wherein each phase can be distributed between zones. Moreover, during a first phase, partially-finished coding chunks can be generated and provided to the remote zones. Further, during a second phase the remote zones can combine the received partially-finished coding chunks independently, to generate a complete coding chunk that can be utilized for data recovery.
-
公开(公告)号:US20200042179A1
公开(公告)日:2020-02-06
申请号:US16053872
申请日:2018-08-03
发明人: Mikhail Danilov , Lu Lei
摘要: The systems and methods disclosed herein relate to immediate replication for protected dedicated chunk. In one embodiment, a method comprises generating an encoded portion of data of a dedicated chunk in a node device of a first group of node devices in a first zone of a distributed storage system. The method further comprises, in immediate response to the generating, transferring the encoded portion of data of the dedicated chunk from the node device of the first group of node devices in the first zone of the distributed storage system to a second zone of the distributed storage system. The method further comprises dividing, by the system, the encoded portion of data in the second zone across second node devices.
-
公开(公告)号:US10528260B1
公开(公告)日:2020-01-07
申请号:US15794950
申请日:2017-10-26
发明人: Mikhail Danilov , Konstantin Buinov
摘要: Opportunistic combining of data chunks is disclosed. Data chunks stored in storage devices of different zones of a zone storage system can be convolved to conserve memory. The zone storage system can be a geographically diverse storage system. A convolved chunk can be stored at a zone that does not contribute a local data chunk to the data represented in the convolved chunk. A zone storage component can be androgynous, rather than being explicitly configured to act as a front/back end storage device. This androgyny can enable the zone storage system to store a complete chunk at a zone based on real time use. In an aspect, an androgynous zone storage component can take on, or transition between, a de facto front-end storage device character or de facto back-end storage device character in response to deployment of the androgynous zone storage component in the storage system.
-
公开(公告)号:US10284234B1
公开(公告)日:2019-05-07
申请号:US15654109
申请日:2017-07-19
摘要: Although a distributed storage device can recover data from multiple failures this process produces excessive inter-zone network traffic when a chunk with user data is deleted. This disclosure employs an un-encoding erasure coding and partial coding chunks to facilitate data deletes while reducing inter-zone network traffic. Therefore a data chunk representative of partitioned disk space associated with a first zone of a data store can be determined to be marked for deletion. Consequently, the data chunk can be copied, resulting in a copied data chunk, to a second zone of the data store associated with a coding chunk comprising the data chunk. Based on the copied data chunk and the coding chunk, a partial coding chunk can be generated via un-encoding, wherein the partial coding chunk is a subset of the coding chunk.
-
公开(公告)号:US10110258B2
公开(公告)日:2018-10-23
申请号:US15281172
申请日:2016-09-30
摘要: A method for generating coded fragments comprises receiving data to be encoded, splitting the data into a plurality of data fragments, identifying a first group of data fragments from among the plurality of data fragments using a coding matrix, summing the data fragments within the first group of data fragments to generate a first group sum, and using the first group sum to calculate at least a portion of two or more coded fragments.
-
公开(公告)号:US20180181612A1
公开(公告)日:2018-06-28
申请号:US15636435
申请日:2017-06-28
IPC分类号: G06F17/30
CPC分类号: G06F16/2365 , G06F16/27
摘要: One embodiment is related to a method for creating a redundancy data chunk for data protection with a chain topology, comprising: transmitting a data chunk of a first frontend zone of a data storage system to a second frontend zone of the data storage system; creating a redundancy data chunk at the second frontend zone of the data storage system based on the data chunk of the first frontend zone and a data chunk of the second frontend zone; passing the redundancy data chunk onto one or more subsequent frontend zones of the data storage system from the second frontend zone, wherein at each subsequent frontend zone the redundancy data chunk is updated based on the received redundancy data chunk and a data chunk of the respective subsequent frontend zone, and wherein the redundancy data chunk is passed through each subsequent frontend zone exactly once; and at a last subsequent frontend zone of the data storage system, forwarding the updated redundancy data chunk to a backend zone of the data storage system for final storage.
-
公开(公告)号:US20180181466A1
公开(公告)日:2018-06-28
申请号:US15636454
申请日:2017-06-28
CPC分类号: G06F11/1076 , G06F3/0608 , G06F3/064 , G06F3/067 , H03M13/154 , H03M13/373 , H03M13/3761 , H03M13/616
摘要: One embodiment is related to a method for avoiding recovery and storage of useless data, comprising: determining whether all of one or more unavailable data fragments of a data chunk correspond only to useless data; and in response to determining that all of the one or more unavailable data fragments of the data chunk correspond only to useless data, generating redundancy data for protecting available data fragments of the data chunk without recovering content of the one or more unavailable data fragments.
-
公开(公告)号:US20180173453A1
公开(公告)日:2018-06-21
申请号:US15631572
申请日:2017-06-23
IPC分类号: G06F3/06
CPC分类号: G06F3/0647 , G06F3/0604 , G06F3/0611 , G06F3/0619 , G06F3/0649 , G06F3/0653 , G06F3/067
摘要: Described is a system that allows for the efficient management of reallocating data between tiers of an automated storage tiering system. In certain configurations, protected data that is stored within the storage system may include a user data portion and a redundant data portion. Accordingly, to conserve space on higher storage tiers, the system may separate user data from the redundant data when reallocating data between tiers. For example, the system may only allocate the user data portion to higher storage tiers thereby conserving the space that would otherwise be taken by the redundant data, which remains, or is demoted to a lower tier. Moreover, the reallocation may occur during scheduled reallocation cycles, and accordingly, the reallocation of the separated protected data may occur without any additional tiering overhead.
-
公开(公告)号:US20180165323A1
公开(公告)日:2018-06-14
申请号:US15620900
申请日:2017-06-13
摘要: A computer program product, system, and method for generating a test data set using object count and object size parameters, storing the generated data set in storage, subsequently regenerating the data set, and comparing the regenerated data set to the stored data set to validate the storage.
-
公开(公告)号:US11971850B2
公开(公告)日:2024-04-30
申请号:US17503024
申请日:2021-10-15
发明人: Mikhail Danilov , Yohannes Altaye
IPC分类号: G06F16/00 , G06F16/11 , G06F16/18 , G06F16/185
CPC分类号: G06F16/125 , G06F16/1805 , G06F16/185
摘要: Data retention for a tiered ordered event stream (OES) data storage system is disclosed. Data retention can be applied to demoted data, e.g., data demoted from a first tier to a second tier of data storage devices. The data retention disclosed can avoid demoted events, generally aggregated via a chunk object, file object, etc., from being subject to both a stream-cut operation and a retention period. In embodiments, where a stream-cut instance corresponds to events occurring later in time than a retention end time (RET), all demoted events, e.g., as aggregated by a chunk, file, etc., can be affiliated with the RET. However, where the stream-cut instance corresponds to events occurring earlier in time than the RET, then a portion of the events, e.g., those that will be truncated by performing the stream-cut instance, can be demoted and affiliated with the RET.
-
-
-
-
-
-
-
-
-