-
公开(公告)号:US20210250042A1
公开(公告)日:2021-08-12
申请号:US17244470
申请日:2021-04-29
Applicant: Huawei Technologies Co., Ltd.
Inventor: Kun Guan , Aleksei Valentinovich Romanovskii , Shaohui Quan , Gongyi Wang
IPC: H03M7/30
Abstract: A data compression method includes obtaining N to-be-compressed data blocks and N pieces of protection information (PI), where the N to-be-compressed data blocks are in a one-to-one correspondence with the N pieces of PI, and N is a positive integer greater than or equal to 2, compressing the N to-be-compressed data blocks to obtain a compressed data block, and compressing the N pieces of PI to obtain compressed PI.
-
公开(公告)号:US12079472B2
公开(公告)日:2024-09-03
申请号:US17732675
申请日:2022-04-29
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Bang Liu , Liyu Wang , Kun Guan , Wen Yang , Jianqiang Shen
IPC: G06F3/06
CPC classification number: G06F3/0608 , G06F3/064 , G06F3/0671
Abstract: A data reduction method, apparatus, and computing device and a storage medium are provided. The method includes: when reduction is to be performed on a to-be-reduced data block, obtaining a fingerprint of the to-be-reduced data block; forming an index set based on the fingerprint of the to-be-reduced data block by using index information of data blocks with identical fingerprints; and performing, in the to-be-reduced data block based on the fingerprint of the to-be-reduced data block, data reduction processing on a data block to which index information in a same index set belongs.
-
3.
公开(公告)号:US12073102B2
公开(公告)日:2024-08-27
申请号:US18340853
申请日:2023-06-24
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Kun Guan , Shaohui Quan , Liyu Wang , Jianqiang Shen
CPC classification number: G06F3/0641 , G06F3/0608 , G06F3/0673 , H03M7/30 , G06F3/0674 , G06F3/0676
Abstract: In a method for compressing data, a storage system determines whether deduplication can be performed on a target data block. When deduplication cannot be performed on the target data block, the storage system obtaining a similar fingerprint of the target data block, and determines, based on the similar fingerprint, a combined data block group to which the target data block belongs. The storage system then performs similar compression on the target data block based on a reference block in the combined data block group.
-
公开(公告)号:US11755207B2
公开(公告)日:2023-09-12
申请号:US17840982
申请日:2022-06-15
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Kun Guan , Bang Liu , Liyu Wang , Shaohui Quan , Liangxiang Zhang
CPC classification number: G06F3/0613 , G06F3/0608 , G06F3/0641 , G06F3/0683
Abstract: A data storage method in a storage system and a related system. The method includes: calculating a similar fingerprint of first to-be-stored data to obtain a first similar fingerprint, where the first similar fingerprint is for determining whether the first to-be-stored data is similar to stored data; determining reference data based on the first similar fingerprint, where a similar fingerprint of the reference data is the first similar fingerprint; determining first differential data between the to-be-stored data and the reference data based on the reference data, where the reference data is stored in a first storage unit; and storing the first differential data in a second storage unit, where the first storage unit and the second storage unit belong to a read range of a same read I/O.
-
5.
公开(公告)号:US20230333764A1
公开(公告)日:2023-10-19
申请号:US18340853
申请日:2023-06-24
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Kun Guan , Shaohui Quan , Liyu Wang , Jianqiang Shen
CPC classification number: G06F3/0641 , G06F3/0608 , G06F3/0673 , H03M7/30 , G06F3/0674
Abstract: In a method for compressing data, a storage system determines whether deduplication can be performed on a target data block. When deduplication cannot be performed on the target data block, the storage system obtaining a similar fingerprint of the target data block, and determines, based on the similar fingerprint, a combined data block group to which the target data block belongs. The storage system then performs similar compression on the target data block based on a reference block in the combined data block group.
-
公开(公告)号:US11514666B2
公开(公告)日:2022-11-29
申请号:US16442102
申请日:2019-06-14
Applicant: Huawei Technologies Co., Ltd.
Inventor: Stanislav Vladimirovich Moiseev , Denis Vasilievich Parfenov , Denis Vladimirovich Parkhomenko , Dmitry Nicolaevich Babin , Kun Guan
Abstract: A method of similarity-based deduplication comprising the steps of: receiving an input data block; computing discrete wavelet transform (DWT) coefficients; extracting feature-related DWT data from the computed DWT coefficients; applying quantization to the extracted feature-related DWT data to obtain keys as results of the quantization; constructing a locality-sensitive fingerprint of the input data block; computing a similarity degree between the locality-sensitive fingerprint of the input data block and a locality-sensitive fingerprint of each data block in the plurality of the data blocks in a cache memory; selecting an optimal reference data block as the data block; determining a differential compression is required to be applied based on the similarity degree between the input data block and the optimal reference data block; applying the differential compression to the input data block and the optimal reference data block.
-
公开(公告)号:US11411577B2
公开(公告)日:2022-08-09
申请号:US17244470
申请日:2021-04-29
Applicant: Huawei Technologies Co., Ltd.
Inventor: Kun Guan , Aleksei Valentinovich Romanovskii , Shaohui Quan , Gongyi Wang
IPC: H03M7/30
Abstract: A data compression method includes obtaining N to-be-compressed data blocks and N pieces of protection information (PI), where the N to-be-compressed data blocks are in a one-to-one correspondence with the N pieces of PI, and N is a positive integer greater than or equal to 2, compressing the N to-be-compressed data blocks to obtain a compressed data block, and compressing the N pieces of PI to obtain compressed PI.
-
8.
公开(公告)号:US20220147255A1
公开(公告)日:2022-05-12
申请号:US17579904
申请日:2022-01-20
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Kun Guan , Shaohui Quan , Liyu Wang , Jianqiang Shen
Abstract: In a method of storing data block, a storage device has stored a plurality of data block groups, each data block group having a common part that is contained in another data block in that group. For a target block to be stored, the storage device selects from the data block groups a target data block group has one data block whose common part is identical to a part of the target data block. The storage device then saves the target block by storing a target reference block of the target data block group and differential data between the target data block and the target reference block.
-
公开(公告)号:US10305512B2
公开(公告)日:2019-05-28
申请号:US15924007
申请日:2018-03-16
Applicant: HUAWEI TECHNOLOGIES, CO., LTD.
Inventor: Kun Guan , Jinan Leng , Gongyi Wang , Shaohui Quan , Jianqiang Shen
Abstract: An encoding method and apparatus is described. In an encoding method, when a first target sub-block in a target block is obtained, a hash operation is first performed on the first target sub-block. Then, a first hash table is queried for a corresponding hash value according to an operation result, and a corresponding location in a reference block is found according to the hash value obtained by means of query, that is, first reference data is found. The first piece of target data in the first target sub-block is matched with the first reference data, and second target data in the target block is matched with second reference data in the reference block. In this way, an approximate location is predetermined, so that a range in which matching needs to be performed is narrowed, a data compression time is reduced, and data compression efficiency is improved.
-
-
-
-
-
-
-
-