Invention Grant
- Patent Title: Method and system of similarity-based deduplication
-
Application No.: US16442102Application Date: 2019-06-14
-
Publication No.: US11514666B2Publication Date: 2022-11-29
- Inventor: Stanislav Vladimirovich Moiseev , Denis Vasilievich Parfenov , Denis Vladimirovich Parkhomenko , Dmitry Nicolaevich Babin , Kun Guan
- Applicant: Huawei Technologies Co., Ltd.
- Applicant Address: CN Shenzhen
- Assignee: Huawei Technologies Co., Ltd.
- Current Assignee: Huawei Technologies Co., Ltd.
- Current Assignee Address: CN Shenzhen
- Agency: Leydig, Voit & Mayer, Ltd.
- Main IPC: G06V10/75
- IPC: G06V10/75 ; G06F17/14 ; G06K9/62 ; H03M7/30 ; G06F3/06 ; G06F16/174 ; G06F16/14

Abstract:
A method of similarity-based deduplication comprising the steps of: receiving an input data block; computing discrete wavelet transform (DWT) coefficients; extracting feature-related DWT data from the computed DWT coefficients; applying quantization to the extracted feature-related DWT data to obtain keys as results of the quantization; constructing a locality-sensitive fingerprint of the input data block; computing a similarity degree between the locality-sensitive fingerprint of the input data block and a locality-sensitive fingerprint of each data block in the plurality of the data blocks in a cache memory; selecting an optimal reference data block as the data block; determining a differential compression is required to be applied based on the similarity degree between the input data block and the optimal reference data block; applying the differential compression to the input data block and the optimal reference data block.
Public/Granted literature
- US20190294589A1 METHOD AND SYSTEM OF SIMILARITY-BASED DEDUPLICATION Public/Granted day:2019-09-26
Information query