Invention Application
- Patent Title: EFFICIENT DEDUPLICATION USING BLOCK-BASED CONVERGENT ENCRYPTION
-
Application No.: US17037369Application Date: 2020-09-29
-
Publication No.: US20220103338A1Publication Date: 2022-03-31
- Inventor: Marc Brooker , Derek Manwaring , Osman Surkatty , Mikhail Danilov , Peter Martin McDonnell , Stefan Schneider
- Applicant: Amazon Technologies, Inc.
- Applicant Address: US WA Seattle
- Assignee: Amazon Technologies, Inc.
- Current Assignee: Amazon Technologies, Inc.
- Current Assignee Address: US WA Seattle
- Main IPC: H04L9/06
- IPC: H04L9/06 ; H04L9/08

Abstract:
Systems and methods are described for providing secure storage of data sets while enabling efficient deduplication of data. Each data set can be divided into fixed-length blocks. The plaintext of each block can be convergently encrypted, such as by using a hash of the plaintext as an encryption key, to result in block-level ciphertext that can be stored. If two data sets share blocks, the resulting block-level ciphertext can be expected to overlap, and thus duplicative block-level ciphertexts need not be stored. A manifest can be created to facilitate re-creation of the data set, which manifest identifies the block-level ciphertexts of the data set and a key by which each block-level ciphertext was encrypted. By use of block-level encryption, nearly identical data sets can be largely deduplicated, even if they are not perfectly identical.
Public/Granted literature
- US11582025B2 Efficient deduplication using block-based convergent encryption Public/Granted day:2023-02-14
Information query