-
公开(公告)号:US10437817B2
公开(公告)日:2019-10-08
申请号:US16113151
申请日:2018-08-27
Applicant: Huawei Technologies Co., Ltd.
Inventor: Michael Hirsch , Yair Toaff , Yehonatan David
Abstract: A system for segmenting an input data stream, comprising a processor adapted to split an input data stream to a plurality of data sub-streams such that each of the plurality of data sub-streams has an overlapping portion with a consecutive data sub-stream of the plurality of data sub-streams, create concurrently a plurality of segmented data sub-streams by concurrently segmenting the plurality of data sub-streams each in one of a plurality of processing pipelines of the processor and join the plurality of segmented data sub-streams to create a segmented data stream by synchronizing a sequencing of each of the plurality of segmented data sub-streams according to one or more overlapping segments in the overlapping portion of each two consecutive data sub-streams of the plurality of data sub-streams.
-
公开(公告)号:US20220188202A1
公开(公告)日:2022-06-16
申请号:US17684598
申请日:2022-03-02
Applicant: Huawei Technologies Co., Ltd.
Inventor: Yehonatan David , Anthony Berkow , Boris Liberman
Abstract: A device is configured to index file system names and paths of a single chain of backed-up snapshots. The device is configured to obtain a first snapshot of the file system. Further, the device is configured to scan the first snapshot of the file system to obtain a first scan of the nodes and the tree structure at a first time point. The device is further configured to insert the first scan into a database. Then the device is configured to index the nodes in the database.
-
公开(公告)号:US11989103B2
公开(公告)日:2024-05-21
申请号:US17684598
申请日:2022-03-02
Applicant: Huawei Technologies Co., Ltd.
Inventor: Yehonatan David , Anthony Berkow , Boris Liberman
CPC classification number: G06F11/1466 , G06F16/128 , G06F16/2246
Abstract: A device is configured to index file system names and paths of a single chain of backed-up snapshots. The device is configured to obtain a first snapshot of the file system. Further, the device is configured to scan the first snapshot of the file system to obtain a first scan of the nodes and the tree structure at a first time point. The device is further configured to insert the first scan into a database. Then the device is configured to index the nodes in the database.
-
公开(公告)号:US11977518B2
公开(公告)日:2024-05-07
申请号:US17573376
申请日:2022-01-11
Applicant: Huawei Technologies Co., Ltd.
Inventor: Assaf Natanzon , Yehonatan David
IPC: G06F16/174
CPC classification number: G06F16/1748 , G06F16/1744
Abstract: A method for data deduplication and compression in untrusted storage system is provided for storing large amount of data more efficiently and in a secure manner and by maintaining the integrity of the data. Such data deduplication and compression in untrusted storage system is achieved by utilizing by a system comprising a set of trusted servers, which are configured to trust each other and to share common encryption keys.
-
公开(公告)号:US11507539B2
公开(公告)日:2022-11-22
申请号:US16800743
申请日:2020-02-25
Applicant: Huawei Technologies Co., Ltd.
Inventor: Michael Hirsch , Yehonatan David , Yair Toaff
IPC: G06F16/174 , G06F16/16 , G06F16/182 , G06F16/14
Abstract: An apparatus stores received data blocks as deduplicated data blocks. The apparatus is configured to: maintain a plurality of containers, where a reference to a container is unique within the apparatus and each container includes one or more data segments and segment metadata for each data segment, the segment metadata including a segment identifier and a segment reference, where the segment identifier is unique within the container and the segment reference is unique within the apparatus; and maintain a plurality of deduplicated data blocks storing received data blocks, where each deduplicated data block includes a plurality of identified container references, where a container reference identifier is unique within the deduplicated data block, and an ordered list of one or more segment indicators.
-
公开(公告)号:US10459961B2
公开(公告)日:2019-10-29
申请号:US15667267
申请日:2017-08-02
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Yehonatan David , Yair Toaff , Michael Hirsch
Abstract: A system for segmenting an input data stream using vector processing, comprising a processor adapted to repeat the following steps throughout an input data stream to create a segmented data stream consisting a plurality of segments: apply a rolling sequence over a sequence of consecutive data items of an input data stream, the rolling sequence includes a subset of consecutive data items of the sequence, calculate concurrently a plurality of partial hash values each by one of a plurality of processing pipelines of the processor, each for a respective one of a plurality of partial rolling sequences each including evenly spaced data items of the subset, determine compliance of each of the plurality of partial hash values with one or more respective partial segmentation criteria and designate the sequence as a variable size segment when at least some of the partial hash values comply with the respective partial segmentation criteria.
-
-
-
-
-