公开(公告)号：US11099938B2

公开(公告)日：2021-08-24

申请号：US16051456

申请日：2018-07-31

Applicant: VMware, Inc.

Inventor： Asit Desai ,  Derek Uluski ,  Alexander T. Garthwaite ,  Sunil Satnur ,  Ilya Languev ,  Anoop Jaishankar

IPC: G06F11/00 ,  G06F11/14 ,  G06F3/06 ,  G06F16/11 ,  G06F16/901

Abstract: System and method for creating linked clones of storage objects stored in a storage uses a target storage structure that includes a linked clone being created from a selected snapshot of a storage object and surface snapshots. The linked clone is created in the target storage structure with references to the selected snapshot of the storage object in a source storage structure without completely copying the selected snapshot to the target storage structure. The surface snapshots, which correspond to other snapshots of the storage object in the source storage structure, are created in the target storage structure with references to the other snapshots without completely copying the other snapshots to the target storage structure to produce the linked clone with similar snapshots as the storage object at a point in time when the selected snapshot was captured.

公开(公告)号：US11385817B2

公开(公告)日：2022-07-12

申请号：US17028312

申请日：2020-09-22

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Junlong Gao ,  Ilya Languev ,  Petr Vandrovec ,  Maxime Austruy ,  Ilia Sokolinski ,  Satish Pudi

IPC: G06F3/06 ,  G06F12/1018

Abstract: The present disclosure is related to methods, systems, and machine-readable media for supporting deduplication in object storage using subset hashes. A plurality of hashes of a plurality of blocks of a plurality of log segments can be received from a software defined data center, wherein each block corresponds to a respective logical address. Each of the plurality of logical addresses can be associated with a respective sequentially-allocated chunk identifier in a logical map. A subset hash comprising a hash of a subset of the plurality of blocks can be determined that corresponds to a contiguous range of the plurality of logical addresses. A search of a hash map for the subset hash can be performed to determine if the subset hash is a duplicate. The subset of the plurality of blocks can be deduplicated responsive to a determination that the subset hash is a duplicate.

公开(公告)号：US20220066882A1

公开(公告)日：2022-03-03

申请号：US17002577

申请日：2020-08-25

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Junlong Gao ,  Petr Vandrovec ,  Ilya Languev ,  Maxime Austruy ,  Ilia Sokolinski ,  Satish Pudi

IPC: G06F11/14 ,  G06F12/02 ,  G06F3/06

Abstract: Techniques for tiering data to a cold storage tier of a cloud object storage platform are provided. In one set of embodiments, a computer system can identify one or more old snapshots of a data set that reside in a first storage tier of the cloud object storage platform, where the one or more old snapshots are snapshots that are unlikely to be deleted from the cloud object storage platform within a period of N days. The computer system can further, for each snapshot in the one or more old snapshots: identify one or more data blocks in the snapshot that are superseded by a more recent snapshot in the one or more old snapshots; write the one or more data blocks to a second (i.e., cold) storage tier of the cloud object storage platform that has a lower storage cost than the first storage tier; and cause the one or more data blocks to be deleted from the first storage tier.

公开(公告)号：US11221944B1

公开(公告)日：2022-01-11

申请号：US17002667

申请日：2020-08-25

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Junlong Gao ,  Ilya Languev ,  Petr Vandrovec ,  Maxime Austruy ,  Ilia Sokolinski ,  Satish Pudi

IPC: G06F12/12 ,  G06F12/02 ,  G06F12/109

Abstract: A method for managing metadata for data stored in a cloud storage is provided. The method receives, at a first of a plurality of metadata servers, information associated with an object stored in the cloud storage, the information comprising a plurality of LBAs for where the object is stored. Each metadata server allocates contiguous chunk IDs for a group of objects. The method generates a new chunk ID for the object, which is a combination of a unique fixed value and a monotonically incrementing local value associated with each LBA, such that a first LBA is mapped to a first chunk ID having a first local value and a next LBA is mapped to a second chunk ID having the first local value incremented as a second local value. The method stores the new chunk ID and other metadata in one or more tables stored in a metadata storage.

公开(公告)号：US11663160B2

公开(公告)日：2023-05-30

申请号：US17002669

申请日：2020-08-25

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Junlong Gao ,  Petr Vandrovec ,  Ilya Languev ,  Maxime Austruy ,  Ilia Sokolinski ,  Satish Pudi

IPC: G06F16/11 ,  G06F16/27 ,  G06F16/20 ,  G06F16/25 ,  G06F11/14 ,  H04L67/1097

CPC classification number: G06F16/128 ,  G06F11/1471 ,  G06F16/20 ,  G06F16/273 ,  H04L67/1097 ,  G06F11/1451 ,  G06F16/258 ,  G06F2201/80 ,  G06F2201/84

Abstract: In one set of embodiments, a computer system can create a snapshot of a data set, where the snapshot includes a plurality of data blocks of the data set. The computer system can upload the snapshot to a cloud object storage platform of a cloud infrastructure, where the snapshot is uploaded as a plurality of log segments conforming to an object format of the cloud object storage platform, and where each log segment includes one or more data blocks in the plurality of data blocks, and a set of metadata comprising, for each of the one or more data blocks, an identifier of the data set, an identifier of the snapshot, and a logical block address (LBA) of the data block. The computer system can then communicate the set of metadata to a server component running in a cloud compute and block storage platform of the cloud infrastructure.

公开(公告)号：US20230251997A1

公开(公告)日：2023-08-10

申请号：US18303478

申请日：2023-04-19

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Junlong Gao ,  Petr Vandrovec ,  Ilya Languev ,  Maxime Austruy ,  Ilia Sokolinski ,  Satish Pudi

IPC: G06F16/11 ,  G06F11/14 ,  H04L67/1097 ,  G06F16/27 ,  G06F16/20

CPC classification number: G06F16/128 ,  G06F11/1471 ,  H04L67/1097 ,  G06F16/273 ,  G06F16/20 ,  G06F11/1451 ,  G06F16/258

Abstract: Techniques for recovering metadata associated with data backed up in cloud object storage are provided. In one set of embodiments, a computer system can create a snapshot of a data set, where the snapshot includes a plurality of data blocks of the data set that have been modified since the creation of a prior snapshot of the data set. The computer system can further upload the snapshot to a cloud object storage platform of a cloud infrastructure, where the snapshot is uploaded as a plurality of log segments conforming to an object format of the cloud object storage platform, and where each log segment includes one or more data blocks in the plurality of data blocks, and a set of metadata comprising, for each of the one or more data blocks, an identifier of the data set, an identifier of the snapshot, and a logical block address (LBA) of the data block. The computer system can then communicate the set of metadata to a server component running in a cloud compute and block storage platform of the cloud infrastructure.

公开(公告)号：US11334545B2

公开(公告)日：2022-05-17

申请号：US16112698

申请日：2018-08-25

Applicant: VMware, Inc.

Inventor： Asit Desai ,  Derek Uluski ,  Alexander T. Garthwaite ,  Sunil Satnur ,  Ilya Languev ,  Tan Li ,  Raveesh Ahuja

IPC: G06F16/22

Abstract: System and method for managing space in storage object structures stored in a storage system uses an object B tree structure to manage a storage object in a storage object structure in the storage system, which provides virtual physical block addresses for data of the storage object and for metadata of nodes of the object B tree structure. The metadata of the nodes of the object B tree structure is written in the storage object structure using first real physical block addresses, which are translated from the virtual block addresses for the metadata of the nodes of the object B tree structure using a metadata system file B tree structure. The data of the storage object is written in the storage object structure using second real physical block addresses, which are translated from the virtual block addresses for the data of the storage object using a data system file B tree structure.

公开(公告)号：US11288129B2

公开(公告)日：2022-03-29

申请号：US17002577

申请日：2020-08-25

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Junlong Gao ,  Petr Vandrovec ,  Ilya Languev ,  Maxime Austruy ,  Ilia Sokolinski ,  Satish Pudi

IPC: G06F11/14 ,  G06F3/06 ,  G06F12/02

Abstract: Techniques for tiering data to a cold storage tier of a cloud object storage platform are provided. In one set of embodiments, a computer system can identify one or more old snapshots of a data set that reside in a first storage tier of the cloud object storage platform, where the one or more old snapshots are snapshots that are unlikely to be deleted from the cloud object storage platform within a period of N days. The computer system can further, for each snapshot in the one or more old snapshots: identify one or more data blocks in the snapshot that are superseded by a more recent snapshot in the one or more old snapshots; write the one or more data blocks to a second (i.e., cold) storage tier of the cloud object storage platform that has a lower storage cost than the first storage tier; and cause the one or more data blocks to be deleted from the first storage tier.

公开(公告)号：US20220092033A1

公开(公告)日：2022-03-24

申请号：US17028405

申请日：2020-09-22

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Junlong Gao ,  Maxime Austruy ,  Petr Vandrovec ,  Ilya Languev ,  Ilia Sokolinski ,  Satish Pudi

IPC: G06F16/174 ,  G06F16/13 ,  G06F16/14

Abstract: The present disclosure is related to methods, systems, and machine-readable media for supporting deduplication in file storage using file chunk hashes. A hash of a chunk of a log segment can be received from a software defined data center. A chunk identifier can be associated with the hash in a hash map that stores associations between sequentially-allocated chunk identifiers and hashes. The chunk identifier can be associated with a logical address corresponding to the chunk of the log segment in a logical map that stores associations between the sequentially-allocated chunk identifiers and logical addresses. A search of the hash map can be performed to determine if the chunk is a duplicate, and the chunk can be deduplicated responsive to a determination that the chunk is a duplicate.

公开(公告)号：US11500819B2

公开(公告)日：2022-11-15

申请号：US17028405

申请日：2020-09-22

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Junlong Gao ,  Maxime Austruy ,  Petr Vandrovec ,  Ilya Languev ,  Ilia Sokolinski ,  Satish Pudi

IPC: G06F7/00 ,  G06F16/174 ,  G06F16/14 ,  G06F16/13

Abstract: The present disclosure is related to methods, systems, and machine-readable media for supporting deduplication in file storage using file chunk hashes. A hash of a chunk of a log segment can be received from a software defined data center. A chunk identifier can be associated with the hash in a hash map that stores associations between sequentially-allocated chunk identifiers and hashes. The chunk identifier can be associated with a logical address corresponding to the chunk of the log segment in a logical map that stores associations between the sequentially-allocated chunk identifiers and logical addresses. A search of the hash map can be performed to determine if the chunk is a duplicate, and the chunk can be deduplicated responsive to a determination that the chunk is a duplicate.