公开(公告)号：US11748139B2

公开(公告)日：2023-09-05

申请号：US16999569

申请日：2020-08-21

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Eric Knauft ,  Pascal Renauld ,  Matt Amdur ,  Blake Lewis ,  Peng Mi

IPC: G06F9/455 ,  G06F16/188 ,  G06F12/02

CPC classification number: G06F9/45558 ,  G06F12/0253 ,  G06F16/188 ,  G06F2009/45583 ,  G06F2212/1044

Abstract: The present disclosure is related to methods, systems, and machine-readable media for log-structured file system management operations. An aggregate amount of over-provisioned computing resources assigned to a plurality of log-structured file system (LFS) objects that are allocated for performance of memory management operations associated with a virtual storage area network (vSAN) can be determined. A subset of LFS objects that are candidates for performance of a particular memory management operation based on an amount of over-provisioned computing resources consumed by one or more LFS objects among the plurality of LFS objects exceeding a resource consumption threshold associated with the determined amount of over-provisioned computing resources assigned to the plurality of LFS objects can be selected. The particular memory management operation using one or more of the candidate LFS objects can be performed.

公开(公告)号：US11704284B2

公开(公告)日：2023-07-18

申请号：US16847543

申请日：2020-04-13

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu

IPC: G06F16/17 ,  G06F16/11 ,  G06F16/182 ,  G06F12/0873 ,  G06F12/02 ,  G06F11/30 ,  G06F16/215

CPC classification number: G06F16/1734 ,  G06F11/3034 ,  G06F12/0246 ,  G06F12/0873 ,  G06F16/119 ,  G06F16/1727 ,  G06F16/1824 ,  G06F16/215 ,  G06F2212/7201

Abstract: Solutions for supporting storage using a multi-writer log-structured file system (LFS) are disclosed that include receiving incoming data from an object of a plurality of objects that are configured to simultaneously write to the LFS from different nodes; based at least on receiving the incoming data, determining whether sufficient free segments are available in a local segment usage table (SUT) for writing the incoming data; based at least on determining that insufficient free segments are available, requesting allocation of new free segments; writing the incoming data to a log; acknowledging the writing to the object; determining whether the log has accumulated a full segment of data; based at least on determining that the log has accumulated a full segment of data, writing the full segment of data to a first segment of the free segments; and updating the local SUT to mark the first segment as no longer free.

公开(公告)号：US11663160B2

公开(公告)日：2023-05-30

申请号：US17002669

申请日：2020-08-25

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Junlong Gao ,  Petr Vandrovec ,  Ilya Languev ,  Maxime Austruy ,  Ilia Sokolinski ,  Satish Pudi

IPC: G06F16/11 ,  G06F16/27 ,  G06F16/20 ,  G06F16/25 ,  G06F11/14 ,  H04L67/1097

CPC classification number: G06F16/128 ,  G06F11/1471 ,  G06F16/20 ,  G06F16/273 ,  H04L67/1097 ,  G06F11/1451 ,  G06F16/258 ,  G06F2201/80 ,  G06F2201/84

Abstract: In one set of embodiments, a computer system can create a snapshot of a data set, where the snapshot includes a plurality of data blocks of the data set. The computer system can upload the snapshot to a cloud object storage platform of a cloud infrastructure, where the snapshot is uploaded as a plurality of log segments conforming to an object format of the cloud object storage platform, and where each log segment includes one or more data blocks in the plurality of data blocks, and a set of metadata comprising, for each of the one or more data blocks, an identifier of the data set, an identifier of the snapshot, and a logical block address (LBA) of the data block. The computer system can then communicate the set of metadata to a server component running in a cloud compute and block storage platform of the cloud infrastructure.

公开(公告)号：US20230067709A1

公开(公告)日：2023-03-02

申请号：US18048170

申请日：2022-10-20

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Junlong Gao ,  Vamsi Gunturu

IPC: G06F3/06 ,  G06F16/17

Abstract: Scalable segment cleaning for log-structured file systems (LFSs) includes determining counts of segment cleaners and virtual nodes, with each virtual node being associated with a plurality of objects. Each virtual node is assigned to a selected segment cleaner. Based at least on the assignments, performing, for each virtual node, segment cleaning of the objects by the assigned segment cleaner. A portion, less than all, of the virtual nodes are reassigned to a newly selected segment cleaner based on a change of the count of the segment cleaners and/or a change of the count of the virtual nodes. Based at least on the reassignments, segment cleaning of the objects is performed, for each reassigned virtual node, by the reassigned segment cleaner. In some examples, the objects comprise virtual machine disks (VMDKs) and the segment cleaning uses a segment usage table (SUT) to track segment usage and identify segment cleaning candidates.

公开(公告)号：US11379318B2

公开(公告)日：2022-07-05

申请号：US16870852

申请日：2020-05-08

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Eric Knauft

IPC: G06F11/14 ,  G06F3/06

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for resynchronizing data in a storage system. One of the methods includes receiving, by a first storage subsystem, a plurality of write requests corresponding to respective meta data blocks, wherein the first storage subsystem comprises a meta object; storing, by the first storage subsystem and for each write request, in each disk of the meta object, a version of the corresponding meta data block; determining that a particular disk of the meta object has failed; determining whether one or more valid versions of the meta data block are stored in respective other disks of the meta object; and in response to determining that one or more valid versions of the meta data block are stored in respective other disks of the meta object, resynchronizing the meta data block in the particular disk.

公开(公告)号：US20220100392A1

公开(公告)日：2022-03-31

申请号：US17033610

申请日：2020-09-25

Applicant: VMware Inc.

Inventor： Asit Desai ,  Wenguang Wang ,  Eric Knauft ,  Vamsi Gunturu

IPC: G06F3/06 ,  G06F11/10

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for maintaining fault tolerance for new writes in a storage system when one or more components of the storage system are unavailable. One of the methods includes determining that one or more first disks of a capacity object of a storage system are unavailable, wherein the storage system comprises a segment usage table identifying the plurality of segments of the capacity object; in response: identifying a plurality of available second disks, adding a plurality of new segments corresponding to the second disks to the capacity object, and adding data identifying the plurality of new segments to the segment usage table; and for each of one or more new write requests to the capacity object: identifying an available segment from the plurality of new segments, and writing data associated with the new write request to the identified available segment.

公开(公告)号：US20220058043A1

公开(公告)日：2022-02-24

申请号：US16999569

申请日：2020-08-21

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Eric Knauft ,  Pascal Renauld ,  Matt Amdur ,  Blake Lewis ,  Peng Mi

IPC: G06F9/455 ,  G06F16/188 ,  G06F12/02

Abstract: The present disclosure is related to methods, systems, and machine-readable media for log-structured file system management operations. An aggregate amount of over-provisioned computing resources assigned to a plurality of log-structured file system (LFS) objects that are allocated for performance of memory management operations associated with a virtual storage area network (vSAN) can be determined. A subset of LFS objects that are candidates for performance of a particular memory management operation based on an amount of over-provisioned computing resources consumed by one or more LFS objects among the plurality of LFS objects exceeding a resource consumption threshold associated with the determined amount of over-provisioned computing resources assigned to the plurality of LFS objects can be selected. The particular memory management operation using one or more of the candidate LFS objects can be performed.

公开(公告)号：US20220027187A1

公开(公告)日：2022-01-27

申请号：US16937780

申请日：2020-07-24

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Matt Amdur ,  Vamsi Gunturu ,  Eric Knauft ,  Pascal Renauld ,  Blake Lewis ,  Peng Mi

IPC: G06F9/455 ,  G06F16/11 ,  G06F16/901

Abstract: The present disclosure is related to methods, systems, and machine-readable media for supporting clones with consolidated snapshots. A clone of a virtual computing instance can be created in a snapshot tree provided by a software defined data center. A consolidated snapshot including tuples from a diskchain of the clone in the snapshot tree can be created responsive to a determination that the snapshot tree exceeds a threshold.

公开(公告)号：US20220019529A1

公开(公告)日：2022-01-20

申请号：US16933183

申请日：2020-07-20

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu

IPC: G06F12/06

Abstract: A logical map represents fragments from separate versions of a data object. Migration of data from a first (old) version to the second (new) version happens gradually, where write operations go to the new version of the data object. The logical map initially points to the old data object, but is updated to point to the portions of the new data object as write operations are performed on the new data object. A background migration copies data from the old data object to the new data object.

公开(公告)号：US11226760B2

公开(公告)日：2022-01-18

申请号：US16842604

申请日：2020-04-07

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu

IPC: G06F3/06

Abstract: Techniques for supporting large segments when issuing writes to an erasure coded storage object in a distributed storage system are provided. In one set of embodiments, a node of the system can receive a write request for updating a logical data block of the storage object, write data/metadata for the block to a record in a data log of a metadata object of the storage object (where the metadata object is stored on a performance storage tier), and determine whether the data log has accumulated a threshold number of records. If so, the node can further allocate an in-memory bank, place the data from the data log records into free slots of the bank, allocate a segment in a capacity object of the storage object for holding contents of the bank (where the capacity object is stored on a capacity storage tier), and write the bank contents via a full stripe write to the allocated segment.