公开(公告)号：US12124701B2

公开(公告)日：2024-10-22

申请号：US18159656

申请日：2023-01-25

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Eric Knauft ,  Sudheer Thokala

IPC: G06F3/06

CPC classification number: G06F3/061 ,  G06F3/0652 ,  G06F3/0679

Abstract: Components of a distributed data object are synchronized using streamlined tracking metadata. A target component of the distributed data object is detected as it becomes available and stale. A source component that is up-to-date and that mirrors the address space of the detected target component is identified. A set of mapped address ranges and a set of unmapped address ranges of the identified source component are obtained. A mapped address range of the target component that corresponds with an unmapped address range of the source component is identified. The identified mapped address range of the target component is then synchronized with the corresponding unmapped address range of the source component. Thus, unmapped address ranges are synchronized without using tracking metadata of the source component.

公开(公告)号：US11907161B2

公开(公告)日：2024-02-20

申请号：US17367233

申请日：2021-07-02

Applicant: VMware, Inc.

Inventor： Asit Desai ,  Abhay Kumar Jain ,  Wenguang Wang ,  Eric Knauft ,  Enning Xiang

IPC: G06F16/14 ,  G06F16/11 ,  G06F12/10 ,  G06F3/06

CPC classification number: G06F16/122 ,  G06F3/0604 ,  G06F3/067 ,  G06F3/0659 ,  G06F3/0664 ,  G06F12/10 ,  G06F16/148

Abstract: An example method of upgrading a distributed storage object from a first version to a second version includes: querying metadata of a first component configured according to the first version of the distributed storage object, the metadata defining extents of data on a disk group of the first component; populating, for a second component configured according to the second version of the distributed storage object, logical and middle maps based on the metadata such that initial entries in the logical map point to initial entries in the middle map, and the initial entries in the middle map point to physical addresses of the disk group of the first component; and reading the data from the disk group of the first component and writing the data to a disk group of the second component while updating the initial entries in the middle map.

公开(公告)号：US11748139B2

公开(公告)日：2023-09-05

申请号：US16999569

申请日：2020-08-21

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Eric Knauft ,  Pascal Renauld ,  Matt Amdur ,  Blake Lewis ,  Peng Mi

IPC: G06F9/455 ,  G06F16/188 ,  G06F12/02

CPC classification number: G06F9/45558 ,  G06F12/0253 ,  G06F16/188 ,  G06F2009/45583 ,  G06F2212/1044

Abstract: The present disclosure is related to methods, systems, and machine-readable media for log-structured file system management operations. An aggregate amount of over-provisioned computing resources assigned to a plurality of log-structured file system (LFS) objects that are allocated for performance of memory management operations associated with a virtual storage area network (vSAN) can be determined. A subset of LFS objects that are candidates for performance of a particular memory management operation based on an amount of over-provisioned computing resources consumed by one or more LFS objects among the plurality of LFS objects exceeding a resource consumption threshold associated with the determined amount of over-provisioned computing resources assigned to the plurality of LFS objects can be selected. The particular memory management operation using one or more of the candidate LFS objects can be performed.

公开(公告)号：US11379318B2

公开(公告)日：2022-07-05

申请号：US16870852

申请日：2020-05-08

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Eric Knauft

IPC: G06F11/14 ,  G06F3/06

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for resynchronizing data in a storage system. One of the methods includes receiving, by a first storage subsystem, a plurality of write requests corresponding to respective meta data blocks, wherein the first storage subsystem comprises a meta object; storing, by the first storage subsystem and for each write request, in each disk of the meta object, a version of the corresponding meta data block; determining that a particular disk of the meta object has failed; determining whether one or more valid versions of the meta data block are stored in respective other disks of the meta object; and in response to determining that one or more valid versions of the meta data block are stored in respective other disks of the meta object, resynchronizing the meta data block in the particular disk.

公开(公告)号：US11327841B2

公开(公告)日：2022-05-10

申请号：US16875838

申请日：2020-05-15

Applicant: VMware, Inc.

Inventor： Enning Xiang ,  Ojan Thornycroft ,  Yiqi Xu ,  Zhihao Yao ,  Eric Knauft

IPC: G06F3/00 ,  G06F11/00 ,  G06F11/10 ,  G06F3/06 ,  G06F11/20

Abstract: The disclosure herein describes placing a delta component of a base component in a target fault domain. A delta component associated with a base component is generated. The generation includes selecting a first fault domain as a target fault domain for the delta component based on the first fault domain including a witness component associated with the distributed data object of the base component. Otherwise, the generation includes selecting a second fault domain as the target fault domain based on the second fault domain including at least one data component that includes a different address space than the base component. Otherwise, the generation includes selecting a third fault domain as the target fault domain based on the third fault domain being unused. Then, the delta component is placed on the target fault domain, whereby data durability of the distributed data object is enhanced, and available fault domains are preserved.

公开(公告)号：US20220100392A1

公开(公告)日：2022-03-31

申请号：US17033610

申请日：2020-09-25

Applicant: VMware Inc.

Inventor： Asit Desai ,  Wenguang Wang ,  Eric Knauft ,  Vamsi Gunturu

IPC: G06F3/06 ,  G06F11/10

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for maintaining fault tolerance for new writes in a storage system when one or more components of the storage system are unavailable. One of the methods includes determining that one or more first disks of a capacity object of a storage system are unavailable, wherein the storage system comprises a segment usage table identifying the plurality of segments of the capacity object; in response: identifying a plurality of available second disks, adding a plurality of new segments corresponding to the second disks to the capacity object, and adding data identifying the plurality of new segments to the segment usage table; and for each of one or more new write requests to the capacity object: identifying an available segment from the plurality of new segments, and writing data associated with the new write request to the identified available segment.

公开(公告)号：US20220058043A1

公开(公告)日：2022-02-24

申请号：US16999569

申请日：2020-08-21

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Eric Knauft ,  Pascal Renauld ,  Matt Amdur ,  Blake Lewis ,  Peng Mi

IPC: G06F9/455 ,  G06F16/188 ,  G06F12/02

Abstract: The present disclosure is related to methods, systems, and machine-readable media for log-structured file system management operations. An aggregate amount of over-provisioned computing resources assigned to a plurality of log-structured file system (LFS) objects that are allocated for performance of memory management operations associated with a virtual storage area network (vSAN) can be determined. A subset of LFS objects that are candidates for performance of a particular memory management operation based on an amount of over-provisioned computing resources consumed by one or more LFS objects among the plurality of LFS objects exceeding a resource consumption threshold associated with the determined amount of over-provisioned computing resources assigned to the plurality of LFS objects can be selected. The particular memory management operation using one or more of the candidate LFS objects can be performed.

公开(公告)号：US20220027187A1

公开(公告)日：2022-01-27

申请号：US16937780

申请日：2020-07-24

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Matt Amdur ,  Vamsi Gunturu ,  Eric Knauft ,  Pascal Renauld ,  Blake Lewis ,  Peng Mi

IPC: G06F9/455 ,  G06F16/11 ,  G06F16/901

Abstract: The present disclosure is related to methods, systems, and machine-readable media for supporting clones with consolidated snapshots. A clone of a virtual computing instance can be created in a snapshot tree provided by a software defined data center. A consolidated snapshot including tuples from a diskchain of the clone in the snapshot tree can be created responsive to a determination that the snapshot tree exceeds a threshold.

公开(公告)号：US11182261B1

公开(公告)日：2021-11-23

申请号：US17106050

申请日：2020-11-27

Applicant: VMware, Inc.

Inventor： Eric Knauft ,  Enning Xiang ,  Ojan Thornycroft ,  Yiqi Xu ,  Asit Desai ,  Varun Shah

IPC: G06F11/00 ,  G06F11/16 ,  G06F11/14 ,  G06F11/20 ,  G06F11/07

Abstract: The disclosure herein describes enhancing data durability of a base component using multiple delta components. A first and second delta component are generated based on the base component becoming unavailable. A write operation targeted for the base component is routed to the first delta component and to the second delta component. Based on routing the write operation targeted for the base component to the first delta component and to the second delta component, a bit associated with a data block affected by the write operation is changed in each of the tracking bitmaps of the first and second delta components. Based on detecting the base component becoming available, one delta component of the first and second delta components is selected, and the data block affected by the routed write operation is synchronized from the selected delta component to the base component. Later, the first and second delta components are removed.

公开(公告)号：US20210311919A1

公开(公告)日：2021-10-07

申请号：US16842657

申请日：2020-04-07

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Eric Knauft

IPC: G06F16/215 ,  H04L29/08 ,  G06F16/23 ,  G06F12/0804

Abstract: Techniques for reducing data log recovery time and metadata write amplification when checkpointing a data log of a storage object in a distributed storage system are provided. In one set of embodiments, a node of the system can determine whether the data log has reached a first threshold size, where the data log comprises a plurality of data log records, and where each data log record includes data and metadata for a write request directed to the storage object. If the data log has reached the first threshold size, the node can copy, from each of the plurality of data log records, the metadata for the write request to a corresponding metadata log entry in a metadata log of the storage object. The node can then truncate the data log by removing the plurality of data log records.