公开(公告)号：US11314440B1

公开(公告)日：2022-04-26

申请号：US17072904

申请日：2020-10-16

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsidhar Gunturu ,  Junlong Gao ,  Ilya Languev ,  Petr Vandrovec ,  Maxime Austruy ,  Ilia Sokolinski ,  Satish Pudi

IPC: G06F3/06 ,  G06F9/455

Abstract: Techniques for the increased efficiency of storing data objects storage in the object storage of a software designed data center (SDDC) are provided. The techniques include the efficient storage of data, while enabling snapshots of each updating of the data. The snapshots of the data may be efficiently recovered via the techniques. Difference-level mappings for each snapshot are encoded in compact self-balancing data trees included in the object's metadata. The metadata mappings include mappings between various address spaces employed by the SDDC, as well as the address spaces employed by data stores that store the data on physical medium. Because the metadata is efficiently structured, the metadata for an object may be cached for quick lookups during data access and/or snapshot recovery. The techniques also provide low-latency recovery and/or system rollback in the event of any failure in the SDDC.

公开(公告)号：US11263146B2

公开(公告)日：2022-03-01

申请号：US16914149

申请日：2020-06-26

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Eric Knauft ,  Vamsidhar Gunturu

IPC: G06F11/10 ,  G06F11/00 ,  H03M13/15 ,  H03M13/00 ,  G06F12/10

Abstract: Systems for accessing client data is described. A request to access a first data block is received. The request indicates a first logical address referencing the first data block. First mapping data is employed to identify a first physical addresses corresponding to the first logical addresses. The first mapping data encodes a first LOM transaction ID and candidate local addresses. The first mapping data is employed to identify the candidate local address and the first LOM transaction ID. A usage table is employed to determine the current status of the first LOM transaction ID. The candidate local address is employed to access the first data block. Second mapping data is employed to identify an updated local address of the set of local addresses. The updated local address currently references the first data block. The updated local address is employed to access the first data block.

公开(公告)号：US11507544B2

公开(公告)日：2022-11-22

申请号：US16894663

申请日：2020-06-05

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsidhar Gunturu ,  Eric Knauft ,  Pascal Renauld

IPC: G06F7/00 ,  G06F16/18 ,  G06F16/182 ,  G06F16/17 ,  G06F16/22 ,  G06F12/02 ,  G06F12/0817 ,  G06F16/2457

Abstract: Techniques for efficiently storing client data blocks on a distributed-computing system are provided. The system includes a fast performance tier and a large capacity tier. The capacity tier stores the client data blocks in erasure encoded data stripes. The performance tier stores logical map data including an address map indicating a correspondence between logical addresses associated with a first layer of the system and physical addresses associated with a second layer. A method includes receiving a request to include additional client data blocks in the client blocks. The request indicates logical addresses for additional blocks. Corresponding physical addresses for additional block are determined. Each additional block is stored at the physical address. Additional logical map data is stored in the performance tier. Storing the additional logical map data includes updating the address map to indicate the correspondence between the logical addresses and the physical addresses for the additional blocks.

公开(公告)号：US11262919B2

公开(公告)日：2022-03-01

申请号：US16914166

申请日：2020-06-26

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsidhar Gunturu

IPC: G06F3/06 ,  G06F3/00 ,  G06F16/13

Abstract: Client data is structured as a set of data blocks. A first subset of data blocks is stored on a current segment of the disks. A second subset of data blocks is stored on a previous segment. A request to clean client data is received, including a request to update the current segment to include the second subset of data blocks. The second subset of data blocks is accessed and transmitted from a lower layer to a higher system layer. Parity data is generated at the higher layer. The parity data is transmitted to the lower layer. The lower layer updates second mapping data. In the updated mapping of the second mapping data, each local address that references a data block of the second subset of data blocks is included in the current segment of the plurality of disks. The lower layer writes the parity data in the current segment.

公开(公告)号：US11334497B2

公开(公告)日：2022-05-17

申请号：US16914171

申请日：2020-06-26

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsidhar Gunturu

IPC: G06F12/10 ,  G06F12/00 ,  G06F16/18 ,  H03M13/15 ,  H03M13/00

Abstract: Client data is structured as a set of data blocks. A first subset of data blocks is stored on a current segment of a plurality of disks. A second subset of data blocks is stored on a previous segment. A request to clean client data is received. The request includes a request to update the current segment to include the second subset of data blocks. The second subset of data blocks is accessed and transmitted from a lower layer to a higher layer of the system. Parity data is generated at the higher layer. The parity data is transmitted to the lower layer. The lower layer is employed to generate a local copy of the second subset of data blocks. Each local address that references the local copy of the second subset of data blocks is included in the current segment. The parity data is written in the current segment.

公开(公告)号：US20210382825A1

公开(公告)日：2021-12-09

申请号：US16914149

申请日：2020-06-26

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Eric Knauft ,  Vamsidhar Gunturu

IPC: G06F12/10 ,  H03M13/15

Abstract: Systems for accessing client data is described. A request to access a first data block is received. The request indicates a first logical address referencing the first data block. First mapping data is employed to identify a first physical addresses corresponding to the first logical addresses. The first mapping data encodes a first LOM transaction ID and candidate local addresses. The first mapping data is employed to identify the candidate local address and the first LOM transaction ID. A usage table is employed to determine the current status of the first LOM transaction ID. The candidate local address is employed to access the first data block. Second mapping data is employed to identify an updated local address of the set of local addresses. The updated local address currently references the first data block. The updated local address is employed to access the first data block.

公开(公告)号：US11144394B1

公开(公告)日：2021-10-12

申请号：US16894646

申请日：2020-06-05

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Eric Knauft ,  Vamsidhar Gunturu

IPC: G06F11/10 ,  G06F11/00 ,  H03M13/15 ,  H03M13/00 ,  G06F16/18 ,  G06F16/22

Abstract: Systems, for managing metadata data blocks, include a fast performance tier and a large capacity tier. The capacity tier stores the data blocks in erasure-encoded stripes. The performance tier stores map data indicating correspondences between logical addresses, associated with a first layer of the system, and physical addresses associated with a second layer. The map data is structured as a B-tree with leaf nodes and index nodes. A method includes determining a volume associated with the leaves. In response to the volume being greater than a threshold, migrating a portion of the leaves to the stripes of the capacity tier. A portion of the indexes that include pointers to the migrated portion of the leaves are updated to include updated pointers to physical addresses of the stripes that store the migrated leaves. A portion of the performance tier that stores the migrated leaves is re-allocated to store additional map data.