公开(公告)号：US11487456B1

公开(公告)日：2022-11-01

申请号：US17238984

申请日：2021-04-23

Applicant: VMware, Inc.

Inventor： Enning Xiang ,  Wenguang Wang

IPC: G06F3/06 ,  G06F12/02

Abstract: A method for updating block addresses is provided. The method includes overwriting content of a first data block referenced by a first logical block address (LBA) with updated content. Prior to overwriting, the content of the first data block is stored in a first physical block corresponding to a first physical block address (PBA), a logical map maps the first LBA to a first middle block address (MBA), and a middle map maps the first MBA to the first PBA. After overwriting, the updated content of the first data block is stored in a second physical block corresponding to a second PBA and, in response to the overwriting, the middle map is updated to map the first MBA to the second PBA instead of the first PBA.

公开(公告)号：US11481140B1

公开(公告)日：2022-10-25

申请号：US17222621

申请日：2021-04-05

Applicant: VMware, Inc.

Inventor： Jyothir Ramanan ,  Matthew B Amdur ,  Wenguang Wang ,  Enning Xiang

IPC: G06F12/00 ,  G06F3/06

Abstract: Techniques for implementing dynamic base disk mirroring for linked clones are provided. In one set of embodiments, a first node in a distributed storage system can monitor a congestion level of a base disk residing on the first node, where the base disk is shared by a plurality of linked clones. Upon determining that the congestion level exceeds a threshold, the first node can send, to a second node, a request to create a mirror of the base disk on that second node. Upon receiving an acknowledgement from the second node that the mirror has been successfully created, the first node can update a mirror set associated with the base disk to include an entry identifying the mirror. The first node can then communicate the updated mirror set to one or more other nodes.

公开(公告)号：US11429498B2

公开(公告)日：2022-08-30

申请号：US16870861

申请日：2020-05-08

Applicant: VMware, Inc.

Inventor： Wenguang Wang ,  Vamsi Gunturu ,  Enning Xiang ,  Eric Knauft

IPC: G06F11/00 ,  G06F11/14 ,  G06F3/06 ,  G06F11/10

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for resynchronizing data in a storage system. One of the methods includes determining that a particular disk of a capacity object of a storage system was offline for an interval of time, wherein the capacity object comprises a plurality of segments, and wherein the storage system comprises a segment usage table identifying a linked list of particular segments of the capacity object that are in use; determining a time point at which the particular disk went offline; determining one or more first segments of the capacity object that were modified after the time point, wherein determining one or more first segments comprises determining each segment of the segment usage table having a transaction ID that is larger than the time point; and resynchronizing, for each first segment, a portion of the particular disk corresponding to the first segment.

公开(公告)号：US11157195B2

公开(公告)日：2021-10-26

申请号：US16445649

申请日：2019-06-19

Applicant: VMware, Inc.

Inventor： Enning Xiang ,  Eric Knauft ,  Pascal Renauld

IPC: G06F3/06

Abstract: Systems and techniques are described for transferring data. A described technique includes determining that a first replica of an object stored at a first host has become available to a distributed storage system after previously being unavailable to the distributed storage system. The object includes a range of memory addresses at which data of the object is stored. In response to determining that the first replica has become available, resyncing data for the first replica is obtained. The resyncing data indicates whether each range of memory addresses is synchronized at the first replica with other replicas of the object. Tracking data for the first replica is obtained. The tracking data indicates whether data stored at the range of memory addresses of the object has been modified at a second replica while the first replica was unavailable. The resyncing data is updated based on the tracking data.

公开(公告)号：US10924550B2

公开(公告)日：2021-02-16

申请号：US16015820

申请日：2018-06-22

Applicant: VMware, Inc.

Inventor： Yuehai Xu ,  Enning Xiang ,  Mukund Srinivasan ,  Jorge Guerra Delgado

IPC: H04L29/08 ,  H04L12/18 ,  H04L29/06

Abstract: A distributed key-value storage system may include a master node. The key-value store may be distributed among first and second nodes. The master node may receive a publish request to publish one or more key-value pairs. Each key-value pair may be stored in a retransmit buffer and sent to all the first nodes using a communication protocol of a first kind that does not include a retransmit protocol mechanism. Some of the key-value pairs may be sent to one or more second node using a communication protocol of a second kind that includes a retransmit protocol mechanism.

公开(公告)号：US10810143B2

公开(公告)日：2020-10-20

申请号：US15944743

申请日：2018-04-03

Applicant: VMware, Inc.

Inventor： Eric Knauft ,  Enning Xiang ,  Yiqi Xu ,  Xiaochuan Shen

IPC: G06F13/16 ,  H04L12/873 ,  H04L29/08 ,  G06F9/455 ,  H04L12/875

Abstract: System and method for managing storage requests issued from multiple sources in a distributed storage system utilizes different queues at a host computer in the distributed storage system to place different classes of storage requests for access to a virtual storage area network. The storage requests in the queues are processed using a fair scheduling algorithm. For each queue, when the storage requests in the queue exceeds a threshold, a backpressure signal is generated and transmitted to at least one source for a class of storage requests queued in one of the queues corresponding to that backpressure signal to delay issuance of new storage requests of that class of storage requests.

公开(公告)号：US20190312925A1

公开(公告)日：2019-10-10

申请号：US15947313

申请日：2018-04-06

Applicant: VMware, Inc.

Inventor： Enning Xiang ,  Eric Knauft ,  Yiqi Xu ,  Xiaochuan Shen

IPC: H04L29/08 ,  H04L12/26 ,  G06F3/06 ,  G06F9/455

Abstract: Computer system and method for managing storage requests in a distributed storage system uses congestion signals associated with storage requests, which are generated based on congestion at local storage of the computer system that supports a virtual storage area network. The storage requests are differentiated between a first class of storage requests and at least one other class of storage requests. For a storage request of the first class of storage requests, an actual ratio of a current average bandwidth of the first class of storage requests to a current average bandwidth of a second class of storage requests is calculated and compared with an expected ratio. The congestion signal associated with the storage request is then adjusted and transmitted to at least one source of storage requests for storage request fairness control.

公开(公告)号：US10237346B2

公开(公告)日：2019-03-19

申请号：US15427778

申请日：2017-02-08

Applicant: VMware, Inc.

Inventor： Enning Xiang

IPC: H04L29/08 ,  H04L12/24

Abstract: Exemplary methods, apparatuses, and systems include a master node receiving, from a new node, a request indicating the new node is joining a cluster of nodes. The master node transmits, to the new node, an identifier of a delegate node within the cluster. The master node receives, from the delegate node, a request to maintain a synchronization point while the delegate node creates and transmits a snapshot of cluster metadata. The master node receives, from the new node, an indication that the new node is ready to join the cluster. Upon determining that the cluster has synchronized metadata following the synchronization point of the delegate node and prior to the ready indication, the master node transmits an acknowledgment to the new node to cause the new node to transition to an active state within the cluster.

公开(公告)号：US10033812B2

公开(公告)日：2018-07-24

申请号：US14850220

申请日：2015-09-10

Applicant: VMware, Inc.

Inventor： Yuehai Xu ,  Enning Xiang ,  Mukund Srinivasan ,  Jorge Guerra Delgado

IPC: G06F15/16 ,  H04L29/08 ,  H04L12/18 ,  H04L29/06

Abstract: A distributed key-value storage system may include a master node. The key-value store may be distributed among first and second nodes. The master node may receive a publish request to publish one or more key-value pairs. Each key-value pair may be stored in a retransmit buffer and sent to all the first nodes using a communication protocol of a first kind that does not include a retransmit protocol mechanism. Some of the key-value pairs may be sent to one or more second node using a communication protocol of a second kind that includes a retransmit protocol mechanism.

公开(公告)号：US09614646B2

公开(公告)日：2017-04-04

申请号：US14664497

申请日：2015-03-20

Applicant: VMware, Inc.

Inventor： Enning Xiang ,  Jorge Guerra Delgado

IPC: H04L1/18

CPC classification number: H04L1/1848 ,  H04L1/1854 ,  H04L1/1874 ,  H04L1/1896

Abstract: Techniques are disclosed for message retransmission. In one embodiment, an agent in a distributed system that receives and/or relays messages from a master node identifies messages that have not been successfully delivered, and adds a stub for each such message to a message queue. The agent then requests retransmission of missing messages in the message queue and sets flags associated with the message stubs to indicate that retransmission requests have been sent. If one (or more) of the messages cannot be retransmitted, the master node sends acknowledgment message(s) notifying the agent of the master node's inability to retransmit the messages. The agent then resets the flags corresponding to those messages to indicate that retransmission request(s) need to be sent again.