-
11.
公开(公告)号:US11494083B2
公开(公告)日:2022-11-08
申请号:US16504204
申请日:2019-07-05
Applicant: VMWARE, INC.
Inventor: Yiqi Xu , Enning Xiang , Eric Knauft , Pascal Renauld
Abstract: The disclosure herein describes performing resynchronization (“resync”) jobs in a distributed storage system based on a parallelism policy. A resync job is obtained from a queue and input/output (I/O) resources that will be used during execution of the resync job are identified. Available bandwidth slots of each I/O resource of the identified I/O resources are determined. The parallelism policy is applied to the identified I/O resources and the available bandwidth slots. Based on the application of the parallelism policy, a bottleneck resource of the I/O resources is determined and a parallel I/O value is calculated based on the available bandwidth slots of the bottleneck resource, wherein the parallel I/O value indicates a quantity of I/O tasks that can be performed in parallel. The resync job is executed using the I/O resources, the execution of the resync job including performance of I/O tasks in parallel based on the parallel I/O value.
-
12.
公开(公告)号:US10810143B2
公开(公告)日:2020-10-20
申请号:US15944743
申请日:2018-04-03
Applicant: VMware, Inc.
Inventor: Eric Knauft , Enning Xiang , Yiqi Xu , Xiaochuan Shen
IPC: G06F13/16 , H04L12/873 , H04L29/08 , G06F9/455 , H04L12/875
Abstract: System and method for managing storage requests issued from multiple sources in a distributed storage system utilizes different queues at a host computer in the distributed storage system to place different classes of storage requests for access to a virtual storage area network. The storage requests in the queues are processed using a fair scheduling algorithm. For each queue, when the storage requests in the queue exceeds a threshold, a backpressure signal is generated and transmitted to at least one source for a class of storage requests queued in one of the queues corresponding to that backpressure signal to delay issuance of new storage requests of that class of storage requests.
-
公开(公告)号:US20190312925A1
公开(公告)日:2019-10-10
申请号:US15947313
申请日:2018-04-06
Applicant: VMware, Inc.
Inventor: Enning Xiang , Eric Knauft , Yiqi Xu , Xiaochuan Shen
Abstract: Computer system and method for managing storage requests in a distributed storage system uses congestion signals associated with storage requests, which are generated based on congestion at local storage of the computer system that supports a virtual storage area network. The storage requests are differentiated between a first class of storage requests and at least one other class of storage requests. For a storage request of the first class of storage requests, an actual ratio of a current average bandwidth of the first class of storage requests to a current average bandwidth of a second class of storage requests is calculated and compared with an expected ratio. The congestion signal associated with the storage request is then adjusted and transmitted to at least one source of storage requests for storage request fairness control.
-
14.
公开(公告)号:US11599554B2
公开(公告)日:2023-03-07
申请号:US16888527
申请日:2020-05-29
Applicant: VMware, Inc.
Inventor: Enning Xiang , Pascal Renauld , Sandeep Rangaswamy , Xin Li , Yiqi Xu , Venkata Ramanan
Abstract: The disclosure herein describes tracking changes to a stale component using a synchronization bitmap. A first component of a plurality of mirrored components of the distributed data object becomes available from an unavailable state, and a stale log sequence number (LSN) and a last committed LSN are identified. A synchronization bitmap of the first component associated with a range of LSNs (e.g., from the stale LSN to the last committed LSN) is created and configured to track changes to data blocks of the first component. A second component is identified based on the second component including a tracking bitmap associated with an LSN that matches the stale LSN of the first component. The first component is synchronized with data from the second component based on, wherein the synchronizing includes updating the synchronization bitmap to track changes made to data blocks of the first component.
-
15.
公开(公告)号:US11178227B1
公开(公告)日:2021-11-16
申请号:US17097479
申请日:2020-11-13
Applicant: VMware, Inc.
Inventor: Enning Xiang , Pratik Shridhar Desai , Eric Shannon Knauft , Yizhou Luo , Pascal Renauld , Yiqi Xu
IPC: H04L29/08 , G06F9/50 , G06F9/455 , H04L12/911
Abstract: Described herein are methods and systems for the efficient resyncing of stale components of a distributed-computing system. One method includes determining that a first base component at a remote site will go offline. After determining that the first base component at the remote site will go offline, a first delta component is created at the remote site. While the first base component at the remote site is offline, data corresponding to the offline component is collected at the first delta component at the remote site. After collecting data at the first delta component, the collected data is sent to a local site. The method includes determining that the first base component has come back online. In response to determining that the first base component has come back online, the collected data is sent from the first delta component to the first base component via an intra-site network.
-
16.
公开(公告)号:US11023493B2
公开(公告)日:2021-06-01
申请号:US16182448
申请日:2018-11-06
Applicant: VMware, Inc.
Inventor: Enning Xiang , Yiqi Xu , Eric Knauft , Pascal Renauld
Abstract: Techniques for intelligently scheduling resynchronization jobs in a distributed object-based storage system are provided. In one set of embodiments, a storage node of the system can create a resynchronization job for a component of an object maintained by the system, where the resynchronization job defines one or more input/output (I/O) operations to be carried out with respect to the component. If a number of currently running resynchronization jobs on the storage node has reached a threshold, the storage node can further determine a priority level associated with the object; add the resynchronization job to an object queue for the object; and if the added resynchronization job is a first job in the object queue, add the object queue as a new queue entry to a global priority queue corresponding to the priority level associated with the object.
-
公开(公告)号:US10761726B2
公开(公告)日:2020-09-01
申请号:US15954512
申请日:2018-04-16
Applicant: VMWare, Inc.
Inventor: Yiqi Xu , Eric Knauft , Enning Xiang , Xiaochuan Shen
IPC: G06F3/06 , H04L12/801 , H04L12/825
Abstract: Computer system and method for managing storage requests in a distributed storage system uses congestion data related to processing of storage requests for local storage to adaptively adjust a bandwidth limit for a first class of storage requests to be processed. The bandwidth limit is enforced on the storage requests belonging to the first class of storage requests without enforcing any bandwidth limit on the storage requests belonging to a second class of storage requests.
-
公开(公告)号:US10270469B2
公开(公告)日:2019-04-23
申请号:US15604459
申请日:2017-05-24
Applicant: VMware, Inc.
Inventor: Enning Xiang , Yiqi Xu
Abstract: Certain embodiments described herein are generally directed to generating an updated version of an existing code block in response to a data update to an existing data block of a plurality of data blocks in a distributed multi-mirror erasure coding system. For example, in some embodiments, a first operation cost to generate the updated version of the existing code block by a first method based on the plurality of data blocks and the data update is determined. In certain embodiments, a second operation cost to generate the updated version of the existing code block by a second method based on the existing code block, the existing data block, and the data update is determined. In some embodiments, if the first operation cost is less than or equal to the second operation cost, the first method is used. Otherwise, the second method is used.
-
19.
公开(公告)号:US20230169036A1
公开(公告)日:2023-06-01
申请号:US17522820
申请日:2021-11-09
Applicant: VMware, Inc.
Inventor: Enning Xiang , Wenguang Wang , Yiqi Xu
IPC: G06F16/11
CPC classification number: G06F16/128
Abstract: System and method for deleting parent snapshots of running points of storage objects stored in a storage system, in response to a request to delete a parent snapshot of a running point of a storage object stored in the storage system, changes the minimum extent ownership value of the running point to the minimum extent ownership value of the parent snapshot so that any physical extent with an extent ownership value equal to or greater than the changed minimum extent ownership value is deemed to be owned by the running point. For each logical block of the parent snapshot, depending on whether the physical extent corresponding to that logical block is determined to be exclusively accessible to the parent snapshot, the physical extent is removed or no action is taken on the physical extent so that the physical extent is used by the running point.
-
公开(公告)号:US11327841B2
公开(公告)日:2022-05-10
申请号:US16875838
申请日:2020-05-15
Applicant: VMware, Inc.
Inventor: Enning Xiang , Ojan Thornycroft , Yiqi Xu , Zhihao Yao , Eric Knauft
Abstract: The disclosure herein describes placing a delta component of a base component in a target fault domain. A delta component associated with a base component is generated. The generation includes selecting a first fault domain as a target fault domain for the delta component based on the first fault domain including a witness component associated with the distributed data object of the base component. Otherwise, the generation includes selecting a second fault domain as the target fault domain based on the second fault domain including at least one data component that includes a different address space than the base component. Otherwise, the generation includes selecting a third fault domain as the target fault domain based on the third fault domain being unused. Then, the delta component is placed on the target fault domain, whereby data durability of the distributed data object is enhanced, and available fault domains are preserved.
-
-
-
-
-
-
-
-
-