Throttling resynchronization operations in a data store cluster based on I/O bandwidth limits

    公开(公告)号:US10860254B2

    公开(公告)日:2020-12-08

    申请号:US16387433

    申请日:2019-04-17

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes throttling resynchronization operations in a cluster of distributed data stores based on I/O bandwidth limits. Resynchronization operations are added to a queue as they are received. A cluster resource manager accesses a resynchronization operation in the queue. A transient capacity value is determined and an available capacity value is obtained. A resynchronization limit of the cluster is identified, wherein the resynchronization limit indicates a maximum percentage of I/O bandwidth of the cluster that is for use by resynchronization operations. Based on a sum of the resynchronization capacity value and the transient capacity value being less than or equal to a product of the resynchronization limit and the available capacity value, the cluster resource manager initiates the accessed resynchronization operation on the cluster, whereby free space is maintained in the cluster for use by user operations.

    Reconfiguring data objects using batch processing of concatenated components

    公开(公告)号:US10949089B2

    公开(公告)日:2021-03-16

    申请号:US16442889

    申请日:2019-06-17

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes reconfiguring a data object in a data store using batch portions of components of the data object. Instructions to reconfigure the data object to a target object layout are received, the data object including a concatenation layer that references a plurality of components. The components are grouped into batch portions and the batch portions are reconfigured in a series based on the received instructions. The reconfiguring for each batch portion includes allocating free storage space according to the target object layout as target components, copying the data stored in the batch portion to the target components, redirecting references in the concatenation layer from the components of the batch portion to the target components, and releasing storage space occupied by the components of the batch portion. As a result, storage space used as transient capacity during the reconfiguring is reduced to a size of the batch portions.

    THROTTLING RESYNCHRONIZATION OPERATIONS IN A DATA STORE CLUSTER BASED ON I/O BANDWIDTH LIMITS

    公开(公告)号:US20200333977A1

    公开(公告)日:2020-10-22

    申请号:US16387433

    申请日:2019-04-17

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes throttling resynchronization operations in a cluster of distributed data stores based on I/O bandwidth limits. Resynchronization operations are added to a queue as they are received. A cluster resource manager accesses a resynchronization operation in the queue. A transient capacity value is determined and an available capacity value is obtained. A resynchronization limit of the cluster is identified, wherein the resynchronization limit indicates a maximum percentage of I/O bandwidth of the cluster that is for use by resynchronization operations. Based on a sum of the resynchronization capacity value and the transient capacity value being less than or equal to a product of the resynchronization limit and the available capacity value, the cluster resource manager initiates the accessed resynchronization operation on the cluster, whereby free space is maintained in the cluster for use by user operations.

Patent Agency Ranking