SYNCHRONIZING A STALE COMPONENT OF A DISTRIBUTED OBJECT USING A DELTA COMPONENT DURING MAINTENANCE

    公开(公告)号:US20210357122A1

    公开(公告)日:2021-11-18

    申请号:US16875624

    申请日:2020-05-15

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes enhancing data durability of a base component using a delta component. A delta component is generated based on the base component becoming unavailable. The delta component is configured to include unwritten storage space with an address space matching the base component and a tracking bitmap associated with data blocks of the address space of the delta component. Write operations targeted for the base component are routed to the delta component. Based on the routed write operations, bits associated with data blocks affected by the write operations are changed in the tracking bitmap. Based on the base component becoming available, data blocks affected by routed write operations are identified based on the tracking bitmap and the identified data blocks are synchronized from the delta component to the base component. The delta component is then removed.

    EFFICIENT DATA WRITE APPROACH FOR DISTRIBUTED MULTI-MIRROR ERASURE CODING SYSTEM

    公开(公告)号:US20180343019A1

    公开(公告)日:2018-11-29

    申请号:US15604459

    申请日:2017-05-24

    Applicant: VMware, Inc.

    CPC classification number: H03M13/154 G06F11/1076 H03M13/1515

    Abstract: Certain embodiments described herein are generally directed to generating an updated version of an existing code block in response to a data update to an existing data block of a plurality of data blocks in a distributed multi-mirror erasure coding system. For example, in some embodiments, a first operation cost to generate the updated version of the existing code block by a first method based on the plurality of data blocks and the data update is determined. In certain embodiments, a second operation cost to generate the updated version of the existing code block by a second method based on the existing code block, the existing data block, and the data update is determined. In some embodiments, if the first operation cost is less than or equal to the second operation cost, the first method is used. Otherwise, the second method is used.

    MODIFIED COPY-ON-WRITE SNAPSHOTTING
    4.
    发明公开

    公开(公告)号:US20230333766A1

    公开(公告)日:2023-10-19

    申请号:US17724456

    申请日:2022-04-19

    Applicant: VMware, Inc.

    CPC classification number: G06F3/0647 G06F3/0655 G06F3/0604 G06F3/0679

    Abstract: Example methods and systems for creating a plurality of snapshots of a storage object backed by a plurality of copy-on-write (COW) B+ tree data structure including a first COW B+ tree data structure having a first root node and leaf nodes maintaining mappings of LBAs to PBAs associated with a first snapshot of the storage object are disclosed. One example method includes creating a first root node of a first B+ tree data structure, maintaining a delta mapping table between a set of LBAs to a set of PBAs in the first leaf node, in response to receiving a request to create a second snapshot of the storage object: creating a second root node of a second COW B+ tree data structure and creating leaf nodes of the second COW B+ tree data structure in batches based on an order of the set of LBAs.

    PARALLELIZATION OF DISTRIBUTED WORKLOADS WITH CONSTRAINED RESOURCES USING COORDINATED THREADS

    公开(公告)号:US20220334859A1

    公开(公告)日:2022-10-20

    申请号:US17231386

    申请日:2021-04-15

    Applicant: VMware, Inc.

    Abstract: An example method of coordinating threads executing in a host cluster in a virtualized computing system is described. The host cluster includes hosts connected to a network. The method includes: assigning objects to owner threads of an owner executing in a first host of the hosts, the objects mapped to virtual resources attached to virtual machines (VMs) executing in the host cluster; assigning components of the objects to component threads executing in a second host of the hosts based on thread indexes of the owner threads, the component threads managing physical resources backing the virtual resources; and establishing connections through the network between the owner threads and the component threads.

    DRR-BASED TWO STAGES IO SCHEDULING ALGORITHM FOR STORAGE SYSTEM WITH DYNAMIC BANDWIDTH REGULATION

    公开(公告)号:US20220179710A1

    公开(公告)日:2022-06-09

    申请号:US17112618

    申请日:2020-12-04

    Applicant: VMware, Inc.

    Abstract: An efficient scheduling of IOs in a computing system using dynamic bandwidth regulation includes building up a shared regulator to limit the total IOPS scheduling among all IO classes at any given time. Reserved regulators may be used to place limits on the IOPS scheduled for a particular IO class at any given time. An outstanding IO window may also limit the overall number of outstanding IOs, and/or the bytes of outstanding IOs at any particular time. A first stage of IO scheduling may involve enforcing the reserved regulators to limit the IOPS scheduled for particular IO classes. A second stage of IO scheduling may involve enforcing the shared regulator to limit the total IOPS scheduled for all IO classes.

    IDENTIFYING FAULT DOMAINS FOR DELTA COMPONENTS OF A DISTRIBUTED DATA OBJECT

    公开(公告)号:US20220171685A1

    公开(公告)日:2022-06-02

    申请号:US17106004

    申请日:2020-11-27

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes placing delta components of a base component in target fault domains. One or more delta components are generated. When a first fault domain that lacks a sibling component of the base component is identified, the first fault domain is selected as a single delta target fault domain and a single delta component is placed on the single delta target fault domain. When a second fault domain that includes a first sibling component of the base component is identified and a third fault domain that includes a second sibling component of the base component is identified, the second fault domain and the third fault domain are selected as a first double delta target fault domain and a second double delta target fault domain, and a first double delta component and a second double delta component are placed on the first and second double delta target fault domains.

    EFFICIENT METHOD FOR MANAGING STORAGE SPACE AND SNAPSHOTS

    公开(公告)号:US20230092177A1

    公开(公告)日:2023-03-23

    申请号:US17478397

    申请日:2021-09-17

    Applicant: VMware, Inc.

    Abstract: A method of managing storage space of a storage device containing a plurality of snapshots of a file includes the steps of: recording a first count record that includes a number of data blocks that are owned by a first snapshot; after recording the first count record, recording a second count record that includes a number of data blocks that are both owned by the first snapshot and shared with a second snapshot that is a child snapshot of the first snapshot; and determining an amount of reclaimable space of the first snapshot as the difference between the numbers of data blocks of the first and second count records.

    MAINTAINING DURABILITY OF A DATA OBJECT USING UNPLANNED DELTA COMPONENTS DURING TRANSIENT FAILURES

    公开(公告)号:US20230018790A1

    公开(公告)日:2023-01-19

    申请号:US17377128

    申请日:2021-07-15

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes enhancing data durability of a base component of a data object using an unplanned delta component during transient fault unavailability. A base component of a data object becoming unavailable due to a transient fault is detected. A delta component associated with the base component is generated, wherein the delta component includes unwritten storage space with an address space and a tracking bitmap including a plurality of bits associated with data blocks of the address space of the delta component. The stale LSN with which the base component is associated is assigned to the delta component and the delta component is synchronized with an active component of the data object based on the assigned stale LSN. The delta component records write I/O targeted for the base component and, based on detecting the base component becoming available, the base component is synchronized with the delta component.

    SYNCHRONIZING CHANGES TO STALE COMPONENTS OF A DISTRIBUTED OBJECT USING SYNCHRONIZATION BITMAPS

    公开(公告)号:US20210374155A1

    公开(公告)日:2021-12-02

    申请号:US16888527

    申请日:2020-05-29

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes tracking changes to a stale component using a synchronization bitmap. A first component of a plurality of mirrored components of the distributed data object becomes available from an unavailable state, and a stale log sequence number (LSN) and a last committed LSN are identified. A synchronization bitmap of the first component associated with a range of LSNs (e.g., from the stale LSN to the last committed LSN) is created and configured to track changes to data blocks of the first component. A second component is identified based on the second component including a tracking bitmap associated with an LSN that matches the stale LSN of the first component. The first component is synchronized with data from the second component based on, wherein the synchronizing includes updating the synchronization bitmap to track changes made to data blocks of the first component.

Patent Agency Ranking