SEAMLESS FAULT TOLERANCE VIA BLOCK REMAPPING AND EFFICIENT RECONCILIATION

    公开(公告)号:US20190065062A1

    公开(公告)日:2019-02-28

    申请号:US15853202

    申请日:2017-12-22

    Applicant: VMware, Inc.

    Abstract: In a storage cluster having nodes, blocks of a logical storage space of a storage object are allocated flexibly by a parent node to component nodes that are backed by physical storage. The method includes maintaining a first allocation map for the parent node, and second and third allocation maps for the first and second component nodes, respectively, executing a first write operation on the first component node and updating the second allocation map to indicate that the first block is a written block, and upon detecting that the first component node is offline, executing a second write operation that targets a second block of the logical storage space, which is allocated to the first component node, on the second component node and updating the third allocation map to indicate that the second block is a written block.

    HASH-BASED DATA TRANSFER IN DISTRIBUTED DEDUPLICATION STORAGE SYSTEMS

    公开(公告)号:US20190026303A1

    公开(公告)日:2019-01-24

    申请号:US15652572

    申请日:2017-07-18

    Applicant: VMware, Inc.

    Abstract: Exemplary methods, apparatuses, and systems include a destination node receiving, from a source node, a hash of data stored by the source node and designated for transfer from the source node to the destination node. In response to determining the hash received from the source node maps to data stored by the destination node, the destination node reads the data into a write buffer and transmits an indication to the source node that the data is present at the source node. The destination node reads the data from write buffer and, in response to determining the data read from the write buffer remains unchanged as stored by the destination node, increases a reference count for the data as stored by the destination node.

    GARBAGE COLLECTION IN A LOG-STRUCTURED FILE SYSTEM

    公开(公告)号:US20250028679A1

    公开(公告)日:2025-01-23

    申请号:US18356129

    申请日:2023-07-20

    Applicant: VMware, Inc.

    Abstract: An example method of managing a log-structured file system (LFS) on a storage device includes: receiving, at storage software executing on a host, an operation that overwrites a data block, the data block included in a segment of the LFS; determining from first metadata stored on the storage device, a change in utilization of the segment from a first utilization value to a second utilization value; modifying second metadata stored on the storage device to change a relation between the segment and a first bucket to be a relation between the segment and a second bucket, the first utilization value included in a range of the first bucket and the second utilization value included in a range of the second bucket; and executing a garbage collection process for the LFS that uses the second metadata to identify for garbage collection a set of segments in the second bucket.

    RESYNCHRONIZATION OF OBJECTS IN A VIRTUAL STORAGE SYSTEM

    公开(公告)号:US20250028471A1

    公开(公告)日:2025-01-23

    申请号:US18356125

    申请日:2023-07-20

    Applicant: VMware, Inc.

    Abstract: An example method of resynchronizing a first replica of an object and a second replica of an object in an object storage system, includes: determining, by storage software in response to the second replica transitioning from failed to available, a stale sequence number for the second replica, the storage software having associated the stale sequence number with the second replica when the second replica failed; querying, by the storage software, block-level metadata for the object using the stale sequence number, the block-level metadata relating logical blocks of the object with sequence numbers for operations on the object; determining, by the software as a result of the querying, a set of the logical blocks each related to a sequence number being the same or after the stale sequence number; and copying, by the storage software, data of the set of logical blocks from the first replica to the second replica.

    DYNAMIC GROWTH OF DATA CACHES USING BACKGROUND PROCESSES FOR HASH BUCKET GROWTH

    公开(公告)号:US20240070080A1

    公开(公告)日:2024-02-29

    申请号:US17900642

    申请日:2022-08-31

    Applicant: VMware, Inc.

    CPC classification number: G06F12/0864 G06F2212/1016 G06F2212/604

    Abstract: The disclosure describes growing a data cache using a background hash bucket growth process. A first memory portion is allocated to the data buffer of the data cache and a second memory portion is allocated to the metadata buffer of the data cache based on the cache growth instruction. The quantity of hash buckets in the hash bucket buffer is increased and the background hash bucket growth process is initiated, wherein the process is configured to rehash hash bucket entries of the hash bucket buffer in the increased quantity of hash buckets. A data entry is stored in the data buffer using the allocated first memory portion of the data cache and metadata associated with the data entry is stored using the allocated second memory portion of the metadata buffer, wherein a hash bucket entry associated with the data entry is stored in the increased quantity of hash buckets.

    PARALLELIZATION OF DISTRIBUTED WORKLOADS WITH CONSTRAINED RESOURCES USING COORDINATED THREADS

    公开(公告)号:US20220334859A1

    公开(公告)日:2022-10-20

    申请号:US17231386

    申请日:2021-04-15

    Applicant: VMware, Inc.

    Abstract: An example method of coordinating threads executing in a host cluster in a virtualized computing system is described. The host cluster includes hosts connected to a network. The method includes: assigning objects to owner threads of an owner executing in a first host of the hosts, the objects mapped to virtual resources attached to virtual machines (VMs) executing in the host cluster; assigning components of the objects to component threads executing in a second host of the hosts based on thread indexes of the owner threads, the component threads managing physical resources backing the virtual resources; and establishing connections through the network between the owner threads and the component threads.

    IDENTIFYING FAULT DOMAINS FOR DELTA COMPONENTS OF A DISTRIBUTED DATA OBJECT

    公开(公告)号:US20220171685A1

    公开(公告)日:2022-06-02

    申请号:US17106004

    申请日:2020-11-27

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes placing delta components of a base component in target fault domains. One or more delta components are generated. When a first fault domain that lacks a sibling component of the base component is identified, the first fault domain is selected as a single delta target fault domain and a single delta component is placed on the single delta target fault domain. When a second fault domain that includes a first sibling component of the base component is identified and a third fault domain that includes a second sibling component of the base component is identified, the second fault domain and the third fault domain are selected as a first double delta target fault domain and a second double delta target fault domain, and a first double delta component and a second double delta component are placed on the first and second double delta target fault domains.

    DATA ENCRYPTION IN A TWO-TIER STORAGE SYSTEM

    公开(公告)号:US20220066950A1

    公开(公告)日:2022-03-03

    申请号:US17002649

    申请日:2020-08-25

    Applicant: VMware, Inc.

    Abstract: A method for encrypting data blocks is provided. The method receives a plurality of data blocks and encrypts each data block using an LBA of the data block as a tweak. The method writes the plurality of encrypted data blocks to physical blocks of the plurality of physical disks. The method then performs deduplication on the physical disks by determining that first and second physical blocks in the physical disks are duplicates, decrypting encrypted data in the first physical block using a first LBA associated with the first physical block as the tweak, and re-encrypting decrypted data in the first physical block using a PBA associated with the first physical block as the tweak. When reading the data back, either the LBA or PBA is used as the tweak, depending on whether the data was encrypted using LBA or re-encrypted using PBA during the deduplication process.

    TRANSLATING HIGH LEVEL REQUIREMENTS POLICIES TO DISTRIBUTED CONFIGURATIONS

    公开(公告)号:US20210266268A1

    公开(公告)日:2021-08-26

    申请号:US17320145

    申请日:2021-05-13

    Applicant: VMware, Inc.

    Abstract: Embodiments of the disclosure provide techniques for partitioning a resource object into multiple resource components of a cluster of host computer nodes in a distributed resources system. The distributed resources system translates high-level policy requirements into a resource configuration that the system accommodates. The system determines an allocation based on the policy requirements and identifies resource configurations that are available. Upon selecting a resource configuration, the distributed resources system assigns the allocation and associated values to the selected configuration and publishes the new configuration to other host computer nodes in the cluster.

Patent Agency Ranking