IDENTIFYING FAULT DOMAINS FOR DELTA COMPONENTS OF A DISTRIBUTED DATA OBJECT

    公开(公告)号:US20220171685A1

    公开(公告)日:2022-06-02

    申请号:US17106004

    申请日:2020-11-27

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes placing delta components of a base component in target fault domains. One or more delta components are generated. When a first fault domain that lacks a sibling component of the base component is identified, the first fault domain is selected as a single delta target fault domain and a single delta component is placed on the single delta target fault domain. When a second fault domain that includes a first sibling component of the base component is identified and a third fault domain that includes a second sibling component of the base component is identified, the second fault domain and the third fault domain are selected as a first double delta target fault domain and a second double delta target fault domain, and a first double delta component and a second double delta component are placed on the first and second double delta target fault domains.

    MAINTAINING PARTITION-TOLERANT DISTRIBUTED METADATA

    公开(公告)号:US20180227363A1

    公开(公告)日:2018-08-09

    申请号:US15427778

    申请日:2017-02-08

    Applicant: VMware, Inc.

    Inventor: Enning XIANG

    CPC classification number: H04L67/1095 H04L41/044 H04L41/0896 H04L67/1097

    Abstract: Exemplary methods, apparatuses, and systems include a master node receiving, from a new node, a request indicating the new node is joining a cluster of nodes. The master node transmits, to the new node, an identifier of a delegate node within the cluster. The master node receives, from the delegate node, a request to maintain a synchronization point while the delegate node creates and transmits a snapshot of cluster metadata. The master node receives, from the new node, an indication that the new node is ready to join the cluster. Upon determining that the cluster has synchronized metadata following the synchronization point of the delegate node and prior to the ready indication, the master node transmits an acknowledgment to the new node to cause the new node to transition to an active state within the cluster.

    SYSTEM AND METHODS OF AN EFFICIENT CACHE ALGORITHM IN A HIERARCHICAL STORAGE SYSTEM

    公开(公告)号:US20170293570A1

    公开(公告)日:2017-10-12

    申请号:US15097159

    申请日:2016-04-12

    Applicant: VMware, Inc.

    Abstract: An in-memory cache for a computer system having a first storage and a second storage where the first storage is a cache for the second storage, tracks priority levels of block attributes stored therein. If a data item is cached in the first storage, the block attribute corresponding to the data item is stored in the in-memory cache as a high priority block attribute. If a data item evicted from the first storage, the block attribute corresponding to the data item is stored in the in-memory cache as a low priority block attribute. When the cache becomes full, the low priority block attributes are evicted before the high priority block attributes.

    METHOD AND SYSTEM FOR ROBUST MESSAGE RETRANSMISSION
    14.
    发明申请
    METHOD AND SYSTEM FOR ROBUST MESSAGE RETRANSMISSION 有权
    用于稳健消息重传的方法和系统

    公开(公告)号:US20160277152A1

    公开(公告)日:2016-09-22

    申请号:US14664497

    申请日:2015-03-20

    Applicant: VMware, Inc.

    CPC classification number: H04L1/1848 H04L1/1854 H04L1/1874 H04L1/1896

    Abstract: Techniques are disclosed for message retransmission. In one embodiment, an agent in a distributed system that receives and/or relays messages from a master node identifies messages that have not been successfully delivered, and adds a stub for each such message to a message queue. The agent then requests retransmission of missing messages in the message queue and sets flags associated with the message stubs to indicate that retransmission requests have been sent. If one (or more) of the messages cannot be retransmitted, the master node sends acknowledgment message(s) notifying the agent of the master node's inability to retransmit the messages. The agent then resets the flags corresponding to those messages to indicate that retransmission request(s) need to be sent again.

    Abstract translation: 公开了用于消息重传的技术。 在一个实施例中,从主节点接收和/或中继消息的分布式系统中的代理标识尚未成功传递的消息,并将每个这样的消息的存根添加到消息队列。 然后,代理请求在消息队列中重传丢失的消息,并设置与消息存根相关联的标志,以指示已发送重传请求。 如果一个(或多个)消息不能被重新发送,则主节点发送确认消息,通知代理人主节点不能重传消息。 然后代理复位与这些消息相对应的标志,以指示需要再次发送重传请求。

    EFFICIENT METHOD FOR MANAGING STORAGE SPACE AND SNAPSHOTS

    公开(公告)号:US20230092177A1

    公开(公告)日:2023-03-23

    申请号:US17478397

    申请日:2021-09-17

    Applicant: VMware, Inc.

    Abstract: A method of managing storage space of a storage device containing a plurality of snapshots of a file includes the steps of: recording a first count record that includes a number of data blocks that are owned by a first snapshot; after recording the first count record, recording a second count record that includes a number of data blocks that are both owned by the first snapshot and shared with a second snapshot that is a child snapshot of the first snapshot; and determining an amount of reclaimable space of the first snapshot as the difference between the numbers of data blocks of the first and second count records.

    MAINTAINING DURABILITY OF A DATA OBJECT USING UNPLANNED DELTA COMPONENTS DURING TRANSIENT FAILURES

    公开(公告)号:US20230018790A1

    公开(公告)日:2023-01-19

    申请号:US17377128

    申请日:2021-07-15

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes enhancing data durability of a base component of a data object using an unplanned delta component during transient fault unavailability. A base component of a data object becoming unavailable due to a transient fault is detected. A delta component associated with the base component is generated, wherein the delta component includes unwritten storage space with an address space and a tracking bitmap including a plurality of bits associated with data blocks of the address space of the delta component. The stale LSN with which the base component is associated is assigned to the delta component and the delta component is synchronized with an active component of the data object based on the assigned stale LSN. The delta component records write I/O targeted for the base component and, based on detecting the base component becoming available, the base component is synchronized with the delta component.

    SYNCHRONIZING CHANGES TO STALE COMPONENTS OF A DISTRIBUTED OBJECT USING SYNCHRONIZATION BITMAPS

    公开(公告)号:US20210374155A1

    公开(公告)日:2021-12-02

    申请号:US16888527

    申请日:2020-05-29

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes tracking changes to a stale component using a synchronization bitmap. A first component of a plurality of mirrored components of the distributed data object becomes available from an unavailable state, and a stale log sequence number (LSN) and a last committed LSN are identified. A synchronization bitmap of the first component associated with a range of LSNs (e.g., from the stale LSN to the last committed LSN) is created and configured to track changes to data blocks of the first component. A second component is identified based on the second component including a tracking bitmap associated with an LSN that matches the stale LSN of the first component. The first component is synchronized with data from the second component based on, wherein the synchronizing includes updating the synchronization bitmap to track changes made to data blocks of the first component.

    IDENTIFYING A FAULT DOMAIN FOR A DELTA COMPONENT OF A DISTRIBUTED DATA OBJECT

    公开(公告)号:US20210357291A1

    公开(公告)日:2021-11-18

    申请号:US16875838

    申请日:2020-05-15

    Applicant: VMware, Inc.

    Abstract: The disclosure herein describes placing a delta component of a base component in a target fault domain. A delta component associated with a base component is generated. The generation includes selecting a first fault domain as a target fault domain for the delta component based on the first fault domain including a witness component associated with the distributed data object of the base component. Otherwise, the generation includes selecting a second fault domain as the target fault domain based on the second fault domain including at least one data component that includes a different address space than the base component. Otherwise, the generation includes selecting a third fault domain as the target fault domain based on the third fault domain being unused. Then, the delta component is placed on the target fault domain, whereby data durability of the distributed data object is enhanced, and available fault domains are preserved.

    SYSTEM AND METHODS OF EFFICIENTLY RESYNCING FAILED COMPONENTS WITHOUT BITMAP IN AN ERASURE-CODED DISTRIBUTED OBJECT WITH LOG-STRUCTURED DISK LAYOUT

    公开(公告)号:US20210349793A1

    公开(公告)日:2021-11-11

    申请号:US16870861

    申请日:2020-05-08

    Applicant: VMware, Inc.

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for resynchronizing data in a storage system. One of the methods includes determining that a particular disk of a capacity object of a storage system was offline for an interval of time, wherein the capacity object comprises a plurality of segments, and wherein the storage system comprises a segment usage table identifying a linked list of particular segments of the capacity object that are in use; determining a time point at which the particular disk went offline; determining one or more first segments of the capacity object that were modified after the time point, wherein determining one or more first segments comprises determining each segment of the segment usage table having a transaction ID that is larger than the time point; and resynchronizing, for each first segment, a portion of the particular disk corresponding to the first segment.

Patent Agency Ranking