METHOD AND SYSTEM FOR LIBFABRIC ATOMICS-BASED LOCKLESS CLUSTER-WIDE SHARED MEMORY ACCESS API IN A DISTRIBUTED SYSTEM

    公开(公告)号:US20220413743A1

    公开(公告)日:2022-12-29

    申请号:US17362587

    申请日:2021-06-29

    Abstract: The system allocates, in a distributed system comprising a plurality of nodes, a plurality of portions of memory which comprise shared remote memory content. The system registers the allocated portions with an operating system to be accessed via RDMA. The system accesses, by a first node, the allocated portions to obtain a local copy. The system performs an atomic operation on one or more bits of the shared remote memory content via libfabric atomic application programming interface calls, by one or more of: updating the one or more bits based on a new value and an offset; retrieving, from the shared remote memory content based on the offset, a current value of the one or more bits prior to the updating; and performing an action on the shared remote memory content based on a comparison of the retrieved current value with an expected value in the local copy.

    Method and system for persistent partitionable distributed map using sparse arrays and sparse ordered two-bit bitmaps in shared memory

    公开(公告)号:US11604603B2

    公开(公告)日:2023-03-14

    申请号:US17355000

    申请日:2021-06-22

    Abstract: One aspect facilitates a global map in a distributed system. The system generates a first data structure which comprises key-value pairs, wherein, in a respective key-value pair, the respective key is an integer and the respective value comprises a pointer to a sparse array which includes a bitmap (such as an ordered two-bit bitmap). The system stores the first data structure as a first partition of the global map. The system searches, based on a pattern, the first data structure to obtain a first value. If the first value comprises a two-bit bitmap, the system converts, based on the pattern, the first value to a two-dimensional bitmap, and performs a function on the first value to obtain a first result. The system uses the first value or the first result as metadata to execute a read or write operation in a filesystem associated with the distributed system.

    Method and system for dynamic topology-aware space allocation in a distributed system

    公开(公告)号:US11687272B2

    公开(公告)日:2023-06-27

    申请号:US17359080

    申请日:2021-06-25

    CPC classification number: G06F3/0655 G06F3/064 G06F3/0604 G06F3/067

    Abstract: A system divides non-volatile memory of a plurality of storage devices into physical extents which comprises chunks. The system allocates slabs associated with the storage devices, wherein a respective slab comprises extents from different storage devices and further comprises stripes. A stripe comprises a chunk from each extent of the respective slab. The system updates, in a first data structure, an entry which indicates: a slab number for the respective allocated slab; and a storage device identifier and an extent number for each extent in the respective allocated slab. Responsive to receiving a write request, the system obtains a first stripe from a pre-allocated list which includes the allocated slabs. The system searches, based on stripe information associated with the first stripe, the first data structure to obtain a physical location in a storage device to which to issue the write request.

    METHOD AND SYSTEM FOR DYNAMIC TOPOLOGY-AWARE SPACE ALLOCATION IN A DISTRIBUTED SYSTEM

    公开(公告)号:US20220413741A1

    公开(公告)日:2022-12-29

    申请号:US17359080

    申请日:2021-06-25

    Abstract: A system divides non-volatile memory of a plurality of storage devices into physical extents which comprises chunks. The system allocates slabs associated with the storage devices, wherein a respective slab comprises extents from different storage devices and further comprises stripes. A stripe comprises a chunk from each extent of the respective slab. The system updates, in a first data structure, an entry which indicates: a slab number for the respective allocated slab; and a storage device identifier and an extent number for each extent in the respective allocated slab. Responsive to receiving a write request, the system obtains a first stripe from a pre-allocated list which includes the allocated slabs. The system searches, based on stripe information associated with the first stripe, the first data structure to obtain a physical location in a storage device to which to issue the write request.

    METHOD AND SYSTEM FOR PERSISTENT PARTITIONABLE DISTRIBUTED MAP USING SPARSE ARRAYS AND SPARSE ORDERED TWO-BIT BITMAPS IN SHARED MEMORY

    公开(公告)号:US20220405006A1

    公开(公告)日:2022-12-22

    申请号:US17355000

    申请日:2021-06-22

    Abstract: One aspect facilitates a global map in a distributed system. The system generates a first data structure which comprises key-value pairs, wherein, in a respective key-value pair, the respective key is an integer and the respective value comprises a pointer to a sparse array which includes a bitmap (such as an ordered two-bit bitmap). The system stores the first data structure as a first partition of the global map. The system searches, based on a pattern, the first data structure to obtain a first value. If the first value comprises a two-bit bitmap, the system converts, based on the pattern, the first value to a two-dimensional bitmap, and performs a function on the first value to obtain a first result. The system uses the first value or the first result as metadata to execute a read or write operation in a filesystem associated with the distributed system.

Patent Agency Ranking