SYSTEM AND METHOD FOR MANAGING RESOURCES OF A STORAGE DEVICE AND QUANTIFYING THE COST OF I/O REQUESTS

    公开(公告)号:WO2020000136A1

    公开(公告)日:2020-01-02

    申请号:PCT/CN2018/092632

    申请日:2018-06-25

    Abstract: One embodiment facilitates measurement of a performance of a storage device. During operation, the system determines a normalized cost for an I/O request, wherein the normalized cost is independent of an access pattern and a type of the I/O request, wherein the normalized cost is indicated by a first number of virtual I/O operations consumed by the I/O request, and wherein a virtual I/O operation is used as a logical unit of cost associated with physical I/O operations. The system identifies a performance metric for the storage device by calculating a second number of virtual I/O operations per second which can be executed by the storage device. The system allocates incoming I/O requests to the storage device based on the performance metric, e. g., to satisfy a Quality of Service requirement, thereby causing an enhanced measurement of the performance of the storage device.

    VIRTUAL DATA COPY SUPPORTING GARBAGE COLLECTION IN DISTRIBUTED FILE SYSTEMS

    公开(公告)号:WO2022094895A1

    公开(公告)日:2022-05-12

    申请号:PCT/CN2020/126866

    申请日:2020-11-05

    Abstract: Methods and systems implement a virtual copy operation which improves support of preemptive garbage collection policies at a distributed file system. A garbage collection process preemptively performs copying upon data in a log-structured file system. So that thread-blocking write operations are not distributed across nodes of a distributed file system node cluster, and thus avoid degradation of computational performance, a virtual copy operation is provided which, based on master node metadata, locates each chunk node storing blocks to be virtual copied and calls a remap API of a logical address mapper provided by a local file system of the chunk node. The logical address mapper of each chunk node performs remaps of disk addresses from source logical block addresses to destination block addresses, without relocating data from one disk address to another. The results of these remaps may be stored as metadata at the master node, replacing previously mapped metadata.

    RESOURCE ALLOCATION BASED ON COMPREHENSIVE I/O MONITORING IN A DISTRIBUTED STORAGE SYSTEM

    公开(公告)号:WO2020211679A1

    公开(公告)日:2020-10-22

    申请号:PCT/CN2020/083447

    申请日:2020-04-07

    Abstract: Embodiments described herein provide a storage management system. During operation, the system receives information indicating sets of pending load of a plurality of storage devices from one or more storage nodes of a distributed storage system. The set of pending load of a respective storage device includes a set of load from host operations and a set of load from background operations on the storage device. The system can receive a request for a target resource associated with a disk operation from a client node of the distributed storage system. The system then selects, from the plurality of storage devices, a storage device with the smallest set of pending load based on the sets of pending load as the target resource and sends the target resource to the client node.

Patent Agency Ranking