System and method for managing resources of a storage device and quantifying the cost of I/O requests

    公开(公告)号:US11816043B2

    公开(公告)日:2023-11-14

    申请号:US16964134

    申请日:2018-06-25

    CPC classification number: G06F13/161

    Abstract: One embodiment facilitates measurement of a performance of a storage device. During operation, the system determines a normalized cost for an I/O request, wherein the normalized cost is independent of an access pattern and a type of the I/O request, wherein the normalized cost is indicated by a first number of virtual I/O operations consumed by the I/O request, and wherein a virtual I/O operation is used as a logical unit of cost associated with physical I/O operations. The system identifies a performance metric for the storage device by calculating a second number of virtual I/O operations per second which can be executed by the storage device. The system allocates incoming I/O requests to the storage device based on the performance metric, e.g., to satisfy a Quality of Service requirement, thereby causing an enhanced measurement of the performance of the storage device.

    SYSTEM AND METHOD FOR MANAGING RESOURCES OF A STORAGE DEVICE AND QUANTIFYING THE COST OF I/O REQUESTS

    公开(公告)号:US20210365390A1

    公开(公告)日:2021-11-25

    申请号:US16964134

    申请日:2018-06-25

    Abstract: One embodiment facilitates measurement of a performance of a storage device. During operation, the system determines a normalized cost for an I/O request, wherein the normalized cost is independent of an access pattern and a type of the I/O request, wherein the normalized cost is indicated by a first number of virtual I/O operations consumed by the I/O request, and wherein a virtual I/O operation is used as a logical unit of cost associated with physical I/O operations. The system identifies a performance metric for the storage device by calculating a second number of virtual I/O operations per second which can be executed by the storage device. The system allocates incoming I/O requests to the storage device based on the performance metric, e.g., to satisfy a Quality of Service requirement, thereby causing an enhanced measurement of the performance of the storage device.

    Systems, methods, and apparatuses for simplifying filesystem operations utilizing a key-value storage system

    公开(公告)号:US11016932B2

    公开(公告)日:2021-05-25

    申请号:US15711409

    申请日:2017-09-21

    Abstract: Systems and methods for providing key-value based filesystem operations are disclosed. In one embodiment, the method comprises receiving at least one file operation from an application, the file operation including a file path and a requested operation; generating a key-value operation based on the file operation, the key-value operation including a key including the file path; executing the key-value operation at a key-value storage engine; receiving, from the key-value storage engine, a result of the key-value operation; generating a result value based on the result of the key-value operation; and returning the result value to the application.

    Open-channel storage device management with FTL on virtual machine

    公开(公告)号:US11599377B2

    公开(公告)日:2023-03-07

    申请号:US16995691

    申请日:2020-08-17

    Abstract: Embodiments of the disclosure provide systems and methods accessing a storage device of a host machine. The method can include: receiving, via a first guest flash translation layer (FTL) instance, a first request for accessing the storage device from a first virtual machine running on a host machine, wherein the first request comprises a first physical address of the storage device; transmitting, via the first FTL instance, the first request to a host FTL driver; converting, via the host FTL driver, the first request into a first hardware command; transmitting, via the host FTL driver, the first hardware command to the storage device; and executing, via the solid state drive, the first hardware command.

    RESOURCE ALLOCATION BASED ON COMPREHENSIVE I/O MONITORING IN A DISTRIBUTED STORAGE SYSTEM

    公开(公告)号:US20200334085A1

    公开(公告)日:2020-10-22

    申请号:US16385955

    申请日:2019-04-16

    Abstract: Embodiments described herein provide a storage management system. During operation, the system receives information indicating sets of pending load of a plurality of storage devices from one or more storage nodes of a distributed storage system. The set of pending load of a respective storage device includes a set of load from host operations and a set of load from background operations on the storage device. The system can receive a request for a target resource associated with a disk operation from a client node of the distributed storage system. The system then selects, from the plurality of storage devices, a storage device with the smallest set of pending load based on the sets of pending load as the target resource and sends the target resource to the client node.

    METHOD AND APPARATUS FOR SIMPLIFYING GARBAGE COLLECTION OPERATIONS IN HOST-MANAGED DRIVES

    公开(公告)号:US20220100652A1

    公开(公告)日:2022-03-31

    申请号:US17035198

    申请日:2020-09-28

    Inventor: Fei LIU Sheng Qiu

    Abstract: The present disclosure provides methods, systems, and non-transitory computer readable media for optimizing garbage collection operations. An exemplary method comprises receiving an update operation on data to be stored in a host-managed drive in a data storage system; inserting the update operation in a local storage of a host of the data storage system; marking one or more obsolete versions of the data in the local storage; and performing, by a translation layer corresponding to the host-managed drive, a garbage collection operation on the host-managed drive, wherein the garbage collection operation removes the one or more obsolete versions of the data marked in the local storage according to the update operation, and the translation layer comprises address mapping information between the host and the host-managed drive.

    Resource allocation based on comprehensive I/O monitoring in a distributed storage system

    公开(公告)号:US10908960B2

    公开(公告)日:2021-02-02

    申请号:US16385955

    申请日:2019-04-16

    Abstract: Embodiments described herein provide a storage management system. During operation, the system receives information indicating sets of pending load of a plurality of storage devices from one or more storage nodes of a distributed storage system. The set of pending load of a respective storage device includes a set of load from host operations and a set of load from background operations on the storage device. The system can receive a request for a target resource associated with a disk operation from a client node of the distributed storage system. The system then selects, from the plurality of storage devices, a storage device with the smallest set of pending load based on the sets of pending load as the target resource and sends the target resource to the client node.

Patent Agency Ranking