Resource allocation based on comprehensive I/O monitoring in a distributed storage system

    公开(公告)号:US10908960B2

    公开(公告)日:2021-02-02

    申请号:US16385955

    申请日:2019-04-16

    Abstract: Embodiments described herein provide a storage management system. During operation, the system receives information indicating sets of pending load of a plurality of storage devices from one or more storage nodes of a distributed storage system. The set of pending load of a respective storage device includes a set of load from host operations and a set of load from background operations on the storage device. The system can receive a request for a target resource associated with a disk operation from a client node of the distributed storage system. The system then selects, from the plurality of storage devices, a storage device with the smallest set of pending load based on the sets of pending load as the target resource and sends the target resource to the client node.

    Optimization of log-structured merge (LSM) tree-based databases using object solid state drive (SSD) devices

    公开(公告)号:US10445022B1

    公开(公告)日:2019-10-15

    申请号:US15963386

    申请日:2018-04-26

    Abstract: The disclosed embodiments are directed to improvements in log-structured merge (LSM) tree databases. In one embodiment, a method is disclosed comprising receiving data to be written to a log-structured merge (LSM) tree, the data including a key and value; determining that an in-memory buffer lacks capacity to store the data to be written; compacting key-ranges stored in at least one level of the LSM tree stored in an object storage device (OSD), each of the key-ranges associated with a respective object identifier; generating a key range object, the key range object including object identifiers associated with a subset of the key-ranges; erasing physical blocks corresponding to each of the object identifiers included in the key range object; and writing the key range object to at least one physical block of the OSD.

    Systems, methods, and apparatuses for simplifying filesystem operations utilizing a key-value storage system

    公开(公告)号:US11016932B2

    公开(公告)日:2021-05-25

    申请号:US15711409

    申请日:2017-09-21

    Abstract: Systems and methods for providing key-value based filesystem operations are disclosed. In one embodiment, the method comprises receiving at least one file operation from an application, the file operation including a file path and a requested operation; generating a key-value operation based on the file operation, the key-value operation including a key including the file path; executing the key-value operation at a key-value storage engine; receiving, from the key-value storage engine, a result of the key-value operation; generating a result value based on the result of the key-value operation; and returning the result value to the application.

    Open-channel storage device management with FTL on virtual machine

    公开(公告)号:US11599377B2

    公开(公告)日:2023-03-07

    申请号:US16995691

    申请日:2020-08-17

    Abstract: Embodiments of the disclosure provide systems and methods accessing a storage device of a host machine. The method can include: receiving, via a first guest flash translation layer (FTL) instance, a first request for accessing the storage device from a first virtual machine running on a host machine, wherein the first request comprises a first physical address of the storage device; transmitting, via the first FTL instance, the first request to a host FTL driver; converting, via the host FTL driver, the first request into a first hardware command; transmitting, via the host FTL driver, the first hardware command to the storage device; and executing, via the solid state drive, the first hardware command.

    RESOURCE ALLOCATION BASED ON COMPREHENSIVE I/O MONITORING IN A DISTRIBUTED STORAGE SYSTEM

    公开(公告)号:US20200334085A1

    公开(公告)日:2020-10-22

    申请号:US16385955

    申请日:2019-04-16

    Abstract: Embodiments described herein provide a storage management system. During operation, the system receives information indicating sets of pending load of a plurality of storage devices from one or more storage nodes of a distributed storage system. The set of pending load of a respective storage device includes a set of load from host operations and a set of load from background operations on the storage device. The system can receive a request for a target resource associated with a disk operation from a client node of the distributed storage system. The system then selects, from the plurality of storage devices, a storage device with the smallest set of pending load based on the sets of pending load as the target resource and sends the target resource to the client node.

    System and method for managing resources of a storage device and quantifying the cost of I/O requests

    公开(公告)号:US11816043B2

    公开(公告)日:2023-11-14

    申请号:US16964134

    申请日:2018-06-25

    CPC classification number: G06F13/161

    Abstract: One embodiment facilitates measurement of a performance of a storage device. During operation, the system determines a normalized cost for an I/O request, wherein the normalized cost is independent of an access pattern and a type of the I/O request, wherein the normalized cost is indicated by a first number of virtual I/O operations consumed by the I/O request, and wherein a virtual I/O operation is used as a logical unit of cost associated with physical I/O operations. The system identifies a performance metric for the storage device by calculating a second number of virtual I/O operations per second which can be executed by the storage device. The system allocates incoming I/O requests to the storage device based on the performance metric, e.g., to satisfy a Quality of Service requirement, thereby causing an enhanced measurement of the performance of the storage device.

    SYSTEM AND METHOD FOR MANAGING RESOURCES OF A STORAGE DEVICE AND QUANTIFYING THE COST OF I/O REQUESTS

    公开(公告)号:US20210365390A1

    公开(公告)日:2021-11-25

    申请号:US16964134

    申请日:2018-06-25

    Abstract: One embodiment facilitates measurement of a performance of a storage device. During operation, the system determines a normalized cost for an I/O request, wherein the normalized cost is independent of an access pattern and a type of the I/O request, wherein the normalized cost is indicated by a first number of virtual I/O operations consumed by the I/O request, and wherein a virtual I/O operation is used as a logical unit of cost associated with physical I/O operations. The system identifies a performance metric for the storage device by calculating a second number of virtual I/O operations per second which can be executed by the storage device. The system allocates incoming I/O requests to the storage device based on the performance metric, e.g., to satisfy a Quality of Service requirement, thereby causing an enhanced measurement of the performance of the storage device.

Patent Agency Ranking