EFFICIENT COMPRESSED TRACK SIZE CLASSIFICATION TO REDUCE DISK FRAGMENTATION AND INCREASE PROBABILITY OF IN-PLACE COMPRESSED WRITES

    公开(公告)号:US20210365198A1

    公开(公告)日:2021-11-25

    申请号:US16881107

    申请日:2020-05-22

    Abstract: In a data storage system in which a full-size allocation unit is used for storage of uncompressed data, an optimal reduced size allocation unit is selected for storage of compressed data. Changes in the compressed size of at least one full-size allocation unit of representative data are monitored over time. The representative data may be selected based on write frequency, relocation frequency, or both. Compression size values are counted and weighted to calculate the optimal reduced allocation unit size. The optimal reduced size allocation unit is used for storage of compressed data. A full-size allocation unit of data that cannot be accommodated by a reduced size allocation unit when compressed is stored uncompressed.

    Method and Apparatus for Adjusting Host QOS Metrics Based on Storage System Performance

    公开(公告)号:US20210342245A1

    公开(公告)日:2021-11-04

    申请号:US16865458

    申请日:2020-05-04

    Inventor: Ramesh Doddaiah

    Abstract: A storage system has a QOS recommendation engine that monitors storage system operational parameters and generates recommended changes to host QOS metrics (throughput, bandwidth, and response time requirements) based on differences between the host QOS metrics and storage system operational parameters. The recommended host QOS metrics may be automatically implemented to adjust the host QOS metrics. By reducing host QOS metrics during times where the storage system is experiencing high volumes of workload, it is possible to throttle workload at the host computer rather than requiring the storage system to expend processing resources associated with queueing the workload prior to processing. This can enable the overall throughput of the storage system to increase. When the workload on the storage system is reduced, updated recommended host QOS metrics are provided to enable the host QOS metrics to increase. Historical analysis is also used to generate recommended host QOS metrics.

    Aperiodic snapshot creation recommendation engine

    公开(公告)号:US11144403B2

    公开(公告)日:2021-10-12

    申请号:US16689133

    申请日:2019-11-20

    Inventor: Ramesh Doddaiah

    Abstract: An aperiodic snapshot recommendation engine running in a storage system aperiodically generates hints that a new snapshot should be created. The hints are sent to host servers to prompt snapshot generation commands to be sent to the storage system. The hints may be generated based on current storage system workload conditions using a model of a snapshot scheduler running on a host server for which the storage system maintains data. The model may be created using a machine learning technique. For example, machine learning may be used to model the host's snapshot scheduler in terms of storage system workload conditions existing when the snapshot scheduler commands generation of new snapshots during a training phase.

    Weighted resource cost matrix scheduler

    公开(公告)号:US11144349B2

    公开(公告)日:2021-10-12

    申请号:US16687730

    申请日:2019-11-19

    Inventor: Ramesh Doddaiah

    Abstract: A scheduler for a storage node uses multi-dimensional weighted resource cost matrices to schedule processing of IOs. A separate matrix is created for each computing node of the storage node via machine learning or regression analysis. Each matrix includes distinct dimensions for each emulation of the computing node for which the matrix is created. Each dimension includes modeled costs in terms of amounts of resources of various types required to process an IO of various IO types. An IO received from a host by a computing node is not scheduled for processing by that computing node unless enough resources are available at each emulation of that computing node. If enough resources are unavailable at an emulation, then the IO is forwarded to a different computing node that has enough resources at each of its emulations. A weighted resource cost for processing the IO is calculated and used to determine scheduling priority. The weights or regression coefficients from the model may be used to calculate weighted resource cost.

    WEIGHTED RESOURCE COST MATRIX SCHEDULER

    公开(公告)号:US20210149718A1

    公开(公告)日:2021-05-20

    申请号:US16687730

    申请日:2019-11-19

    Inventor: Ramesh Doddaiah

    Abstract: A scheduler for a storage node uses multi-dimensional weighted resource cost matrices to schedule processing of IOs. A separate matrix is created for each computing node of the storage node via machine learning or regression analysis. Each matrix includes distinct dimensions for each emulation of the computing node for which the matrix is created. Each dimension includes modeled costs in terms of amounts of resources of various types required to process an IO of various IO types. An IO received from a host by a computing node is not scheduled for processing by that computing node unless enough resources are available at each emulation of that computing node. If enough resources are unavailable at an emulation, then the IO is forwarded to a different computing node that has enough resources at each of its emulations. A weighted resource cost for processing the IO is calculated and used to determine scheduling priority. The weights or regression coefficients from the model may be used to calculate weighted resource cost.

    HOST DEVICE WITH MULTI-PATH LAYER CONFIGURED FOR PER-PROCESS DATA REDUCTION CONTROL

    公开(公告)号:US20200019520A1

    公开(公告)日:2020-01-16

    申请号:US16034603

    申请日:2018-07-13

    Abstract: An apparatus in one embodiment comprises a host device configured to communicate over a network with a storage system comprising a plurality of storage devices. The host device comprises a set of input-output queues and a multi-path input-output driver configured to select input-output operations from the set of input-output queues for delivery to the storage system over the network. The multi-path input-output driver is further configured to determine data reduction control indicators for the input-output operations, and to provide the data reduction control indicators to the storage system in association with the input-output operations. Different data reduction control indicators are associated with different ones of the input-output operations that are generated by different processes running on the host device. The storage system adapts its performance of data reduction for the different ones of the input-output operations based at least in part on their associated data reduction control indicators.

    Host device with multi-path layer configured for per-process data reduction control

    公开(公告)号:US10521369B1

    公开(公告)日:2019-12-31

    申请号:US16034603

    申请日:2018-07-13

    Abstract: An apparatus in one embodiment comprises a host device configured to communicate over a network with a storage system comprising a plurality of storage devices. The host device comprises a set of input-output queues and a multi-path input-output driver configured to select input-output operations from the set of input-output queues for delivery to the storage system over the network. The multi-path input-output driver is further configured to determine data reduction control indicators for the input-output operations, and to provide the data reduction control indicators to the storage system in association with the input-output operations. Different data reduction control indicators are associated with different ones of the input-output operations that are generated by different processes running on the host device. The storage system adapts its performance of data reduction for the different ones of the input-output operations based at least in part on their associated data reduction control indicators.

Patent Agency Ranking