STORAGE SYSTEM WITH ADAPTIVE FLOW CONTROL USING MULTIPLE FEEDBACK LOOPS

    公开(公告)号:US20220131802A1

    公开(公告)日:2022-04-28

    申请号:US17077559

    申请日:2020-10-22

    Abstract: At least one processing device comprises a processor and a memory coupled to the processor. The at least one processing device is configured to implement adaptive flow control in conjunction with processing of input-output operations in a storage system. The adaptive flow control comprises a first feedback loop in which a window size defining an amount of concurrent processing of the input-output operations in the storage system is adjusted responsive to a measured latency for processing of one or more of the input-output operations. The adaptive flow control further comprises a second feedback loop in which at least one latency threshold used to control adjustment of the window size in the first feedback loop is adjusted. The at least one processing device illustratively comprises at least one processing core of a multi-core storage node of a distributed storage system.

    DEFRAGMENTATION OF STRIPED VOLUME IN DATA STORAGE SYSTEM

    公开(公告)号:US20220129164A1

    公开(公告)日:2022-04-28

    申请号:US17078837

    申请日:2020-10-23

    Abstract: A storage control system generates a striped storage volume in an array of data storage devices. The striped storage volume includes multiple stripe sets, each associated with a different stripe type, and each having stripes that are assigned the stripe type associated with the stripe set. The stripe type represents a block size of the stripes included in the stripe set. A background stripe defragmentation process is performed to defragment stripes in a target stripe set and generate empty stripes. The empty stripes generated by the background stripe defragmentation process are added into an empty stripe set of the striped storage volume. The empty stripes in the empty stripe set have unassigned stripe types. A stripe type is assigned to an empty stripe in the empty stripe which is selected for removal and inclusion in the stripe set associated with the stripe type assigned to the empty stripe.

    System and method for parallel journaling in a storage cluster

    公开(公告)号:US11256439B2

    公开(公告)日:2022-02-22

    申请号:US16916330

    申请日:2020-06-30

    Abstract: A method, computer program product, and computing system for receiving, via a first node of a plurality of nodes, data for storage in a storage system. The data may be written, via the first node, to one or more data pages of a log buffer of the first node. One or more page descriptors associated with the one or more data pages may be generated via the first node. The one or more page descriptors may be sent to a second node concurrently with the writing of the data to the one or more data pages of the log buffer of the first node.

    Transactional update system and method

    公开(公告)号:US11237771B1

    公开(公告)日:2022-02-01

    申请号:US17074840

    申请日:2020-10-20

    Abstract: A method, computer program product, and computing system for receiving a plurality of updates to one or more metadata pages of a storage system, where the plurality of updates include one or more bulk updates and one or more delta updates. A transaction record may be defined. The delta updates may be written to a non-volatile log. The bulk updates may be written to a first metadata store position. The bulk updates may be written to a second metadata store position in response to writing the bulk updates to the first metadata store position. A status indicator for the transaction record may be set based upon, at least in part, writing the delta updates to the non-volatile log and one or more of writing the bulk updates to the first metadata store position and writing the bulk updates to the second metadata store position.

    Sub-block deduplication using sector hashing

    公开(公告)号:US11237743B2

    公开(公告)日:2022-02-01

    申请号:US16397131

    申请日:2019-04-29

    Abstract: A method of performing deduplication is provided. The method includes (a) selecting, by applying a deterministic selection criterion, a sub-block of a block of data that contains multiple sub-blocks; (b) performing a lookup, into a deduplication table, of a digest generated by hashing the selected sub-block, the lookup matching an entry indexed by the digest in the deduplication table, the entry identifying a previously processed block; and (c) effecting storage of the block, including pointing to the previously processed block. An apparatus, system, and computer program product for performing a similar method are also provided.

    MULTI-LEVEL BUCKET AGGREGATION FOR JOURNAL DESTAGING IN A DISTRIBUTED STORAGE SYSTEM

    公开(公告)号:US20210286537A1

    公开(公告)日:2021-09-16

    申请号:US16819447

    申请日:2020-03-16

    Abstract: An apparatus comprises at least one processing device configured to maintain a metadata update journal for at least a first storage node of a plurality of storage nodes of a distributed storage system, and to destage the metadata update journal of the first storage node to one or more storage devices accessible to the first storage node. The metadata update journal of the first storage node utilizes a multi-level bucket aggregation of metadata updates in which metadata pages each comprising a plurality of address-to-hash mapping pairs are arranged in a plurality of first-level buckets containing respective subsets of the metadata pages for respective different logical storage volumes, and a plurality of second-level buckets are each configured to aggregate multiple metadata pages from different ones of the first-level buckets in order to increase a number of metadata updates in each second-level bucket relative to numbers of metadata updates in its corresponding first-level buckets.

    Method and apparatus for dynamic flow control in distributed storage systems

    公开(公告)号:US11099753B2

    公开(公告)日:2021-08-24

    申请号:US16047087

    申请日:2018-07-27

    Abstract: A method for processing I/O requests that are received at a distributed storage system including a plurality of receiver nodes, a plurality of first nodes, and a plurality of second nodes, the method comprising: receiving, at a receiver node, an I/O request and executing the I/O request by using at least one of the first nodes and at least one of the second nodes; receiving, by the receiver node, one or more latency metrics from each of the first nodes and second nodes that are used to execute the I/O request, and reconfiguring the storage system, by the receiver node, based on any of the received latency metrics.

    FLOW CONTROL OF INPUT/OUTPUT (IO) IN A SYNCHRONOUS REPLICATION SESSION

    公开(公告)号:US20210247909A1

    公开(公告)日:2021-08-12

    申请号:US16786422

    申请日:2020-02-10

    Abstract: An aspect of performing flow control of IO in a synchronous replication session between a local storage and a remote storage of a storage system includes tracking an amount of time an input/output (IO) request is processed at the remote storage including an amount of time the IO request is in transmit to and from the remote storage system. The amount of time indicates a remote latency value. An aspect also includes tracking an amount of time the IO request is processed at the local storage and calculating a difference between the remote latency value and the amount of time the IO request is processed at the local storage. The difference indicates a local latency value. An aspect further includes modifying an amount of IO requests admitted at the storage system as a function of the local latency value.

Patent Agency Ranking