System and Method for Allocating Storage System Resources During Write Throttling Unknown

    公开(公告)号:US20230129182A1

    公开(公告)日:2023-04-27

    申请号:US17509308

    申请日:2021-10-25

    IPC分类号: G06F3/06

    摘要: A method, computer program product, and computing system for allocating a first number of tokens from a plurality of tokens for processing read IO requests from a read IO queue, thus defining a number of allocated read tokens. A second number of tokens may be allocated from the plurality of tokens for processing write IO requests from a write IO queue, thus defining a number of allocated write tokens. It may be determined that the processing of the write IO requests is throttled. In response to determining that the processing of the write IO requests from the write IO queue is throttled, a maximum allowable number of write tokens may be defined. Additional tokens may be allocated for processing the read IO requests from the read IO queue based upon, at least in part, the maximum allowable number of write tokens and the number of allocated write tokens.

    Systems and methods of updating persistent statistics on a multi-transactional and multi-node storage system

    公开(公告)号:US11163496B1

    公开(公告)日:2021-11-02

    申请号:US16918357

    申请日:2020-07-01

    IPC分类号: G06F3/06

    摘要: Techniques for updating persistent statistics on a multi-transactional and multi-node storage system. The techniques can be practiced in a distributed storage system including a plurality of storage nodes. Each storage node can include a persistent storage configured to accommodate a set of delta counter pages, as well as a global counter page for summarizing delta count values tracked by respective delta counters. The techniques can include, in each storage node, tracking, by each of a set of delta counters, changes to delta count values due to storage node operations performed on units of data storage, and summarizing, periodically or at least at intervals, the delta count values of the respective delta counters as global count values. The techniques can further include summarizing the global count values across the respective storage nodes in a count summarization report and sending the count summarization report to a client via a communications interface.

    Speeding deduplication using a most wanted digest cache

    公开(公告)号:US11093454B2

    公开(公告)日:2021-08-17

    申请号:US15799117

    申请日:2017-10-31

    摘要: Embodiments are directed to techniques for performing deduplication. A method includes (a) obtaining a digest of a data block logically-positioned within a filesystem, the digest providing a hash value of data of the data block, (b) searching a Most Wanted Digest Cache (MWDC) within system memory for the digest, (c) locating an entry in the MWDC using the digest, wherein this locating indicates that the data block has the same data as another data block located elsewhere within the filesystem, the other data block having been previously persistently-stored, the entry having been added to the MWDC in response to the other data block having been deduplicated at least a plurality number of times, (d) locating a mapping structure referenced by the entry located from the MWDC, the mapping structure providing metadata about the other data block, and (e) deduplicating the data block and the other data block with reference to the located mapping structure.

    MANAGING GLOBAL COUNTERS USING LOCAL DELTA COUNTERS

    公开(公告)号:US20210117339A1

    公开(公告)日:2021-04-22

    申请号:US16659940

    申请日:2019-10-22

    IPC分类号: G06F12/126 G06F12/0804

    摘要: A data storage system performs updating of a set of global counters stored in persistent storage accessible to a plurality of processing nodes of a data storage system, the global counters storing respective global count values describing associated units of data storage shared by the processing nodes for performing data storage operations. The updating includes, by each processing node, using a respective set of in-memory delta counters storing respective delta count values to track changes to respective global count values due to data storage operations performed by the processing node with respect to the units of data storage. A summarization process is regularly executed to merge the delta count values of the delta counters of all processing nodes into the respective global counters.

    Managing eviction from a deduplication cache

    公开(公告)号:US11086794B2

    公开(公告)日:2021-08-10

    申请号:US16398689

    申请日:2019-04-30

    IPC分类号: G06F3/06 G06F12/123

    摘要: A technique for managing a deduplication digest cache (DDC) includes assigning each digest entry of the DDC to one of multiple entry lists, scoring the entry lists based at least in part on the deduplicability of the data represented by the digest entries in the entry lists, and selecting for eviction from the DDC entries assigned to the lowest-scoring entry list. In this manner, entries assigned to entry lists that perform more poorly in terms of deduplicability tend to be evicted more quickly than entries assigned to entry lists that perform better.

    COORDINATED RECLAIMING OF DATA STORAGE SPACE

    公开(公告)号:US20210124680A1

    公开(公告)日:2021-04-29

    申请号:US16663507

    申请日:2019-10-25

    IPC分类号: G06F12/02

    摘要: Coordinating a reclaiming of data storage space among processing nodes of a data storage system includes, by a first node in response to an event, performing local cleanup of first-node mapping data and issuing a request message to a second node, the request message identifying the data storage space to be reclaimed. The event may be a notification from a RAID component rebuilding a RAID volume. In response to the request message, the second node performs local cleanup of second-node mapping data and issues a completion message to the first node indicating that the second node has completed its part of the reclaiming of the data storage space. The first node responds to the completion message by marking the data storage space as being reclaimed and signaling to a source of the event that the data storage space is available for new use.

    MANAGING EVICTION FROM A DEDUPLICATION CACHE

    公开(公告)号:US20200349088A1

    公开(公告)日:2020-11-05

    申请号:US16398689

    申请日:2019-04-30

    IPC分类号: G06F12/123 G06F3/06

    摘要: A technique for managing a deduplication digest cache (DDC) includes assigning each digest entry of the DDC to one of multiple entry lists, scoring the entry lists based at least in part on the deduplicability of the data represented by the digest entries in the entry lists, and selecting for eviction from the DDC entries assigned to the lowest-scoring entry list. In this manner, entries assigned to entry lists that perform more poorly in terms of deduplicability tend to be evicted more quickly than entries assigned to entry lists that perform better.

    SPEEDING DEDUPLICATION USING A MOST WANTED DIGEST CACHE

    公开(公告)号:US20190129970A1

    公开(公告)日:2019-05-02

    申请号:US15799117

    申请日:2017-10-31

    IPC分类号: G06F17/30

    摘要: Embodiments are directed to techniques for performing deduplication. A method includes (a) obtaining a digest of a data block logically-positioned within a filesystem, the digest providing a hash value of data of the data block, (b) searching a Most Wanted Digest Cache (MWDC) within system memory for the digest, (c) locating an entry in the MWDC using the digest, wherein this locating indicates that the data block has the same data as another data block located elsewhere within the filesystem, the other data block having been previously persistently-stored, the entry having been added to the MWDC in response to the other data block having been deduplicated at least a plurality number of times, (d) locating a mapping structure referenced by the entry located from the MWDC, the mapping structure providing metadata about the other data block, and (e) deduplicating the data block and the other data block with reference to the located mapping structure.