Managing inline data compression in storage systems

    公开(公告)号:US11216186B1

    公开(公告)日:2022-01-04

    申请号:US15393443

    申请日:2016-12-29

    IPC分类号: G06F3/06 G06F16/17 G06F12/02

    摘要: A method is used in managing inline data compression in storage systems. A request is received to flush data of a file system to a storage device of a storage system. A compression ratio is determined for writing the data to the storage device in a compressed format. Based on the determination, a number of allocation units is determined in which a segment is apportioned. The segment comprises of a set of allocation units in the compressed format. Based on the determination, the data is written to the segment in the compressed format.

    Adaptively over-allocating storage space for compressed data

    公开(公告)号:US11048419B2

    公开(公告)日:2021-06-29

    申请号:US16262423

    申请日:2019-01-30

    IPC分类号: G06F3/06 G06F16/17

    摘要: A technique for managing storage of compressed data includes generating and enforcing a minimum slot size requirement. The minimum slot size is based at least in part on collected performance metrics that indicate a degree of compressibility of data received, compressed, and written by the data storage system. As new data arrive, the new data are compressed and stored in slots at least as big as the minimum slot size, in many cases effecting an over-allocation of storage space and improving the likelihood that subsequent overwrites will fit into existing slots.

    STORAGE MANAGEMENT SYSTEM AND METHOD

    公开(公告)号:US20210133156A1

    公开(公告)日:2021-05-06

    申请号:US16674555

    申请日:2019-11-05

    IPC分类号: G06F16/18 G06F16/14 G06F16/16

    摘要: A method, computer program product, and computing system for maintaining a first cursor pointer for a memory system, wherein the first cursor pointer concerns a first search criteria and identifies an initial first cursor starting location; receiving a first search request for the memory system that satisfies the first search criteria; executing the first search request within an initial first search window starting at the initial first cursor starting location; and updating the first cursor pointer to identify an updated first cursor starting location based, at least in part, upon the initial first search window.

    COORDINATED RECLAIMING OF DATA STORAGE SPACE

    公开(公告)号:US20210124680A1

    公开(公告)日:2021-04-29

    申请号:US16663507

    申请日:2019-10-25

    IPC分类号: G06F12/02

    摘要: Coordinating a reclaiming of data storage space among processing nodes of a data storage system includes, by a first node in response to an event, performing local cleanup of first-node mapping data and issuing a request message to a second node, the request message identifying the data storage space to be reclaimed. The event may be a notification from a RAID component rebuilding a RAID volume. In response to the request message, the second node performs local cleanup of second-node mapping data and issues a completion message to the first node indicating that the second node has completed its part of the reclaiming of the data storage space. The first node responds to the completion message by marking the data storage space as being reclaimed and signaling to a source of the event that the data storage space is available for new use.

    RELOCATING COMPRESSED EXTENTS USING BATCH-HOLE LIST

    公开(公告)号:US20200133549A1

    公开(公告)日:2020-04-30

    申请号:US16176738

    申请日:2018-10-31

    IPC分类号: G06F3/06 G06F12/02

    摘要: A technique for writing data in a data storage system includes aggregating data received in a set of I/O requests into a batch that includes multiple extents of data. After compressing a current extent of the batch and determining that the compressed extent does not fit in a space where a previous version of the extent is stored, the technique performs a batch-relocate operation by gathering a set of mapping metadata for mapping each of the extents in the batch, identifying a set of holes indicated by the set of mapping metadata, and adding the holes to a batch-hole list. The technique then selects a hole, from the batch-hole list, which is big enough to accommodate the compressed extent, and places the compressed extent in the selected hole.

    Memory management system and method

    公开(公告)号:US12050807B2

    公开(公告)日:2024-07-30

    申请号:US17239281

    申请日:2021-04-23

    IPC分类号: G06F12/00 G06F3/06

    摘要: A method, computer program product, and computing system for defining a quantity of discrete storage portions within a storage system; entering an expansion mode during which the discrete storage portions are incrementally assigned to at least one processing node until a first assignment level target is achieved; once the first assignment level target is achieved, entering a utilization mode during which the utilization of the assigned discrete portions is increased until a first utilization level target is achieved; and once the first utilization level target is achieved, reentering the expansion mode during which additional discrete storage portions are incrementally assigned to the at least one processing node until a second assignment level target is achieved.

    Managing global counters using local delta counters

    公开(公告)号:US11210236B2

    公开(公告)日:2021-12-28

    申请号:US16659940

    申请日:2019-10-22

    IPC分类号: G06F12/126 G06F12/0804

    摘要: A data storage system performs updating of a set of global counters stored in persistent storage accessible to a plurality of processing nodes of a data storage system, the global counters storing respective global count values describing associated units of data storage shared by the processing nodes for performing data storage operations. The updating includes, by each processing node, using a respective set of in-memory delta counters storing respective delta count values to track changes to respective global count values due to data storage operations performed by the processing node with respect to the units of data storage. A summarization process is regularly executed to merge the delta count values of the delta counters of all processing nodes into the respective global counters.

    Managing data storage in storage systems

    公开(公告)号:US10922027B2

    公开(公告)日:2021-02-16

    申请号:US16179256

    申请日:2018-11-02

    摘要: There is disclosed techniques for use in managing data storage in storage systems. For example, in one embodiment, there is disclosed a method comprising receiving a request to store data of a data object in a storage system. The method also comprising determining that at least a portion of the data is to be stored in an uncompressed format in the storage system in response to receiving the request. The method also comprising storing at least a portion of the data in the uncompressed format in an allocation unit of a segment in the storage system such that the stored data in the uncompressed format emulates stored data in a compressed format based on the said determination.