Memory use and eviction in a deduplication storage system

    公开(公告)号:US09940060B1

    公开(公告)日:2018-04-10

    申请号:US15331181

    申请日:2016-10-21

    Abstract: The method includes storing data including an index summary (IS) and a deduplication map (DDM) in volatile memory of a deduplication system. The method also includes detecting that the stored data exceeds a data allocation size limit for the volatile memory. The method includes evicting the data from the volatile memory using a memory eviction policy to meet the data allocation size limit. The method further includes performing a first eviction by evicting the DDM levels from an oldest DDM level to a newest DDM level until a first one of the data allocation size limit or a DDM threshold is met. The method also includes performing a second eviction by evicting the IS levels from an oldest IS level to a newest IS level until a first one of the data allocation size limit or IS threshold is met in response to the data allocation size limit not being met by the first eviction.

    Managing compressed data in a storage system
    2.
    发明授权
    Managing compressed data in a storage system 有权
    管理存储系统中的压缩数据

    公开(公告)号:US09569357B1

    公开(公告)日:2017-02-14

    申请号:US14592336

    申请日:2015-01-08

    Abstract: Systems, methods, and computer readable storage mediums for optimistically managing compressed data in a storage system. When possible, multiple input blocks are compressed into a buffer and stored in a single physical block on a storage device. The metadata of the multiple input blocks can be managed separately. A fingerprint of the compressed buffer can be generated and used as an index to the single physical block. Alternatively, fingerprints of the uncompressed input blocks can be generated, and reference counts can be maintained to track the number of input blocks which reference the compressed buffer.

    Abstract translation: 用于乐观管理存储系统中的压缩数据的系统,方法和计算机可读存储介质。 如果可能,多个输入块被压缩成缓冲器并存储在存储设备上的单个物理块中。 可以单独管理多个输入块的元数据。 可以生成压缩缓冲区的指纹,并将其用作单个物理块的索引。 或者,可以生成未压缩输入块的指纹,并且可以保持参考计数以跟踪引用压缩缓冲器的输入块的数量。

    Generating and optimizing summary index levels in a deduplication storage system

    公开(公告)号:US10452297B1

    公开(公告)日:2019-10-22

    申请号:US15339684

    申请日:2016-10-31

    Abstract: The method and system generates a first deduplication map (DDM) level including first data and a second DDM level including second data. The method or apparatus also generates a first index summary (IS) level corresponding to the first DDM level and a second IS level corresponding to the second DDM level. The method or apparatus merges the first data of the first DDM level and the second data of the second DDM level to generate a third DDM level comprising third data. The method or apparatus in response to generating the third DDM level, generates a third IS level to accelerate lookup within the third DDM level.

Patent Agency Ranking