公开(公告)号：US11816029B2

公开(公告)日：2023-11-14

申请号：US17691588

申请日：2022-03-10

Applicant: NetApp, Inc.

Inventor： Alyssa Proulx ,  Wei Sun

IPC: G06F12/02 ,  G06F12/0864 ,  G06F11/30

CPC classification number: G06F12/0253 ,  G06F11/3006 ,  G06F11/3037 ,  G06F12/0246 ,  G06F12/0864

Abstract: A system, method, and machine-readable storage medium for performing garbage collection in a distributed storage system are provided. In some embodiments, an efficiency level of a garbage collection process is monitored. The garbage collection process may include removal of one or more data blocks of a set of data blocks that is referenced by a set of content identifiers. The set of slice services and the set of data blocks may reside in a cluster, and a set of probabilistic filters (e.g., Bloom filters) may indicate whether the set of data blocks is in-use. At least one parameter of a probabilistic filter of the set of probabilistic filters may be adjusted (e.g., increased or reduced) if the efficiency level is below the efficiency threshold. Garbage collection may be performed on the set of data blocks in accordance with the set of probabilistic filters.

公开(公告)号：US11567694B2

公开(公告)日：2023-01-31

申请号：US17457117

申请日：2021-12-01

Applicant: NetApp, Inc.

Inventor： Alyssa Proulx ,  Mark David Olson

IPC: G06F3/06

Abstract: A system, method, and machine-readable storage medium for determining an amount of unique data in a distributed storage system are provided. In some embodiments, a combined efficiency set for a first data set stored in the distributed storage system, such as at a volume, may be generated. The first data set may include a first subset of data and a second subset of data in the distributed storage system. Additionally, a set of efficiency sets for the first subset of data may be generated. A set difference based on the combined efficiency set and the set of efficiency sets may be computed. An amount of memory used for storing unique data of the second subset of data may be estimated based on the set difference. The unique data may be present in the second subset of data but absent from the first subset of data.

公开(公告)号：US11526275B2

公开(公告)日：2022-12-13

申请号：US17079249

申请日：2020-10-23

Applicant: NetApp, Inc.

Inventor： Charles Randall ,  Alyssa Proulx

IPC: G06F3/06 ,  G06F11/30 ,  G06F11/32 ,  G06F11/34

Abstract: Systems and methods for sampling a set of block IDs to facilitate estimating an amount of data stored in a data set of a storage system having one or more characteristics are provided. According to an example, metadata (e.g., block headers and block IDs) may be maintained regarding multiple data blocks of the data set. When one or more metrics relating to the data set are desired, an efficiency set, representing a subset of the block IDs of the data set, may be created to facilitate efficient calculation of the metrics by statistically sampling the block IDs of the data set. Finally, the metrics may be estimated based on the efficiency set by analyzing one or more of the metadata (e.g., block headers) and the data contained in the data blocks corresponding to the subset of the block IDs and extrapolating the metrics for the entirety of the data set.

公开(公告)号：US20220197789A1

公开(公告)日：2022-06-23

申请号：US17691588

申请日：2022-03-10

Applicant: NetApp, Inc.

Inventor： Alyssa Proulx ,  Wei Sun

IPC: G06F12/02 ,  G06F11/30 ,  G06F12/0864

Abstract: A system, method, and machine-readable storage medium for performing garbage collection in a distributed storage system are provided. In some embodiments, an efficiency level of a garbage collection process is monitored. The garbage collection process may include removal of one or more data blocks of a set of data blocks that is referenced by a set of content identifiers. The set of slice services and the set of data blocks may reside in a cluster, and a set of probabilistic filters (e.g., Bloom filters) may indicate whether the set of data blocks is in-use. At least one parameter of a probabilistic filter of the set of probabilistic filters may be adjusted (e.g., increased or reduced) if the efficiency level is below the efficiency threshold. Garbage collection may be performed on the set of data blocks in accordance with the set of probabilistic filters.