In an example implementation, a method includes receiving an indication to reclaim memory from a cache, the cache including a plurality of data buckets each configured to store one or more records and corresponding access bits. The method also includes selecting a data bucket from the cache, and processing the selected data bucket. Processing the selected data bucket includes determining access bits of the selected data bucket that are clear, and expunging data records corresponding to those access bits from the cache. Processing the selected data bucket also includes determining access bits of the selected data bucket that are set and do not correspond to records relevant to outstanding requests by a process utilizing the cache, and clearing those access bits. The method also includes repeating selecting and processing data buckets until a stop criterion is satisfied.