An apparatus for efficiently identifying and tracking cold memory pages. The apparatus includes a memory to store memory pages, one or more processor cores to access the memory pages stored in the memory by issuing access requests to the memory; and a page index bitmap to track accesses made by the one or more processor cores to the memory pages stored in the memory. The tracked accesses are usable to identify infrequently-accessed memory pages, wherein the infrequently-accessed memory pages are removed from the memory and stored in a secondary storage.