公开(公告)号：US10089239B2

公开(公告)日：2018-10-02

申请号：US15165839

申请日：2016-05-26

Applicant: GOOGLE INC.

Inventor： Allan D. Knies ,  Shinye Shiu ,  Chih-Chung Chang ,  Vyacheslav Vladimirovich Malyugin ,  Santhosh Rao

IPC: G06F12/08 ,  G06F12/10 ,  G06F12/12 ,  G06F12/0893 ,  G06F12/0891 ,  G06F12/1045 ,  G06F12/0888 ,  G06F12/084 ,  G06F12/127

Abstract: Provided are methods, systems, and apparatus for managing and controlling memory caches, in particular, system level caches outside of those closest to the CPU. The processes and representative hardware structures that implement the processes are designed to allow for detailed control over the behavior of such system level caches. Caching policies are developed based on policy identifiers, where a policy identifier corresponds to a collection of parameters that control the behavior of a set of cache management structures. For a given cache, one policy identifier is stored in each line of the cache.

公开(公告)号：US20170228322A1

公开(公告)日：2017-08-10

申请号：US15097177

申请日：2016-04-12

Applicant: Google Inc.

Inventor： Chih-Chung Chang

IPC: G06F12/12 ,  G06F12/08 ,  G06F3/06

CPC classification number: G06F12/122 ,  G06F3/0605 ,  G06F3/061 ,  G06F3/064 ,  G06F3/0647 ,  G06F3/0665 ,  G06F3/0673 ,  G06F12/0284 ,  G06F12/08 ,  G06F12/0804 ,  G06F12/0859 ,  G06F12/0868 ,  G06F12/0897 ,  G06F12/12 ,  G06F12/121 ,  G06F12/123 ,  G06F2212/1016 ,  G06F2212/1021 ,  G06F2212/152 ,  G06F2212/251 ,  G06F2212/253 ,  G06F2212/601

Abstract: This document describes profiling cache replacement. Profiling cache replacement is a technique for managing data migration between a main memory and a cache memory to improve overall system performance. Unlike conventional cache replacement techniques, profiling cache replacement employs a profiler to maintain counters that count memory requests for access to not only the pages maintained in the cache memory, but also the pages maintained in the main memory. Based on the information collected by the profiler (e.g., about memory access requests), a mover moves pages between the main and cache memories. By way of example, the mover can swap highly-requested pages of the main memory, such as a most-requested page of the main memory, with little-requested pages of the cache memory, such as a least-requested page of the cache memory. The mover can do so, for instance, when the counters indicate that the number of page access requests for highly-requested pages of the main memory is greater than the number of page access requests for little-requested pages of the cache memory. So as not to impede the operations of memory users (e.g., client applications), the mover performs the page swapping in the background. To do so, the mover is limited to swapping pages at predetermined time intervals, such as once every microsecond (μs).

公开(公告)号：US10387329B2

公开(公告)日：2019-08-20

申请号：US15097177

申请日：2016-04-12

Applicant: Google Inc.

Inventor： Chih-Chung Chang

IPC: G06F12/122 ,  G06F12/123 ,  G06F12/02 ,  G06F12/08 ,  G06F12/0868 ,  G06F12/0897 ,  G06F12/121 ,  G06F3/06 ,  G06F12/0804 ,  G06F12/12

Abstract: Profiling cache replacement is a technique for managing data migration between a main memory and a cache memory to improve overall system performance. A profiler maintains counters that count memory requests for access to the pages maintained in both the cache memory and the main memory. Based on this access-request count information, a mover moves pages between the main and cache memories. For example, the mover can swap little-requested pages of the cache memory with highly-requested pages of the main memory. The mover can do so, for instance, when the counters indicate that the number of page access requests for highly-requested pages of the main memory is greater than the number of page access requests for little-requested pages of the cache memory. To avoid impeding the operations of memory users, the mover can perform page swapping in the background at predetermined time intervals, such as once every microsecond (μs).