公开(公告)号：US20250156326A1

公开(公告)日：2025-05-15

申请号：US18505952

申请日：2023-11-09

Applicant: NVIDIA CORPORATION

Inventor： Ashutosh PANDEY ,  Steven E. MOLNAR ,  Mirko ANDJIC ,  Amit PABALKAR ,  Harold W. CAIN, III ,  Prabal SHARMA

IPC: G06F12/0811 ,  G06F12/0846 ,  G06F12/128

Abstract: Various embodiments include techniques for managing cache memory in a computing system. The disclosed techniques include a cache policy manager that monitors activity of various components that access a common cache memory. The cache policy manager establishes cache rules that determine what data remains stored in cache memory and what data is removed from cache memory in order to make room for new data. As the activities of these components change over time, cache rules that work well for a previous activity profile may no longer work well for the current activity profile. Therefore, the cache policy manager dynamically modifies the cache rules as the activity profile changes in order to select cache rules at any given time that work well with the current activity profile. These techniques are advantageous over conventional approaches that employ static cache rules that work well only for specific activity profiles.

公开(公告)号：US20250156321A1

公开(公告)日：2025-05-15

申请号：US18506007

申请日：2023-11-09

Applicant: NVIDIA CORPORATION

Inventor： Ashutosh PANDEY ,  Steven E. MOLNAR ,  Mirko ANDJIC ,  Amit PABALKAR ,  Harold W. CAIN, III ,  Prabal Sharma

IPC: G06F12/0802

Abstract: Various embodiments include techniques for managing cache memory in a computing system. The disclosed techniques include a cache policy manager that monitors activity of various components that access a common cache memory. The cache policy manager establishes cache rules that determine what data remains stored in cache memory and what data is removed from cache memory in order to make room for new data. As the activities of these components change over time, cache rules that work well for a previous activity profile may no longer work well for the current activity profile. Therefore, the cache policy manager dynamically modifies the cache rules as the activity profile changes in order to select cache rules at any given time that work well with the current activity profile. These techniques are advantageous over conventional approaches that employ static cache rules that work well only for specific activity profiles.