公开(公告)号：US11886354B1

公开(公告)日：2024-01-30

申请号：US17664379

申请日：2022-05-20

Applicant: Apple Inc.

Inventor： Anwar Q. Rohillah ,  Tyler J. Huberty

IPC: G06F12/128 ,  G06F1/3225 ,  G06F12/0891

CPC classification number: G06F12/128 ,  G06F1/3225 ,  G06F12/0891 ,  G06F2212/1021

Abstract: Techniques are disclosed relating to cache thrash detection. In some embodiments, cache controller circuitry is configured to monitor and track performance metrics across multiple levels of a cache hierarchy, detect cache thrashing based on one or more performance metrics, and modify a cache insertion policy to mitigate cache thrashing. Disclosed techniques may advantageously detect and reduce or avoid cache thrashing, which may increase processor performance, decrease power consumption for a given workload, or both, relative to traditional techniques.

公开(公告)号：US20250103520A1

公开(公告)日：2025-03-27

申请号：US18819755

申请日：2024-08-29

Applicant: Apple Inc.

Inventor： Ilya Granovsky ,  Jurgen M. Schulz ,  Tom Greenshtein ,  Elli Bagelman ,  Brian P. Lilly ,  John H. Kelm ,  Rohit K. Gupta ,  Sandeep Gupta ,  Anwar Q. Rohillah

IPC: G06F13/16 ,  G06F12/0831

Abstract: A memory controller circuit receives memory access requests from a network of a computer system. Entries are reserved for these requests in a retry queue circuit. An arbitration circuit of the memory controller circuit issues those requests to a tag pipeline circuit that determines whether the received memory access requests hit in a memory cache. As a memory access request passes through the tag pipeline circuit, it may require another pass through this pipeline—for example, if resources such as certain storage circuits needed to complete the memory access request are unavailable (for example a snoop queue circuit). The reservation that has been made in the retry queue circuit thus keeps the request from having to be returned to the network for resubmission to the memory controller circuit if initial processing of the memory access request cannot be completed.

公开(公告)号：US20250076948A1

公开(公告)日：2025-03-06

申请号：US18459250

申请日：2023-08-31

Applicant: Apple Inc.

Inventor： Srikanth Balasubramanian ,  Anwar Q. Rohillah

IPC: G06F1/26

Abstract: An apparatus includes a system-on-chip that includes a plurality of agents configured to generate data transactions, a communication network configured to transfer transactions between two or more of the agents, a plurality of network switches, and a bandwidth regulation circuit. The network switching circuits may be coupled to the agents and to the network. One of the network switches may be configured to estimate a bandwidth need for transactions to be sent via the network switch in an upcoming window. The bandwidth regulation circuit may be configured to moderate power consumption of the network by determining a bandwidth budget using a network power budget for the upcoming time window, and determining a global bandwidth forecast using estimated bandwidth needs received from the network switches. The bandwidth regulation circuit may also be configured to allocate, using the global bandwidth forecast, the bandwidth budget among the network switches.