POWER MANAGEMENT FOR EXECUTION OF MACHINE LEARNING WORKLOADS

    公开(公告)号:US20230273832A1

    公开(公告)日:2023-08-31

    申请号:US18133616

    申请日:2023-04-12

    CPC classification number: G06F9/505 G06F1/3228 G06F1/3296

    Abstract: A system for autonomous and proactive power management for energy efficient execution of machine learning workloads may include an apparatus such as system-on-chip (SoC) comprising an accelerator configurable to load and execute a neural network and circuitry to receive a profile of the neural network. The profile may be received from a compiler and include information regarding a plurality of layers of the neural network. Responsive to the profile and the information regarding the plurality of layers, circuitry may adjust, using a local power management unit (PMU) included the apparatus, a power level to the accelerator while the accelerator executes the neural network. The power level adjustment may be based on whether the particular layer is a compute-intensive layer or a memory-intensive layer.

Patent Agency Ranking