Optimization of Scratchpad Memory Allocation for Heterogeneous Devices Using A Cooperative Compiler Framework

    公开(公告)号:US20240231910A9

    公开(公告)日:2024-07-11

    申请号:US17969397

    申请日:2022-10-19

    Applicant: MediaTek Inc.

    Inventor: Chi-Wei Wang

    CPC classification number: G06F9/5016 G06F8/441

    Abstract: A system allocates scratchpad memory (SPM) to heterogeneous devices for neural network computing. The system executes the operations of a global optimization manager. The global optimization manager receives compilation states from compilers, which compile corresponding subgraphs of a neural network model into corresponding subcommands that run on the heterogeneous devices. The global optimization manager unifies records of a same object across different ones of the compilation states, and allocates the SPM to the subgraphs according to the unified records of the compilation states.

    Optimization of Scratchpad Memory Allocation for Heterogeneous Devices Using A Cooperative Compiler Framework

    公开(公告)号:US20240134691A1

    公开(公告)日:2024-04-25

    申请号:US17969397

    申请日:2022-10-18

    Applicant: MediaTek Inc.

    Inventor: Chi-Wei Wang

    CPC classification number: G06F9/5016 G06F8/441

    Abstract: A system allocates scratchpad memory (SPM) to heterogeneous devices for neural network computing. The system executes the operations of a global optimization manager. The global optimization manager receives compilation states from compilers, which compile corresponding subgraphs of a neural network model into corresponding subcommands that run on the heterogeneous devices. The global optimization manager unifies records of a same object across different ones of the compilation states, and allocates the SPM to the subgraphs according to the unified records of the compilation states.

Patent Agency Ranking