APPARATUS AND METHOD FOR SCHEDULING INFERENCE TASKS

    公开(公告)号:US20230297415A1

    公开(公告)日:2023-09-21

    申请号:US17699058

    申请日:2022-03-18

    CPC classification number: G06F9/4843 G06T1/20 G06F9/30189

    Abstract: Apparatus and method for scheduling inference tasks. For example, one embodiment of an apparatus comprises: a plurality of compute units (CUs) to execute inferencing routines, an inferencing routine comprising a plurality of phases, at least one CU comprising execution circuitry configurable to operate in a single instruction multiple data (SIMD) mode or a single instruction multiple thread (SIMT) mode; and dispatching hardware logic to determine whether a current phase of an inferencing routine is to be executed in the SIMD mode or the SIMT mode, and to dispatch instructions of the current phase for execution by the execution circuitry of a CU in accordance with the SIMD mode or the SIMT mode, respectively.

Patent Agency Ranking