CACHE STREAMING APPARATUS AND METHOD FOR DEEP LEARNING OPERATIONS

    公开(公告)号:US20230297513A1

    公开(公告)日:2023-09-21

    申请号:US17699062

    申请日:2022-03-18

    CPC classification number: G06F12/0897 G06N20/00 G06F2212/60

    Abstract: A cache streaming apparatus and method for machine learning. For example, one embodiment of an apparatus comprises: a plurality of compute units to perform machine learning operations; a cache subsystem comprising a hierarchy of cache levels, at least some of the cache levels shared by two or more of the plurality of compute units; and data streaming hardware logic to stream machine learning data in and out of the cache subsystem based on the machine learning operations, the data streaming hardware logic to load data into the cache subsystem from memory before the data is needed by a first portion of the machine learning operations and to ensure that results produced by the first portion of machine learning operations are maintained in the cache subsystem until used by a second portion of the machine learning operations.

Patent Agency Ranking