Software-defined memory bandwidth reduction by hierarchical stream buffering for general matrix multiplication in a programmable IC
Abstract:
Methods and apparatus are described for partitioning and reordering block-based matrix multiplications for high-speed data streaming in general matrix multiplication (GEMM), which may be implemented by a programmable integrated circuit (IC). By preloading and hierarchically caching the blocks, examples of the present disclosure reduce the double data rate (DDR) memory intake bandwidth for software-defined GEMM accelerators.
Information query
Patent Agency Ranking
0/0