公开(公告)号：US20230401420A1

公开(公告)日：2023-12-14

申请号：US17838240

申请日：2022-06-12

Applicant: MediaTek Inc.

Inventor： Chih-Wen Goo ,  Pei-Kuei Tsung ,  Chih-Wei Chen ,  Mingen Shih ,  Shu-Hsin Chang ,  Po-Hua Huang ,  Ping-Yuan Tsai ,  Shih-Wei Hsieh ,  You Yu Nian

IPC: G06N3/04 ,  G06F9/30

CPC classification number: G06N3/04 ,  G06F9/3001

Abstract: A system receives a neural network model that includes asymmetric operations. Each asymmetric operation includes one or more fixed-point operands that are asymmetrically-quantized from corresponding floating-point operands. The system compiles a given asymmetric operation of the neural network model into a symmetric operation that includes a combined bias value. A compiler computes the combined bias value is a constant by merging at least zero points of input and output of the given asymmetric operation. The system then generates a symmetric neural network model including the symmetric operation for inference hardware to execute in fixed-point arithmetic.