QUANTIZATION METHOD AND DEVICE FOR WEIGHTS OF BATCH NORMALIZATION LAYER

    公开(公告)号:US20200151568A1

    公开(公告)日:2020-05-14

    申请号:US16541275

    申请日:2019-08-15

    Abstract: An embodiment of the present invention provides a quantization method for weights of a plurality of batch normalization layers, including: receiving a plurality of previously learned first weights of the plurality of batch normalization layers; obtaining first distribution information of the plurality of first weights; performing a first quantization on the plurality of first weights using the first distribution information to obtain a plurality of second weights; obtaining second distribution information of the plurality of second weights; and performing a second quantization on the plurality of second weights using the second distribution information to obtain a plurality of final weights, and thereby reducing an error that may occur when quantizing the weight of the batch normalization layer.

    COMPRESSED NEURAL NETWORK SYSTEM USING SPARSE PARAMETERS AND DESIGN METHOD THEREOF

    公开(公告)号:US20180204110A1

    公开(公告)日:2018-07-19

    申请号:US15867601

    申请日:2018-01-10

    CPC classification number: G06N3/04 G06N3/0454 G06N3/063 G06N3/082

    Abstract: Provided is a design method of a compressed neural network system. The method includes generating a compressed neural network based on an original neural network model, analyzing a sparse weight among kernel parameters of the compressed neural network, calculating a maximum possible calculation throughput on a target hardware platform according to a sparse property of the sparse weight, calculating a calculation throughput with respect to access to an external memory on the target hardware platform according to the sparse property, and determining a design parameter on the target hardware platform by referring the maximum possible calculation throughput and the calculation throughput with respect to access.

    ENCODING APPARATUS AND ENCODING METHOD OF MULTIPLE INPUT MULTIPLE OUTPUT COMMUNICATION SYSTEM
    5.
    发明申请
    ENCODING APPARATUS AND ENCODING METHOD OF MULTIPLE INPUT MULTIPLE OUTPUT COMMUNICATION SYSTEM 有权
    多输入多输出通信系统的编码装置和编码方法

    公开(公告)号:US20150030093A1

    公开(公告)日:2015-01-29

    申请号:US14157727

    申请日:2014-01-17

    Inventor: Byung Jo KIM

    CPC classification number: H04B7/0689 H04B7/0456 H04B7/0697

    Abstract: When precoding information corresponding to data items of respective layers to be transmitted is received from an upper layer, an encoding apparatus of a multiple input multiple output (MIMO) communication system selects a precoding matrix among a plurality of precoding matrices stored in a storage using the precoding information and precodes the data items of the respective layers by simple operations consisting of at least one operation combination of addition, subtraction, selection, and inversion operations in accordance with a kind of the selected precoding matrix and a precoding operation pattern.

    Abstract translation: 当从上层接收到与要发送的各层的数据项对应的预编码信息时,多输入多输出(MIMO)通信系统的编码装置使用存储在存储器中的多个预编码矩阵中选择预编码矩阵 通过根据所选择的预编码矩阵的种类和预编码操作模式,进行由加法,减法,选择和反转操作的至少一个操作组合的简单操作,对各个层的数据项进行预编码信息和预编码。

    NEUROMORPHIC ARITHMETIC DEVICE AND OPERATING METHOD THEREOF

    公开(公告)号:US20200226456A1

    公开(公告)日:2020-07-16

    申请号:US16742808

    申请日:2020-01-14

    Abstract: The neuromorphic arithmetic device comprises an input monitoring circuit that outputs a monitoring result by monitoring that first bits of at least one first digit of a plurality of feature data and a plurality of weight data are all zeros, a partial sum data generator that skips an arithmetic operation that generates a first partial sum data corresponding to the first bits of a plurality of partial sum data in response to the monitoring result while performing the arithmetic operation of generating the plurality of partial sum data, based on the plurality of feature data and the plurality of weight data, and a shift adder that generates the first partial sum data with a zero value and result data, based on second partial sum data except for the first partial sum data among the plurality of partial sum data and the first partial sum data generated with the zero value.

Patent Agency Ranking