Method and apparatus for neural network quantization

    公开(公告)号:US11934939B2

    公开(公告)日:2024-03-19

    申请号:US18116553

    申请日:2023-03-02

    CPC classification number: G06N3/045 G06N3/047 G06N3/084

    Abstract: According to a method and apparatus for neural network quantization, a quantized neural network is generated by performing learning of a neural network, obtaining weight differences between an initial weight and an updated weight determined by the learning of each cycle for each of layers in the first neural network, analyzing a statistic of the weight differences for each of the layers, determining one or more layers, from among the layers, to be quantized with a lower-bit precision based on the analyzed statistic, and generating a second neural network by quantizing the determined one or more layers with the lower-bit precision.

    Method and apparatus with neural network

    公开(公告)号:US11544549B2

    公开(公告)日:2023-01-03

    申请号:US16106703

    申请日:2018-08-21

    Abstract: A processor-implemented neural network method includes calculating individual update values for a weight assigned to a connection relationship between nodes included in a neural network; generating an accumulated update value by accumulating the individual update values in an accumulation buffer; and training the neural network by updating the weight using the accumulated update value in response to the accumulated update value being equal to or greater than a threshold value.

    APPARATUS AND METHOD FOR ACQUIRING BIO-INFORMATION
    4.
    发明申请
    APPARATUS AND METHOD FOR ACQUIRING BIO-INFORMATION 审中-公开
    获取生物信息的装置和方法

    公开(公告)号:US20160106327A1

    公开(公告)日:2016-04-21

    申请号:US14884019

    申请日:2015-10-15

    CPC classification number: A61B5/02108 A61B5/0261 A61B5/681 A61B5/742

    Abstract: An apparatus for acquiring bio-information includes a light source configured to radiate a laser beam to a region of interest including a blood vessel; a sensor configured to sense, from the region of interest, a change of a laser speckle generated by the radiated laser beam; and a controller configured to obtain a bio-signal indicating a change in a blood flow in the blood vessel based on the sensed change of the laser speckle.

    Abstract translation: 一种用于获取生物信息的装置,包括配置成将激光束照射到包括血管的感兴趣区域的光源; 传感器,被配置为从感兴趣的区域感测由辐射激光束产生的激光散斑的变化; 以及控制器,被配置为基于感测到的激光散斑的变化来获得指示血管中血流变化的生物信号。

    Neural network method and apparatus with parameter quantization

    公开(公告)号:US11836603B2

    公开(公告)日:2023-12-05

    申请号:US16282748

    申请日:2019-02-22

    CPC classification number: G06N3/047 G06N3/04 G06N3/08

    Abstract: A neural network method of parameter quantization obtains channel profile information for first parameter values of a floating-point type in each channel included in each of feature maps based on an input in a first dataset to a floating-point parameters pre-trained neural network, and determines a probability density function (PDF) type, for each channel, appropriate for the channel profile information based on a classification network receiving the channel profile information as a dataset. The neural network method of parameter quantization determines a fixed-point representation, based on the determined PDF type, for each channel, statistically covering a distribution range of the first parameter values, and generates a fixed-point quantized neural network based on the fixed-point representation determined for each channel.

    Method and apparatus for neural network quantization

    公开(公告)号:US11625577B2

    公开(公告)日:2023-04-11

    申请号:US16738338

    申请日:2020-01-09

    Abstract: According to a method and apparatus for neural network quantization, a quantized neural network is generated by performing learning of a neural network, obtaining weight differences between an initial weight and an updated weight determined by the learning of each cycle for each of layers in the first neural network, analyzing a statistic of the weight differences for each of the layers, determining one or more layers, from among the layers, to be quantized with a lower-bit precision based on the analyzed statistic, and generating a second neural network by quantizing the determined one or more layers with the lower-bit precision.

    Method and apparatus for generating fixed-point quantized neural network

    公开(公告)号:US11588496B2

    公开(公告)日:2023-02-21

    申请号:US16051788

    申请日:2018-08-01

    Abstract: A method of generating a fixed-point quantized neural network includes analyzing a statistical distribution for each channel of floating-point parameter values of feature maps and a kernel for each channel from data of a pre-trained floating-point neural network, determining a fixed-point expression of each of the parameters for each channel statistically covering a distribution range of the floating-point parameter values based on the statistical distribution for each channel, determining fractional lengths of a bias and a weight for each channel among the parameters of the fixed-point expression for each channel based on a result of performing a convolution operation, and generating a fixed-point quantized neural network in which the bias and the weight for each channel have the determined fractional lengths.

Patent Agency Ranking