METHOD AND APPARATUS FOR INCREMENTAL LEARNING

    公开(公告)号:US20220138633A1

    公开(公告)日:2022-05-05

    申请号:US17317421

    申请日:2021-05-11

    IPC分类号: G06N20/20 G06K9/62

    摘要: An electronic device and method for performing class-incremental learning are provided. The method includes designating a pre-trained first model for at least one past data class as a first teacher; training a second model; designating the trained second model as a second teacher; performing dual-teacher information distillation by maximizing mutual information at intermediate layers of the first teacher and second teacher; and transferring the information to a combined student model.

    Method and apparatus for learning low-precision neural network that combines weight quantization and activation quantization

    公开(公告)号:US11270187B2

    公开(公告)日:2022-03-08

    申请号:US15914229

    申请日:2018-03-07

    IPC分类号: G06N3/04 G06N3/08

    摘要: A method is provided. The method includes selecting a neural network model, wherein the neural network model includes a plurality of layers, and wherein each of the plurality of layers includes weights and activations; modifying the neural network model by inserting a plurality of quantization layers within the neural network model; associating a cost function with the modified neural network model, wherein the cost function includes a first coefficient corresponding to a first regularization term, and wherein an initial value of the first coefficient is pre-defined; and training the modified neural network model to generate quantized weights for a layer by increasing the first coefficient until all weights are quantized and the first coefficient satisfies a pre-defined threshold, further including optimizing a weight scaling factor for the quantized weights and an activation scaling factor for quantized activations, and wherein the quantized weights are quantized using the optimized weight scaling factor.

    COMPUTING SYSTEM WITH CHANNEL ESTIMATION MECHANISM AND METHOD OF OPERATION THEREOF
    6.
    发明申请
    COMPUTING SYSTEM WITH CHANNEL ESTIMATION MECHANISM AND METHOD OF OPERATION THEREOF 有权
    具有信道估计机制的计算系统及其操作方法

    公开(公告)号:US20160080174A1

    公开(公告)日:2016-03-17

    申请号:US14553917

    申请日:2014-11-25

    IPC分类号: H04L25/02 H04L27/00

    摘要: A computing system includes: an inter-device interface configured to receive receiver signal for communicating serving content through a communication channel; a communication unit, coupled to the inter-device interface, configured to: calculate a weighting set corresponding to a modular estimation mechanism, and generate a channel estimate based on the weighting set for characterizing the communication channel for recovering the serving content.

    摘要翻译: 计算系统包括:设备间接口,被配置为接收通过通信信道传送服务内容的接收机信号; 耦合到所述设备间接口的通信单元,被配置为:计算对应于模块化估计机制的加权集合,并且基于所述加权集合生成用于表征所述通信信道以恢复所述服务内容的信道估计。