ELECTRONIC DEVICE AND OPERATION METHOD THEREOF

    公开(公告)号:US20210136467A1

    公开(公告)日:2021-05-06

    申请号:US17046494

    申请日:2019-03-27

    摘要: Provided are an electronic device and an operation method thereof. The electronic device includes a memory that stores one or more instructions, and a processor that executes the one or more instructions stored in the memory, wherein the processor is configured to execute the one or more instructions to: divide original image data into a plurality of image sequences; determine a predetermined number of image sequences among the plurality of image sequences as an input image group, select one of the image sequences included in the input image group and add the selected image sequence to the highlight image group based on one or more image sequences pre-classified as a highlight image group, by using a trained model trained using an artificial intelligence algorithm; and generate summary image data extracted from the original image data, by using the image sequence included in the highlight image group.

    METHOD AND APPARATUS WITH NEURAL NETWORK TRAINING

    公开(公告)号:US20240232632A1

    公开(公告)日:2024-07-11

    申请号:US18343303

    申请日:2023-06-28

    IPC分类号: G06N3/084 G06N3/045

    CPC分类号: G06N3/084 G06N3/045

    摘要: A processor-implemented method may include generating respective first neural network differential data by differentiating a respective output of each layer of a first neural network with respect to input data provided to the first neural network that estimates output data from the input data, by a forward propagation process of the first neural network, generating, using a second neural network, an output differential value of the output data with respect to the input data using the respective first neural network differential data, and training the first neural network and the second neural network based on ground truth data of the output data and ground truth data of the output differential value.

    METHOD AND APPARATUS WITH NEURAL NETWORK PARAMETER QUANTIZATION

    公开(公告)号:US20230017432A1

    公开(公告)日:2023-01-19

    申请号:US17950342

    申请日:2022-09-22

    IPC分类号: G06N3/04 G06K9/62 G06F17/18

    摘要: A processor-implemented neural network method includes: determining a respective probability density function (PDF) of normalizing a statistical distribution of parameter values, for each channel of each of a plurality of feature maps of a pre-trained neural network; determining, for each channel, a corresponding first quantization range for performing quantization of corresponding parameter values, based on a quantization error and a quantization noise of the respective determined PDF; determining, for each channel, a corresponding second quantization range, based on a signal-to-quantization noise ratio (SQNR) of the respective determined PDF; correcting, for each channel, the corresponding first quantization range based on the corresponding second quantization range; and generating a quantized neural network, based on the corrected first quantization range corresponding for each channel.

    METHOD AND APPARATUS WITH DISTRIBUTED TRAINING OF NEURAL NETWORK

    公开(公告)号:US20230169333A1

    公开(公告)日:2023-06-01

    申请号:US17862881

    申请日:2022-07-12

    IPC分类号: G06N3/08

    CPC分类号: G06N3/08

    摘要: Disclosed are a training method and apparatus for distributed training of a neural network, the training apparatus including processors configured to perform distributed training, wherein each of the processors is further configured to perform a forward direction operation for layers of the neural network, determine a loss of the neural network based on the forward direction operation, determine a local gradient for each layer of the neural network by performing a backward direction operation for the layers of the neural network based on the loss, determine whether to perform gradient clipping for a local gradient determined for a previous layer, in response to determining a local gradient for a current layer through the backward direction operation, determine an aggregated gradient based on the backward direction operation and the gradient clipping performed by each of the processors, and update parameters of the neural network based on the aggregated gradient.

    METHOD AND APPARATUS WITH DATA LOADING

    公开(公告)号:US20230140239A1

    公开(公告)日:2023-05-04

    申请号:US17868361

    申请日:2022-07-19

    IPC分类号: G06F16/906 G06F40/20 G06K9/62

    摘要: A processor-implemented method with data loading includes: dividing a training data set into a plurality of subsets based on sizes of a plurality of data files included in the training data set; loading, from each of the plurality of subsets, a portion of data files in the subset to a plurality of processors based on a proportion of a number of data files of the plurality of subsets in the subset and a batch size of distributed training; and reallocating, based on sizes of data files loaded to processors in a same group among the plurality of processors, the loaded data files to the processors in the same group.