公开(公告)号：US12079717B2

公开(公告)日：2024-09-03

申请号：US16918206

申请日：2020-07-01

Applicant: CANON KABUSHIKI KAISHA

Inventor： Shunta Tate ,  Tsewei Chen

IPC: G06N3/08 ,  G06N3/04

CPC classification number: G06N3/08 ,  G06N3/04

Abstract: There is provided with a data processing apparatus for detecting an object from an image using a hierarchical neural network. The data processing apparatus has parallel first and second neural networks. An obtaining unit obtains a table which defines different first and second portions. An operation unit performs calculation of the feature data of a third portion based on feature data of the first portion identified using the table and on a weighting parameter between first and second layers of the first neural network, and calculation of feature data of a fourth portion based on feature data of the second portion identified using the table and on a weighting parameter between the first and second layers of the second neural network.

公开(公告)号：US11822900B2

公开(公告)日：2023-11-21

申请号：US16896565

申请日：2020-06-09

Applicant: CANON KABUSHIKI KAISHA

Inventor： Tsewei Chen ,  Masami Kato

IPC: G06F7/544 ,  G06N3/02 ,  G06N3/08 ,  G06F17/15 ,  G06F18/2431 ,  G06V10/764 ,  G06V10/82 ,  G06V10/44

CPC classification number: G06F7/5443 ,  G06F18/2431 ,  G06N3/08 ,  G06V10/454 ,  G06V10/764 ,  G06V10/82

Abstract: There is provided with a filter processing device for performing a convolution operation using a filter on a feature plane. An acquisition unit acquires feature plane data, filter coefficients of the filter, and valid coefficient information which specifies filter coefficients to be used in the convolution operation among the filter coefficients of the filter. A calculation unit performs a convolution operation of the filter coefficients specified by the valid coefficient information and pieces of the feature plane data corresponding to the specified filter coefficients.

公开(公告)号：US11574188B2

公开(公告)日：2023-02-07

申请号：US16810057

申请日：2020-03-05

Applicant: CANON KABUSHIKI KAISHA

Inventor： Motoki Yoshinaga ,  Tsewei Chen ,  Masami Kato

IPC: G06N3/08 ,  H03M7/30

Abstract: There is provided with a data processing apparatus. An acquisition unit acquires feature plane data of a layer included in a neural network. A control unit outputs a first control signal corresponding to the layer for controlling first compression processing and a second control signal corresponding to the layer for controlling second compression processing. A first compression unit performs the first compression processing corresponding to the first control signal on the feature plane data. A second compression unit performs the second compression processing corresponding to the second control signal on the feature plane data after the first compression processing. A type of processing of the second compression processing is different from the first compression processing.

公开(公告)号：US11537438B2

公开(公告)日：2022-12-27

申请号：US16900613

申请日：2020-06-12

Applicant: CANON KABUSHIKI KAISHA

Inventor： Daisuke Nakashima ,  Tsewei Chen

IPC: G06F9/50 ,  G06N3/10 ,  G06N3/063 ,  G06V30/194

Abstract: An information processing apparatus includes a determination unit configured to determine a storage method of storing a kernel based on a configuration of a plurality of memory areas and a size of the kernel, a storage unit configured to store the kernel using the determined storage method, a reading unit configured to read the kernel from the storage unit based on the storage method of storing the kernel, and a calculation unit configured to execute calculation using input data and the read kernel.

公开(公告)号：US11468600B2

公开(公告)日：2022-10-11

申请号：US16589483

申请日：2019-10-01

Applicant: CANON KABUSHIKI KAISHA

Inventor： Tsewei Chen

IPC: G06T7/00 ,  G06F7/544 ,  G06N3/063 ,  G06N3/04

Abstract: An information processing apparatus comprises a control unit configured to set a shift amount based on a bit width of data, for each layer of a network including a plurality of layers, a plurality of MAC (multiply-accumulate) units configured to execute MAC operations on a plurality of data and a plurality of filter coefficients of the layer, a plurality of shift operation units configured to shift a plurality of MAC operation results obtained by the plurality of MAC units based on the shift amount, and an adding unit configured to calculate a total sum of the plurality of MAC operation results shifted by the plurality of shift operation units.

公开(公告)号：US11354808B2

公开(公告)日：2022-06-07

申请号：US16140279

申请日：2018-09-24

Applicant: CANON KABUSHIKI KAISHA

Inventor： Qin Yang ,  Tsewei Chen

IPC: G06T7/194 ,  G06T7/11 ,  G06T7/254 ,  G06V10/22

Abstract: An image processing apparatus including a unit configured to acquire a current image from an inputted video and a background model which comprises a background image and foreground/background classification information of visual elements; a unit configured to determine first similarity measures between visual elements in the current image and the visual elements in the background model; and a unit configured to classify the visual elements in the current image as the foreground or the background according to the current image, the background image in the background model and the first similarity measures. Wherein, the visual elements in the background model are the visual elements whose classification information is the background and which neighbour to corresponding portions of the visual elements in the current image. Accordingly, the accuracy of the foreground detection could be improved.

公开(公告)号：US20200285961A1

公开(公告)日：2020-09-10

申请号：US16799199

申请日：2020-02-24

Applicant: CANON KABUSHIKI KAISHA

Inventor： Motoki Yoshinaga ,  Tsewei Chen ,  Masami Kato

IPC: G06N3/08 ,  G06N3/04 ,  G06K9/62

Abstract: A data processing apparatus for executing data processing using a neural network including a plurality of hierarchal levels includes an extraction unit configured to extract intermediate feature data from input feature data, a calculation unit configured to calculate output feature data by reducing the number of channels of the intermediate feature data, a storage unit configured to store the output feature data calculated by the calculation unit and provide the input feature data to the extraction unit, and a control unit configured to control the number of channels of the intermediate feature data to be extracted by the extraction unit and the number of channels of the output feature data to be calculated by the calculation unit.

公开(公告)号：US10579909B2

公开(公告)日：2020-03-03

申请号：US15730075

申请日：2017-10-11

Applicant: CANON KABUSHIKI KAISHA

Inventor： Tsewei Chen

IPC: G06K9/62 ,  G06K9/00

Abstract: In an information processing apparatus that includes sequences of weak classifiers which are logically cascade-connected in each sequence and the sequences respectively correspond to categories of an object and in which the weak classifiers are grouped into at least a first group and a second group in the order of connection, classification processing by weak classifiers belonging to the first group of respective categories is performed by pipeline processing. Based on the processing results of the weak classifiers belonging to the first group of the respective categories, categories in which classification processing by weak classifiers belonging to the second group is to be performed are decided out of the categories. The classification processing by the weak classifiers respectively corresponding to the decided categories and belonging to the second group is performed by pipeline processing.

公开(公告)号：US20190332356A1

公开(公告)日：2019-10-31

申请号：US16387262

申请日：2019-04-17

Applicant: CANON KABUSHIKI KAISHA

Inventor： Tsewei Chen ,  Masami Kato ,  Masahiro Ariizumi

IPC: G06F7/533 ,  G06N3/08 ,  G06F7/544

Abstract: An apparatus includes a first holding unit and a second holding unit configured to hold first-type data and second-type data, respectively, a first operation unit configured to execute a first product-sum operation based on the first-type data, a branch unit configured to output an operation result of the first product-sum operation in parallel, a sampling unit configured to sample the operation result and to output a sampling result, and a second operation unit configured to execute a second product-sum operation based on the second-type data and the sampling result.

公开(公告)号：US20190279072A1

公开(公告)日：2019-09-12

申请号：US16295384

申请日：2019-03-07

Applicant: CANON KABUSHIKI KAISHA

Inventor： Hongxing Gao ,  Wei Tao ,  Tsewei Chen ,  Dongchao Wen

IPC: G06N3/04 ,  G06N3/08

Abstract: A method and an apparatus for optimizing and applying a multilayer neural network model, and a storage medium are provided. The optimization method includes, dividing out at least one sub-structure from the multilayer neural network model to be optimized, wherein a tail layer of the divided sub-structure is a quantization layer, and transferring operation parameters in layers other than the quantization layer to the quantization layer for each of the divided sub-structures and updating quantization threshold parameters in the quantization layer based on the transferred operation parameters. When a multilayer neural network model optimized based on the optimization method is operated, the necessary processor resources can be reduced.