公开(公告)号：US12249183B2

公开(公告)日：2025-03-11

申请号：US17687432

申请日：2022-03-04

Applicant: CANON KABUSHIKI KAISHA

Inventor： Qiao Wang ,  Deyu Wang ,  Kotaro Kitajima ,  Naoko Watazawa ,  Tsewei Chen ,  Wei Tao ,  Dongchao Wen

IPC: G06V40/16 ,  G06V10/24 ,  G06V10/77 ,  G06V10/82

Abstract: The present disclosure discloses an apparatus and a method for detecting a facial pose, an image processing system, and a storage medium. The apparatus comprises: an obtaining unit to obtain at least three keypoints of at least one face from an input image based on a pre-generated neural network, wherein coordinates of the keypoints obtained via a layer in the neural network for obtaining coordinates are three-dimensional coordinates; and a determining unit to determine, for the at least one face, a pose of the face based on the obtained keypoints, wherein the determined facial pose includes at least an angle. According to the present disclosure, the accuracy of the three-dimensional coordinates of the facial keypoints can be improved, thus the detection precision of a facial pose can be improved.

公开(公告)号：US20210287414A1

公开(公告)日：2021-09-16

申请号：US17196257

申请日：2021-03-09

Applicant: CANON KABUSHIKI KAISHA

Inventor： Kotaro Kitajima

IPC: G06T11/60

Abstract: An image processing apparatus includes: an image acquisition unit configured to acquire a photographed image; an editing unit configured to edit the photographed image by executing an action including an application and image processing that is a function of the application; an information acquisition unit configured to acquire photographing information on photographing of the photographed image; a first acquisition unit configured to acquire first history information indicating a history of actions for the photographed image; a second acquisition unit configured to acquire second history information based on at least a history of actions for an image different from the photographed image; and a control unit configured to determine a candidate for an action that is to be executed next on a basis of the first history information and the second history information and perform control to notify the determined candidate.

公开(公告)号：US20190304071A1

公开(公告)日：2019-10-03

申请号：US16363773

申请日：2019-03-25

Applicant: CANON KABUSHIKI KAISHA

Inventor： Kotaro Kitajima

IPC: G06T5/00 ,  H04N13/271 ,  G06T5/50 ,  G06T7/593

Abstract: An image processing apparatus includes a plurality of acquisition units configured to acquire distance distribution information about a subject included in the image, the plurality of acquisition units including a first acquisition unit configured to acquire the distance distribution information about the subject included in the image, based on parallax information about the image, and a second acquisition unit configured to acquire the distance distribution information about the subject included in the image, based on a feature quantity of the image different from the parallax information, and a determination unit configured to determine the acquisition unit which has acquired the distance distribution information with which a relighting process is to be performed, among the plurality of acquisition units.

公开(公告)号：US20190130544A1

公开(公告)日：2019-05-02

申请号：US16170203

申请日：2018-10-25

Applicant: CANON KABUSHIKI KAISHA

Inventor： Kotaro Kitajima

IPC: G06T5/00

Abstract: There is provided an image processing apparatus. A compositing unit performs compositing processing for compositing a first reflection characteristic data that shows a reflection characteristic of a first virtual light source on a predetermined object and a second reflection characteristic data that shows a reflection characteristic of a second virtual light source on the predetermined object. A generation unit generates a reflection component relating to an object that is included in an image, based on a reflection characteristic shown by composited reflection characteristic data obtained by the compositing processing. An addition unit adds the reflection component to the image.

公开(公告)号：US10171744B2

公开(公告)日：2019-01-01

申请号：US15432412

申请日：2017-02-14

Applicant: CANON KABUSHIKI KAISHA

Inventor： Kotaro Kitajima

IPC: H04N5/235 ,  G06K9/00 ,  G06K9/46 ,  G06K9/52 ,  G06K9/62 ,  H04N5/262

Abstract: With respect to a subject included in an image, the illuminating condition by an ambient light source in an environment where the image was captured is estimated, and based on the estimation result, the effect of a virtual light source that was non-existent at the time of image capture is computed. More specifically, the effect of the virtual light source is computed using an illumination direction of the virtual light source and the reflective characteristics of the subject illuminated by the virtual light source, which have been determined based on the estimation result, and an image derived from addition of the effect of the virtual light source is output.

公开(公告)号：US20180191933A1

公开(公告)日：2018-07-05

申请号：US15906328

申请日：2018-02-27

Applicant: CANON KABUSHIKI KAISHA

Inventor： Kotaro Kitajima

IPC: H04N5/235 ,  H04N5/262 ,  G06T5/00 ,  G01N21/88

CPC classification number: H04N5/2351 ,  G01N2021/8838 ,  G06T5/008 ,  H04N5/2354 ,  H04N5/2621

Abstract: The amount of light to be emitted by an auxiliary light source for capturing an image to which correction processing is applied, as well as a parameter used in the correction processing, is determined based on a degree of shadows of an object to be captured using the auxiliary light source. In this way, shadows in an image obtained through image capture using the auxiliary light source can be appropriately corrected with a simple method.

公开(公告)号：US20180077395A1

公开(公告)日：2018-03-15

申请号：US15693069

申请日：2017-08-31

Applicant: CANON KABUSHIKI KAISHA

Inventor： Kotaro Kitajima

IPC: H04N9/64 ,  G06T5/00 ,  G06T7/90 ,  G06T5/20 ,  H04N9/73 ,  H04N9/04 ,  G06T5/50

CPC classification number: H04N9/646 ,  G06K9/00221 ,  G06T5/008 ,  G06T5/20 ,  G06T5/50 ,  G06T7/90 ,  G06T2207/10024 ,  G06T2207/20224 ,  G06T2207/30201 ,  H04N5/235 ,  H04N9/045 ,  H04N9/68 ,  H04N9/73 ,  H04N9/77

Abstract: A reflection correction processing unit extracts at least color information from a peripheral area of a processing target pixel having a high luminance in an input image, and performs control, to the processing target pixel, to reduce the luminance of the processing target pixel and to bring a chrominance signal of the processing target pixel close to a predetermined chrominance signal ratio. In a case where a chrominance signal ratio based on the color information is close to the predetermined chrominance signal ratio, the reflection correction processing unit increases an intensity of the correction to the processing target pixel.

公开(公告)号：US11822974B2

公开(公告)日：2023-11-21

申请号：US17683878

申请日：2022-03-01

Applicant: CANON KABUSHIKI KAISHA

Inventor： Kotaro Kitajima

IPC: G06F3/00 ,  G06F9/54 ,  G06V40/16 ,  H04N23/71

CPC classification number: G06F9/54 ,  G06V40/171 ,  H04N23/71

Abstract: A portable terminal capable of executing a plurality of applications at the same time comprising a system controller configured to determine whether or not a background application can be executed in the background while the foreground application is being executed and executes the background application in the background, wherein the system controller determines whether or not the background application can be executed in the background based on information about the foreground application and environment suitability information from during the execution of the foreground application.

公开(公告)号：US20190098193A1

公开(公告)日：2019-03-28

申请号：US16203914

申请日：2018-11-29

Applicant: CANON KABUSHIKI KAISHA

Inventor： Kotaro Kitajima

IPC: H04N5/235 ,  G06K9/52 ,  G06K9/62 ,  G06K9/00 ,  G06K9/46 ,  H04N5/262

Abstract: With respect to a subject included in an image, the illuminating condition by an ambient light source in an environment where the image was captured is estimated, and based on the estimation result, the effect of a virtual light source that was non-existent at the time of image capture is computed. More specifically, the effect of the virtual light source is computed using an illumination direction of the virtual light source and the reflective characteristics of the subject illuminated by the virtual light source, which have been determined based on the estimation result, and an image derived from addition of the effect of the virtual light source is output.

公开(公告)号：US20170264808A1

公开(公告)日：2017-09-14

申请号：US15609126

申请日：2017-05-31

Applicant: CANON KABUSHIKI KAISHA

Inventor： Kotaro Kitajima

IPC: H04N5/235 ,  G06K9/20 ,  H04N5/232 ,  H04N9/04 ,  H04N5/225 ,  G06K9/00 ,  G06T5/00

CPC classification number: H04N5/2354 ,  G06K9/00221 ,  G06K9/2027 ,  G06K9/4661 ,  G06T5/008 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2207/20012 ,  G06T2207/30201 ,  H04N5/2256 ,  H04N5/23219 ,  H04N9/045

Abstract: An image processing apparatus comprising: an obtaining unit configured to obtain a first image of an object shot with flashing of an illumination device and distance information of distances to a plurality of positions of the object; a determination unit configured to determine a position of a virtual light source that emits virtual light; and a processing unit configured to obtain shape information of the object based on the distance information, and generate an image in which the object is illuminated by the virtual light source by processing the first image based on the obtained shape information of the object, the distance information, and the position of the virtual light source with respect to the object.