公开(公告)号：US10528846B2

公开(公告)日：2020-01-07

申请号：US15795677

申请日：2017-10-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Youngsung Kim ,  Byungin Yoo ,  Deheng Qian ,  Hui Zhang ,  Chang Kyu Choi ,  He Zheng ,  Jae-Joon Han ,  Jingtao Xu ,  Tianchu Guo

IPC: G06K9/62 ,  G06K9/00 ,  G06K9/66

Abstract: A method to analyze a facial image includes: inputting a facial image to a residual network including residual blocks that are sequentially combined and arranged in a direction from an input to an output; processing the facial image using the residual network; and acquiring an analysis map from an output of an N-th residual block among the residual blocks using a residual deconvolution network, wherein the residual network transfers the output of the N-th residual block to the residual deconvolution network, and N is a natural number that is less than a number of all of the residual blocks, and wherein the residual deconvolution network includes residual deconvolution blocks that are sequentially combined, and the residual deconvolution blocks correspond to respective residual blocks from a first residual block among the residual blocks to the N-th residual block.

公开(公告)号：US20210366152A1

公开(公告)日：2021-11-25

申请号：US17394653

申请日：2021-08-05

Applicant: Samsung Electronics Co., Ltd.

Inventor： Xiabing Liu ,  Hui Zhang ,  Jae-Joon Han ,  Changkyu Choi ,  Tianchu Guo

IPC: G06T7/73

Abstract: A gaze estimation method and apparatus is disclosed. The gaze estimation method includes obtaining an image including an eye region of a user, extracting, from the obtained image, a first feature of data, obtaining a second feature of data used for calibration of a neural network model, and estimating a gaze of the user using the first feature and the second feature.

公开(公告)号：US11747898B2

公开(公告)日：2023-09-05

申请号：US17394653

申请日：2021-08-05

Applicant: Samsung Electronics Co., Ltd.

Inventor： Xiabing Liu ,  Hui Zhang ,  Jae-Joon Han ,  Changkyu Choi ,  Tianchu Guo

IPC: G06V10/82 ,  G06F3/01 ,  G06T7/73 ,  G06V10/764 ,  G06V40/18 ,  G06V20/20

CPC classification number: G06F3/013 ,  G06T7/74 ,  G06V10/764 ,  G06V10/82 ,  G06V40/18 ,  G06T2207/20021 ,  G06T2207/20076 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30201 ,  G06V20/20

Abstract: A gaze estimation method and apparatus is disclosed. The gaze estimation method includes obtaining an image including an eye region of a user, extracting, from the obtained image, a first feature of data, obtaining a second feature of data used for calibration of a neural network model, and estimating a gaze of the user using the first feature and the second feature.

公开(公告)号：US11347308B2

公开(公告)日：2022-05-31

申请号：US16937722

申请日：2020-07-24

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yongchao Liu ,  Hui Zhang ,  Xiabing Liu ,  Byung In Yoo ,  Chang Kyu Choi ,  Jaejoon Han ,  Youngjun Kwak ,  Tianchu Guo

IPC: G06F3/01 ,  G06N3/08 ,  G06F3/14 ,  G06K9/62 ,  G06V40/16

Abstract: A gaze tracking method and apparatus, and a gaze tracking neural network training method and apparatus are provided. The gaze tracking apparatus includes one or more processors and a memory, and the one or more processors obtain output position information from an input face image of a user using a neural network model, determines a position adjustment parameter for the user, and predicts gaze position information of the user by adjusting the output position information based on the position adjustment parameter.

公开(公告)号：US11688105B2

公开(公告)日：2023-06-27

申请号：US17109762

申请日：2020-12-02

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Tianchu Guo ,  Youngsung Kim ,  Hui Zhang ,  Byungin Yoo ,  Chang Kyu Choi ,  Jae-Joon Han ,  Jingtao Xu ,  Deheng Qian

IPC: G06T11/00 ,  G06F17/10 ,  G06T7/246 ,  G06V40/16 ,  G06V10/75

CPC classification number: G06T11/00 ,  G06F17/10 ,  G06T7/248 ,  G06V10/757 ,  G06V40/166 ,  G06V40/168 ,  G06V40/171 ,  G06V40/174 ,  G06T2207/30201

Abstract: A processor implemented method of processing a facial expression image, the method includes controlling a camera to capture a first facial expression image and a second facial expression image, acquiring a first expression feature of the first facial expression image, acquiring a second expression feature of the second facial expression image, generating a new expression feature dependent on differences between the acquired first expression feature and the acquired second expression feature, and adjusting a target facial expression image based on the new expression feature.

公开(公告)号：US11514602B2

公开(公告)日：2022-11-29

申请号：US16722304

申请日：2019-12-20

Applicant: Samsung Electronics Co., Ltd.

Inventor： Tianchu Guo ,  Hui Zhang ,  Xiabing Liu ,  Chang Kyu Choi ,  Jaejoon Han ,  Yongchao Liu

IPC: G06T7/73 ,  G06K9/62 ,  G06V40/16

Abstract: A gaze estimation method includes receiving, by a processor, input data including a current image and a previous image each including a face of a user, determining, by the processor, a gaze mode indicating a relative movement between the user and a camera that captured the current image and the previous image based on the input data, and estimating, by the processor, a gaze of the user based on the determined gaze mode, wherein the determined gaze mode is one of a plurality of gaze modes comprising a stationary mode and a motion mode.

公开(公告)号：US12014529B2

公开(公告)日：2024-06-18

申请号：US17153018

申请日：2021-01-20

Applicant: Samsung Electronics Co., Ltd.

Inventor： Tianchu Guo ,  Hui Zhang ,  Xiabing Liu ,  ByungIn Yoo ,  ChangKyu Choi ,  Jaejoon Han ,  YoungJun Kwak ,  Yongchao Liu

IPC: G06V10/40 ,  G06N3/08 ,  G06T3/10 ,  G06T5/50 ,  G06V10/80 ,  G06V10/82 ,  G06V40/16 ,  G06V40/18

CPC classification number: G06V10/40 ,  G06N3/08 ,  G06T3/10 ,  G06T5/50 ,  G06V10/809 ,  G06V10/82 ,  G06V40/168 ,  G06V40/193

Abstract: An image processing method and apparatus using a neural network are provided. The image processing method includes generating a plurality of augmented features by augmenting an input feature, and generating a prediction result based on the plurality of augmented features.

公开(公告)号：US11113842B2

公开(公告)日：2021-09-07

申请号：US16722221

申请日：2019-12-20

Applicant: Samsung Electronics Co., Ltd.

Inventor： Xiabing Liu ,  Hui Zhang ,  Jae-Joon Han ,  Changkyu Choi ,  Tianchu Guo

IPC: G06T7/73

Abstract: A gaze estimation method and apparatus is disclosed. The gaze estimation method includes obtaining an image including an eye region of a user, extracting, from the obtained image, a first feature of data, obtaining a second feature of data used for calibration of a neural network model, and estimating a gaze of the user using the first feature and the second feature.

公开(公告)号：US10860841B2

公开(公告)日：2020-12-08

申请号：US15837877

申请日：2017-12-11

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Tianchu Guo ,  Youngsung Kim ,  Hui Zhang ,  Byungin Yoo ,  Chang Kyu Choi ,  Jae-Joon Han ,  Jingtao Xu ,  Deheng Qian

IPC: G06K9/00 ,  G06F17/10 ,  G06T7/246 ,  G06K9/62 ,  G06T11/00

Abstract: A processor implemented method of processing a facial expression image, the method includes acquiring an expression feature of each of at least two reference facial expression images; generating a new expression feature based on an interpolation value of the expression feature; and adjusting a target facial expression image based on the new expression feature and creating a new facial expression image.