-
公开(公告)号:US11468544B2
公开(公告)日:2022-10-11
申请号:US17355687
申请日:2021-06-23
Applicant: Snap Inc.
Inventor: Chen Cao , Wen Zhang , Menglei Chai , Linjie Luo
Abstract: Systems, devices, media, and methods are presented for generating texture models for objects within a video stream. The systems and methods access a set of images as the set of images are being captured at a computing device. The systems and methods determine, within a portion of the set of images, an area of interest containing an eye and extract an iris area from the area of interest. The systems and methods segment a sclera area within the area of interest and generate a texture for the eye based on the iris area and the sclera area.
-
公开(公告)号:US20220254084A1
公开(公告)日:2022-08-11
申请号:US17724235
申请日:2022-04-19
Applicant: Snap Inc.
Inventor: Harrison Jesse Smith , Chen Cao , Yingying Wang
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for transforming a motion style of an avatar from a first style to a second style. The program and method include: retrieving, by a processor from a storage device, an avatar depicting motion in a first style; receiving user input selecting a second style; obtaining, based on the user input, a trained machine learning model that performs a non-linear transformation of motion from the first style to the second style; and applying the obtained trained machine learning model to the retrieved avatar to transform the avatar from depicting motion in the first style to depicting motion in the second style.
-
公开(公告)号:US20220036647A1
公开(公告)日:2022-02-03
申请号:US17499659
申请日:2021-10-12
Applicant: Snap Inc.
Inventor: Soumyadip Sengupta , Linjie Luo , Chen Cao , Menglei Chai
Abstract: A shape generation system can generate a three-dimensional (3D) model of an object from a two-dimensional (2D) image of the object by projecting vectors onto light cones created from the 2D image. The projected vectors can be used to more accurately create the 3D model of the object based on image element (e.g., pixel) values of the image.
-
公开(公告)号:US20210319540A1
公开(公告)日:2021-10-14
申请号:US17355687
申请日:2021-06-23
Applicant: Snap Inc.
Inventor: Chen Cao , Wen Zhang , Menglei Chai , Linjie Luo
Abstract: Systems, devices, media, and methods are presented for generating texture models for objects within a video stream. The systems and methods access a set of images as the set of images are being captured at a computing device. The systems and methods determine, within a portion of the set of images, an area of interest containing an eye and extract an iris area from the area of interest. The systems and methods segment a sclera area within the area of interest and generate a texture for the eye based on the iris area and the sclera area.
-
公开(公告)号:US11120597B2
公开(公告)日:2021-09-14
申请号:US16749753
申请日:2020-01-22
Applicant: Snap Inc.
Abstract: The present invention relates to a joint automatic audio visual driven facial animation system that in some example embodiments includes a full scale state of the art Large Vocabulary Continuous Speech Recognition (LVCSR) with a strong language model for speech recognition and obtained phoneme alignment from the word lattice.
-
公开(公告)号:US20200242826A1
公开(公告)日:2020-07-30
申请号:US16849397
申请日:2020-04-15
Applicant: Snap Inc.
Abstract: Embodiments described herein relate to an augmented expression system to generate and cause display of a specially configured interface to present an augmented reality perspective. The augmented expression system receives image and video data of a user and tracks facial landmarks of the user based on the image and video data, in real-time to generate and present a 3-dimensional (3D) bitmoji of the user.
-
公开(公告)号:US12182921B2
公开(公告)日:2024-12-31
申请号:US17724235
申请日:2022-04-19
Applicant: Snap Inc.
Inventor: Harrison Jesse Smith , Chen Cao , Yingying Wang
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for transforming a motion style of an avatar from a first style to a second style. The program and method include: retrieving, by a processor from a storage device, an avatar depicting motion in a first style; receiving user input selecting a second style; obtaining, based on the user input, a trained machine learning model that performs a non-linear transformation of motion from the first style to the second style; and applying the obtained trained machine learning model to the retrieved avatar to transform the avatar from depicting motion in the first style to depicting motion in the second style.
-
公开(公告)号:US12182919B2
公开(公告)日:2024-12-31
申请号:US18064140
申请日:2022-12-09
Applicant: Snap Inc.
Abstract: The present invention relates to a joint automatic audio visual driven facial animation system that in some example embodiments includes a full scale state of the art Large Vocabulary Continuous Speech Recognition (LVCSR) with a strong language model for speech recognition and obtained phoneme alignment from the word lattice.
-
公开(公告)号:US20230394681A1
公开(公告)日:2023-12-07
申请号:US18235563
申请日:2023-08-18
Applicant: Snap Inc.
Inventor: Chen Cao , Menglei Chai , Linjie Luo , Oliver Woodford
IPC: G06T7/246 , G06T13/40 , G06T7/73 , G06V40/16 , G06V10/774
CPC classification number: G06T7/251 , G06T13/40 , G06T7/73 , G06V40/161 , G06V10/774 , G06V40/165 , G06V40/176 , G06V10/62
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex that is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.
-
公开(公告)号:US11769259B2
公开(公告)日:2023-09-26
申请号:US17248908
申请日:2021-02-12
Applicant: Snap Inc.
Inventor: Chen Cao , Menglei Chai , Linjie Luo , Oliver Woodford
CPC classification number: G06T7/251 , G06T7/73 , G06T13/40 , G06V10/774 , G06V40/161 , G06V40/165 , G06V40/176 , G06V10/62
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex that is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.
-
-
-
-
-
-
-
-
-