-
公开(公告)号:US11610354B2
公开(公告)日:2023-03-21
申请号:US17349015
申请日:2021-06-16
Applicant: Snap Inc.
Abstract: The present invention relates to a joint automatic audio visual driven facial animation system that in some example embodiments includes a full scale state of the art Large Vocabulary Continuous Speech Recognition (LVCSR) with a strong language model for speech recognition and obtained phoneme alignment from the word lattice.
-
公开(公告)号:US20200160580A1
公开(公告)日:2020-05-21
申请号:US16749753
申请日:2020-01-22
Applicant: Snap Inc.
Abstract: The present invention relates to a joint automatic audio visual driven facial animation system that in some example embodiments includes a full scale state of the art Large Vocabulary Continuous Speech Recognition (LVCSR) with a strong language model for speech recognition and obtained phoneme alignment from the word lattice.
-
公开(公告)号:US20250086868A1
公开(公告)日:2025-03-13
申请号:US18955286
申请日:2024-11-21
Applicant: Snap Inc.
Abstract: The present invention relates to a joint automatic audio visual driven facial animation system that in some example embodiments includes a full scale state of the art Large Vocabulary Continuous Speech Recognition (LVCSR) with a strong language model for speech recognition and obtained phoneme alignment from the word lattice.
-
公开(公告)号:US12141922B2
公开(公告)日:2024-11-12
申请号:US18216327
申请日:2023-06-29
Applicant: Snap Inc.
Inventor: Chen Cao , Menglei Chai , Linjie Luo , Soumyadip Sengupta
Abstract: A shape generation system can generate a three-dimensional (3D) model of an object from a two-dimensional (2D) image of the object by projecting vectors onto light cones created from the 2D image. The projected vectors can be used to more accurately create the 3D model of the object based on image element (e.g., pixel) values of the image.
-
公开(公告)号:US11074675B2
公开(公告)日:2021-07-27
申请号:US16051083
申请日:2018-07-31
Applicant: Snap Inc.
Inventor: Chen Cao , Wen Zhang , Menglei Chai , Linjie Luo
Abstract: Systems, devices, media, and methods are presented for generating texture models for objects within a video stream. The systems and methods access a set of images as the set of images are being captured at a computing device. The systems and methods determine, within a portion of the set of images, an area of interest containing an eye and extract an iris area from the area of interest. The systems and methods segment a sclera area within the area of interest and generate a texture for the eye based on the iris area and the sclera area.
-
公开(公告)号:US20190325631A1
公开(公告)日:2019-10-24
申请号:US16387092
申请日:2019-04-17
Applicant: Snap Inc.
Abstract: The present invention relates to improvements to systems and methods for determining a current location of a client device, and for identifying and selecting appropriate geo-fences based on the current location of the client device. An improved geo-fence selection system performs operations that include associating media content with a geo-fence that encompasses a portion of a geographic region, sampling location data from a client device, defining a boundary based on the sampled location data from the client device, detecting an overlap between the boundary and the geo-fence, retrieving the media content associated with the geo-fence, and loading the media content at a memory location of the client device, in response to detecting the overlap.
-
公开(公告)号:US20240104815A1
公开(公告)日:2024-03-28
申请号:US18528098
申请日:2023-12-04
Applicant: Snap Inc.
CPC classification number: G06T13/20 , G06T7/73 , G06T13/40 , G06T19/006 , G06T19/20 , G06V40/174 , G06T2207/30201
Abstract: Embodiments described herein relate to an augmented expression system to generate and cause display of a specially configured interface to present an augmented reality perspective. The augmented expression system receives image and video data of a user and tracks facial landmarks of the user based on the image and video data, in real-time to generate and present a 3-dimensional (3D) bitmoji of the user.
-
公开(公告)号:US11875439B2
公开(公告)日:2024-01-16
申请号:US16849397
申请日:2020-04-15
Applicant: Snap Inc.
IPC: G06T13/20 , G06K9/00 , G06T7/73 , G06T9/00 , G06T19/20 , G06T13/40 , G06T7/246 , G06T19/00 , G06V40/16
CPC classification number: G06T13/20 , G06T7/73 , G06T13/40 , G06T19/006 , G06T19/20 , G06V40/174 , G06T2207/30201
Abstract: Embodiments described herein relate to an augmented expression system to generate and cause display of a specially configured interface to present an augmented reality perspective. The augmented expression system receives image and video data of a user and tracks facial landmarks of the user based on the image and video data, in real-time to generate and present a 3-dimensional (3D) bitmoji of the user.
-
公开(公告)号:US11798261B2
公开(公告)日:2023-10-24
申请号:US17303871
申请日:2021-06-09
Applicant: Snap Inc.
Inventor: Chen Cao , Sergey Tulyakov , Zhenglin Geng
IPC: G06V40/16 , G06V10/82 , G06V10/764
CPC classification number: G06V10/764 , G06V10/82 , G06V40/161 , G06V40/168 , G06V40/172 , G06V40/175
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for synthesizing a realistic image with a new expression of a face in an input image by receiving an input image comprising a face having a first expression; obtaining a target expression for the face; and extracting a texture of the face and a shape of the face. The program and method for generating, based on the extracted texture of the face, a target texture corresponding to the obtained target expression using a first machine learning technique; generating, based on the extracted shape of the face, a target shape corresponding to the obtained target expression using a second machine learning technique; and combining the generated target texture and generated target shape into an output image comprising the face having a second expression corresponding to the obtained target expression.
-
公开(公告)号:US11710275B2
公开(公告)日:2023-07-25
申请号:US17499659
申请日:2021-10-12
Applicant: Snap Inc.
Inventor: Soumyadip Sengupta , Linjie Luo , Chen Cao , Menglei Chai
CPC classification number: G06T17/30 , G06V20/647 , G06V40/165 , G06V40/171
Abstract: A shape generation system can generate a three-dimensional (3D) model of an object from a two-dimensional (2D) image of the object by projecting vectors onto light cones created from the 2D image. The projected vectors can be used to more accurately create the 3D model of the object based on image element (e.g., pixel) values of the image.
-
-
-
-
-
-
-
-
-