-
公开(公告)号:US20230394681A1
公开(公告)日:2023-12-07
申请号:US18235563
申请日:2023-08-18
Applicant: Snap Inc.
Inventor: Chen Cao , Menglei Chai , Linjie Luo , Oliver Woodford
IPC: G06T7/246 , G06T13/40 , G06T7/73 , G06V40/16 , G06V10/774
CPC classification number: G06T7/251 , G06T13/40 , G06T7/73 , G06V40/161 , G06V10/774 , G06V40/165 , G06V40/176 , G06V10/62
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex that is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.
-
公开(公告)号:US11798213B2
公开(公告)日:2023-10-24
申请号:US17364218
申请日:2021-06-30
Applicant: Snap Inc.
Inventor: Menglei Chai , Jian Ren , Aliaksandr Siarohin , Sergey Tulyakov , Oliver Woodford
CPC classification number: G06T13/00 , G06N3/045 , G06N3/08 , G06T7/20 , G06T11/001 , G06T2207/20081 , G06T2207/20084
Abstract: Systems and methods herein describe novel motion representations for animating articulated objects consisting of distinct parts. The described systems and method access source image data, identify driving image data to modify image feature data in the source image sequence data, generate, using an image transformation neural network, modified source image data comprising a plurality of modified source images depicting modified versions of the image feature data, the image transformation neural network being trained to identify, for each image in the source image data, a driving image from the driving image data, the identified driving image being implemented by the image transformation neural network to modify a corresponding source image in the source image data using motion estimation differences between the identified driving image and the corresponding source image, and stores the modified source image data.
-
公开(公告)号:US11769259B2
公开(公告)日:2023-09-26
申请号:US17248908
申请日:2021-02-12
Applicant: Snap Inc.
Inventor: Chen Cao , Menglei Chai , Linjie Luo , Oliver Woodford
CPC classification number: G06T7/251 , G06T7/73 , G06T13/40 , G06V10/774 , G06V40/161 , G06V40/165 , G06V40/176 , G06V10/62
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex that is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.
-
公开(公告)号:US10949648B1
公开(公告)日:2021-03-16
申请号:US16170997
申请日:2018-10-25
Applicant: Snap Inc.
Inventor: Chen Cao , Menglei Chai , Linjie Luo , Oliver Woodford
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex which is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.
-
公开(公告)号:US12299905B2
公开(公告)日:2025-05-13
申请号:US18235563
申请日:2023-08-18
Applicant: Snap Inc.
Inventor: Chen Cao , Menglei Chai , Linjie Luo , Oliver Woodford
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex that is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.
-
公开(公告)号:US20230316553A1
公开(公告)日:2023-10-05
申请号:US18205940
申请日:2023-06-05
Applicant: Snap Inc.
Inventor: Oliver Woodford
CPC classification number: G06T7/55 , G06T5/006 , G06T5/50 , G06T2200/08 , G06T2207/10028
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: accessing a source image depicting a target structure; accessing one or more target images depicting at least a portion of the target structure; computing correspondence between a first set of pixels in the source image of a first portion of the target structure and a second set of pixels in the one or more target images of the first portion of the target structure, the correspondence being computed as a function of camera parameters that vary between the source image and the one or more target images; and generating a three-dimensional (3D) model of the target structure based on the correspondence between the first set of pixels in the source image and the second set of pixels in the one or more target images based on a joint optimization of target structure and camera parameters.
-
公开(公告)号:US20230245399A1
公开(公告)日:2023-08-03
申请号:US18131824
申请日:2023-04-06
Applicant: Snap Inc.
Inventor: Oliver Woodford
CPC classification number: G06T19/006 , G06T7/73 , G06T2200/04 , G06T2207/20084 , G06T2200/08
Abstract: A correlation system can be implemented on a user device (e.g., smartphone) to perform image processing tasks e.g., point to point correlations for tasks such as alignment, tracking, and reconstruction of model data. The correlation system can implement normalized cross correlation in a least squares optimization scheme without use of approximations. Normalized cross correlation optimized via least squares can further implement global and local cost functions that are invariant to dynamic lighting conditions.
-
公开(公告)号:US20220084293A1
公开(公告)日:2022-03-17
申请号:US17456487
申请日:2021-11-24
Applicant: Snap inc.
Inventor: Oliver Woodford
Abstract: A correlation system can be implemented on a user device (e.g., smartphone) to perform image processing tasks e.g., point to point correlations for tasks such as alignment, tracking, and reconstruction of model data. The correlation system can implement normalized cross correlation in a least squares optimization scheme without use of approximations. Normalized cross correlation optimized via least squares can further implement global and local cost functions that are invariant to dynamic lighting conditions.
-
公开(公告)号:US11710248B2
公开(公告)日:2023-07-25
申请号:US17813887
申请日:2022-07-20
Applicant: Snap Inc.
Inventor: Oliver Woodford
CPC classification number: G06T7/55 , G06T5/006 , G06T5/50 , G06T2200/08 , G06T2207/10028
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: accessing a source image depicting a target structure; accessing one or more target images depicting at least a portion of the target structure; computing correspondence between a first set of pixels in the source image of a first portion of the target structure and a second set of pixels in the one or more target images of the first portion of the target structure, the correspondence being computed as a function of camera parameters that vary between the source image and the one or more target images; and generating a three-dimensional (3D) model of the target structure based on the correspondence between the first set of pixels in the source image and the second set of pixels in the one or more target images based on a joint optimization of target structure and camera parameters.
-
公开(公告)号:US20210407163A1
公开(公告)日:2021-12-30
申请号:US17364218
申请日:2021-06-30
Applicant: Snap Inc.
Inventor: Menglei Chai , Jian Ren , Aliaksandr Siarohin , Sergey Tulyakov , Oliver Woodford
Abstract: Systems and methods herein describe novel motion representations for animating articulated objects consisting of distinct parts. The described systems and method access source image data, identify driving image data to modify image feature data in the source image sequence data, generate, using an image transformation neural network, modified source image data comprising a plurality of modified source images depicting modified versions of the image feature data, the image transformation neural network being trained to identify, for each image in the source image data, a driving image from the driving image data, the identified driving image being implemented by the image transformation neural network to modify a corresponding source image in the source image data using motion estimation differences between the identified driving image and the corresponding source image, and stores the modified source image data.
-
-
-
-
-
-
-
-
-