-
公开(公告)号：US20240303926A1
公开(公告)日：2024-09-12
申请号：US18179717
申请日：2023-03-07
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Dominik Kulon , Himmy Tam , Haoyang Wang
CPC classification number: G06T17/20 , G06T7/40 , G06T11/00 , G06T2200/24 , G06T2207/10028 , G06T2207/20081 , G06T2207/30196 , G06T2210/22 , G06T2210/56
Abstract: An system for augmenting images using hand surface normal estimation is provided. In a model training phase, 3D models of hands are generated using 3D data of hands in a variety of positions. Target normal training data is generated that includes normals of surfaces of the 3D models and synthetic 2D image training data corresponding to the 3D models and the normals. The target normal training data and the synthetic image training data are used to train a normal estimation model. The normal estimation is used by an interactive application to generate augmentations that are applied to hand image data.
-
公开(公告)号：US20240013463A1
公开(公告)日：2024-01-11
申请号：US17888786
申请日：2022-08-16
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Riza Alp Guler , Antonios Kakolyris , Frank Lu , Haoyang Wang , Matan Zohar
CPC classification number: G06T13/40 , G06T19/006 , H04L51/10
Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system accesses, by a messaging application, an image depicting a person. The system generates, by the messaging application, a three-dimensional (3D) avatar based on the person depicted in the image. The system receives input that selects a pose for the 3D avatar and one or more fashion items to be worn by the 3D avatar and places, by the messaging application, the 3D avatar in the selected pose and wearing the one or more fashion items in an augmented reality (AR) experience.
-
公开(公告)号：US20240303843A1
公开(公告)日：2024-09-12
申请号：US18179784
申请日：2023-03-07
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Dominik Kulon , Himmy Tam , Haoyang Wang
CPC classification number: G06T7/55 , G06V10/25 , G06T2207/10028 , G06T2207/20081 , G06T2207/20132
Abstract: A system for generating extended reality effects using image data of hands and a depth estimation model. The depth estimation model is trained using pairings of synthetic 2D image data with sets of depths and segmentation masks. An extended reality system captures image data of hands in a real-world scene and uses the image data and the depth estimation model to generate the extended reality effects. The extended reality effects are provided to a user during an extended reality experience.
-
公开(公告)号：US20240087266A1
公开(公告)日：2024-03-14
申请号：US17973295
申请日：2022-10-25
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Himmy Tam , Haoyang Wang , Antonios Kakolyris
CPC classification number: G06T19/20 , G06T3/0093 , G06T7/10 , G06T19/006 , G06T2200/04 , G06T2207/10016 , G06T2207/20021 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196 , G06T2210/22 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing real-time deforming operations. The system receives an image that includes a depiction of a real-world object. The system applies a machine learning model to the image to generate a warping field and segmentation mask, the machine learning model trained to establish a relationship between a plurality of training images depicting real-world objects and corresponding ground-truth warping fields and segmentation masks associated with a target shape. The system applies the generated warping field and segmentation mask to the image to warp the real-world object depicted in the image to the target shape.
-
Patent Agency Ranking
公开(公告)号：US20240346762A1
公开(公告)日：2024-10-17
申请号：US18134347
申请日：2023-04-13
Applicant: Snap Inc.
Inventor： Gal Dudovitch , Riza Alp Guler , Frank Lu , Haoyang Wang
CPC classification number: G06T17/20 , G06T7/70 , G06T13/20 , G06T19/006 , G06T2210/16
Abstract: Methods and systems are disclosed for generating an animatable garment from a single image. The system accesses a monocular image depicting a person wearing a fashion item and generates a three-dimensional (3D) mesh representing the person in a canonical space. The system determines a pose of the person depicted in the monocular image and modifies a pose of the 3D mesh to match the determined pose of the person. The system extracts a portion of the 3D mesh corresponding to the fashion item and generates an extended reality (XR) item using the extracted portion of the 3D mesh.
-
公开(公告)号：US11915365B2
公开(公告)日：2024-02-27
申请号：US16949781
申请日：2020-11-13
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Haoyang Wang , Iason Kokkinos , Stefanos Zafeiriou
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: receiving a plurality of bone scale coefficients each corresponding to respective bones of a skeleton model; receiving a plurality of joint angle coefficients that collectively define a pose for the skeleton model; generating the skeleton model based on the received bone scale coefficients and the received joint angle coefficients; generating a base surface based on the plurality of bone scale coefficients; generating an identity surface by deformation of the base surface; and generating the 3D body model by mapping the identity surface onto the posed skeleton model.
-
公开(公告)号：US20240153214A1
公开(公告)日：2024-05-09
申请号：US18413423
申请日：2024-01-16
Applicant: Snap Inc.
Inventor： Yanli Zhao , Matan Zohar , Brian Fulkerson , Georgios Papandreou , Haoyang Wang
IPC: G06T17/20 , G06T19/00 , G06T19/20 , H04L51/046 , H04L51/10
CPC classification number: G06T17/205 , G06T19/006 , G06T19/20 , H04L51/046 , H04L51/10 , G06T2219/2016
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality element; automatically establishing a correspondence between the 3D body mesh associated with the real-world object and the external mesh; deforming the external mesh based on movement of the real-world object and the established correspondence with the 3D body mesh; and modifying the video to include a display of the augmented reality element based on the deformed external mesh.
-
公开(公告)号：US11908083B2
公开(公告)日：2024-02-20
申请号：US17446533
申请日：2021-08-31
Applicant: Snap Inc.
Inventor： Yanli Zhao , Matan Zohar , Brian Fulkerson , Georgios Papandreou , Haoyang Wang
IPC: G06T17/20 , G06T19/00 , G06T19/20 , H04L51/046 , H04L51/10
CPC classification number: G06T17/205 , G06T19/006 , G06T19/20 , H04L51/046 , H04L51/10 , G06T2219/2016
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality element; automatically establishing a correspondence between the 3D body mesh associated with the real-world object and the external mesh; deforming the external mesh based on movement of the real-world object and the established correspondence with the 3D body mesh; and modifying the video to include a display of the augmented reality element based on the deformed external mesh.
-
公开(公告)号：US20230061875A1
公开(公告)日：2023-03-02
申请号：US17446533
申请日：2021-08-31
Applicant: Snap Inc.
Inventor： Yanli Zhao , Matan Zohar , Brian Fulkerson , Georgios Papandreou , Haoyang Wang
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality element; automatically establishing a correspondence between the 3D body mesh associated with the real-world object and the external mesh; deforming the external mesh based on movement of the real-world object and the established correspondence with the 3D body mesh; and modifying the video to include a display of the augmented reality element based on the deformed external mesh.
-
-
-
-
-
-
-
-
Search Results
9
records
(took 0.016 seconds)
