-
公开(公告)号：US20240303926A1
公开(公告)日：2024-09-12
申请号：US18179717
申请日：2023-03-07
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Dominik Kulon , Himmy Tam , Haoyang Wang
CPC classification number: G06T17/20 , G06T7/40 , G06T11/00 , G06T2200/24 , G06T2207/10028 , G06T2207/20081 , G06T2207/30196 , G06T2210/22 , G06T2210/56
Abstract: An system for augmenting images using hand surface normal estimation is provided. In a model training phase, 3D models of hands are generated using 3D data of hands in a variety of positions. Target normal training data is generated that includes normals of surfaces of the 3D models and synthetic 2D image training data corresponding to the 3D models and the normals. The target normal training data and the synthetic image training data are used to train a normal estimation model. The normal estimation is used by an interactive application to generate augmentations that are applied to hand image data.
-
公开(公告)号：US12148105B2
公开(公告)日：2024-11-19
申请号：US17841994
申请日：2022-06-16
Applicant: Snap Inc.
Inventor： Madiyar Aitbayev , Brian Fulkerson , Riza Alp Guler , Georgios Papandreou , Himmy Tam
Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a person depicted in an image. The operations include receiving an image that includes data representing a depiction of a person; generating a segmentation of the data representing the person depicted in the image; extracting a portion of the image corresponding to the segmentation of the data representing the person depicted in the image; applying a machine learning model to the portion of the image to predict a surface normal tensor for the data representing the depiction of the person, the surface normal tensor representing surface normals of each pixel within the portion of the image; and applying one or more augmented reality (AR) elements to the image based on the surface normal tensor.
-
公开(公告)号：US12254577B2
公开(公告)日：2025-03-18
申请号：US17842006
申请日：2022-06-16
Applicant: Snap Inc.
Inventor： Madiyar Aitbayev , Brian Fulkerson , Riza Alp Guler , Georgios Papandreou , Himmy Tam
Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a person depicted in an image. The operations include receiving an image that includes data representing a depiction of a person; extracting a portion of the image; applying a first machine learning model stage to the portion to predict a depth of a point of interest for the data representing the depiction of the person; applying a second machine learning model stage to the portion of the image to predict a relative depth of each pixel in the portion of the image to the predicted depth of the point of interest; generating dense depth reconstruction of the data representing the depiction of the person based on outputs of the first and second stages of the machine learning model; and applying one or more AR elements to the image based on the dense depth reconstruction.
-
公开(公告)号：US20240290043A1
公开(公告)日：2024-08-29
申请号：US18135599
申请日：2023-04-17
Applicant: Snap Inc.
Inventor： Kai Zhou , Laura Rosalia Luidolt , Himmy Tam , Riza Alp Guler , Iason Kokkinos , Avihay Assouline
CPC classification number: G06T19/006 , G06T13/40 , G06T2210/16
Abstract: Methods and systems are disclosed for transferring garments from a real-world object to a virtual object. The system receives, by a client device, an image that includes a depiction of a real-world object having a fashion item in a real-world environment. The system accesses a three-dimensional (3D) avatar model of a human and generates a graphic item corresponding to the fashion item being worn by the real-world object depicted in the image. The system modifies the 3D avatar model of the human based on the graphic item and presents the 3D avatar model that has been modified based on the graphic item within a view of the real-world environment on the client device.
-
公开(公告)号：US20240404220A1
公开(公告)日：2024-12-05
申请号：US18798370
申请日：2024-08-08
Applicant: Snap Inc.
Inventor： Madiyar Aitbayev , Brian Fulkerson , Riza Alp Guler , Georgios Papandreou , Himmy Tam
Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a person depicted in an image. The operations include receiving an image that includes data representing a depiction of a person; generating a segmentation of the data representing the person depicted in the image; extracting a portion of the image corresponding to the segmentation of the data representing the person depicted in the image; applying a machine learning model to the portion of the image to predict a surface normal tensor for the data representing the depiction of the person, the surface normal tensor representing surface normals of each pixel within the portion of the image; and applying one or more augmented reality (AR) elements to the image based on the surface normal tensor.
-
Patent Agency Ranking
公开(公告)号：US20240161242A1
公开(公告)日：2024-05-16
申请号：US18068383
申请日：2022-12-19
Applicant: Snap Inc.
Inventor： Avihay Assouline , Nir Malbin , Iason Kokkinos , Riza Alp Guler , Himmy Tam , Mohammad Rami Koujan
CPC classification number: G06T5/50 , G06T7/70 , G06V10/761 , G06V10/82 , G06T2207/20221 , G06T2207/30196
Abstract: Methods and systems are disclosed for transferring garments from one real-world object to another in real time using body landmarks. The system receives a first image that includes a depiction of a first person wearing a fashion item in a first pose. The system obtains a second image that includes a depiction of a second person in a second pose and generates a first set of body landmarks corresponding the first person in the first pose and a second set of body landmarks corresponding the second person wearing in the first pose. The system computes a deviation between the first set of body landmarks and the second set of body landmarks. The system generates a new image that depicts the second person wearing the fashion item worn by the first person based on the deviation between the first set of body landmarks and the second set of body landmarks.
-
公开(公告)号：US12094066B2
公开(公告)日：2024-09-17
申请号：US17841994
申请日：2022-06-16
Applicant: Snap Inc.
Inventor： Madiyar Aitbayev , Brian Fulkerson , Riza Alp Guler , Georgios Papandreou , Himmy Tam
CPC classification number: G06T19/006 , G06T7/11 , G06T7/194 , G06T7/70 , G06T15/506 , G06T15/60 , G06T19/20 , G06T2200/08 , G06T2207/10016 , G06T2207/20021 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196 , G06T2210/16 , G06T2219/2012
Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a person depicted in an image. The operations include receiving an image that includes data representing a depiction of a person; generating a segmentation of the data representing the person depicted in the image; extracting a portion of the image corresponding to the segmentation of the data representing the person depicted in the image; applying a machine learning model to the portion of the image to predict a surface normal tensor for the data representing the depiction of the person, the surface normal tensor representing surface normals of each pixel within the portion of the image; and applying one or more augmented reality (AR) elements to the image based on the surface normal tensor.
-
公开(公告)号：US20240303843A1
公开(公告)日：2024-09-12
申请号：US18179784
申请日：2023-03-07
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Dominik Kulon , Himmy Tam , Haoyang Wang
CPC classification number: G06T7/55 , G06V10/25 , G06T2207/10028 , G06T2207/20081 , G06T2207/20132
Abstract: A system for generating extended reality effects using image data of hands and a depth estimation model. The depth estimation model is trained using pairings of synthetic 2D image data with sets of depths and segmentation masks. An extended reality system captures image data of hands in a real-world scene and uses the image data and the depth estimation model to generate the extended reality effects. The extended reality effects are provided to a user during an extended reality experience.
-
公开(公告)号：US20240087266A1
公开(公告)日：2024-03-14
申请号：US17973295
申请日：2022-10-25
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Himmy Tam , Haoyang Wang , Antonios Kakolyris
CPC classification number: G06T19/20 , G06T3/0093 , G06T7/10 , G06T19/006 , G06T2200/04 , G06T2207/10016 , G06T2207/20021 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196 , G06T2210/22 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing real-time deforming operations. The system receives an image that includes a depiction of a real-world object. The system applies a machine learning model to the image to generate a warping field and segmentation mask, the machine learning model trained to establish a relationship between a plurality of training images depicting real-world objects and corresponding ground-truth warping fields and segmentation masks associated with a target shape. The system applies the generated warping field and segmentation mask to the image to warp the real-world object depicted in the image to the target shape.
-
公开(公告)号：US20230316666A1
公开(公告)日：2023-10-05
申请号：US17842006
申请日：2022-06-16
Applicant: Snap Inc.
Inventor： Madiyar Aitbayev , Brian Fulkerson , Riza Alp Guler , Georgios Papandreou , Himmy Tam
CPC classification number: G06T19/006 , G06V10/70 , G06V10/26 , G06V20/20 , G06N20/20
Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a person depicted in an image. The operations include receiving an image that includes data representing a depiction of a person; extracting a portion of the image; applying a first machine learning model stage to the portion to predict a depth of a point of interest for the data representing the depiction of the person; applying a second machine learning model stage to the portion of the image to predict a relative depth of each pixel in the portion of the image to the predicted depth of the point of interest; generating dense depth reconstruction of the data representing the depiction of the person based on outputs of the first and second stages of the machine learning model; and applying one or more AR elements to the image based on the dense depth reconstruction.
-
-
-
-
-
-
-
-
-
Search Results
11
records
(took 0.02 seconds)
