-
公开(公告)号：US12254577B2
公开(公告)日：2025-03-18
申请号：US17842006
申请日：2022-06-16
Applicant: Snap Inc.
Inventor： Madiyar Aitbayev , Brian Fulkerson , Riza Alp Guler , Georgios Papandreou , Himmy Tam
Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a person depicted in an image. The operations include receiving an image that includes data representing a depiction of a person; extracting a portion of the image; applying a first machine learning model stage to the portion to predict a depth of a point of interest for the data representing the depiction of the person; applying a second machine learning model stage to the portion of the image to predict a relative depth of each pixel in the portion of the image to the predicted depth of the point of interest; generating dense depth reconstruction of the data representing the depiction of the person based on outputs of the first and second stages of the machine learning model; and applying one or more AR elements to the image based on the dense depth reconstruction.
-
公开(公告)号：US20240290043A1
公开(公告)日：2024-08-29
申请号：US18135599
申请日：2023-04-17
Applicant: Snap Inc.
Inventor： Kai Zhou , Laura Rosalia Luidolt , Himmy Tam , Riza Alp Guler , Iason Kokkinos , Avihay Assouline
CPC classification number: G06T19/006 , G06T13/40 , G06T2210/16
Abstract: Methods and systems are disclosed for transferring garments from a real-world object to a virtual object. The system receives, by a client device, an image that includes a depiction of a real-world object having a fashion item in a real-world environment. The system accesses a three-dimensional (3D) avatar model of a human and generates a graphic item corresponding to the fashion item being worn by the real-world object depicted in the image. The system modifies the 3D avatar model of the human based on the graphic item and presents the 3D avatar model that has been modified based on the graphic item within a view of the real-world environment on the client device.
-
公开(公告)号：US12148105B2
公开(公告)日：2024-11-19
申请号：US17841994
申请日：2022-06-16
Applicant: Snap Inc.
Inventor： Madiyar Aitbayev , Brian Fulkerson , Riza Alp Guler , Georgios Papandreou , Himmy Tam
Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a person depicted in an image. The operations include receiving an image that includes data representing a depiction of a person; generating a segmentation of the data representing the person depicted in the image; extracting a portion of the image corresponding to the segmentation of the data representing the person depicted in the image; applying a machine learning model to the portion of the image to predict a surface normal tensor for the data representing the depiction of the person, the surface normal tensor representing surface normals of each pixel within the portion of the image; and applying one or more augmented reality (AR) elements to the image based on the surface normal tensor.
-
公开(公告)号：US20240346762A1
公开(公告)日：2024-10-17
申请号：US18134347
申请日：2023-04-13
Applicant: Snap Inc.
Inventor： Gal Dudovitch , Riza Alp Guler , Frank Lu , Haoyang Wang
CPC classification number: G06T17/20 , G06T7/70 , G06T13/20 , G06T19/006 , G06T2210/16
Abstract: Methods and systems are disclosed for generating an animatable garment from a single image. The system accesses a monocular image depicting a person wearing a fashion item and generates a three-dimensional (3D) mesh representing the person in a canonical space. The system determines a pose of the person depicted in the monocular image and modifies a pose of the 3D mesh to match the determined pose of the person. The system extracts a portion of the 3D mesh corresponding to the fashion item and generates an extended reality (XR) item using the extracted portion of the 3D mesh.
-
公开(公告)号：US11915365B2
公开(公告)日：2024-02-27
申请号：US16949781
申请日：2020-11-13
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Haoyang Wang , Iason Kokkinos , Stefanos Zafeiriou
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: receiving a plurality of bone scale coefficients each corresponding to respective bones of a skeleton model; receiving a plurality of joint angle coefficients that collectively define a pose for the skeleton model; generating the skeleton model based on the received bone scale coefficients and the received joint angle coefficients; generating a base surface based on the plurality of bone scale coefficients; generating an identity surface by deformation of the base surface; and generating the 3D body model by mapping the identity surface onto the posed skeleton model.
-
Patent Agency Ranking
公开(公告)号：US11430247B2
公开(公告)日：2022-08-30
申请号：US16949773
申请日：2020-11-13
Applicant: Snap Inc.
Inventor： Iason Kokkinos , Georgios Papandreou , Riza Alp Guler
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: receiving a two-dimensional continuous surface representation of a three-dimensional object, the continuous surface comprising a plurality of landmark locations; determining a first set of soft membership functions based on a relative location of points in the two-dimensional continuous surface representation and the landmark locations; receiving a two-dimensional input image, the input image comprising an image of the object; extracting a plurality of features from the input image using a feature recognition model; generating an encoded feature representation of the extracted features using the first set of soft membership functions; generating a dense feature representation of the extracted features from the encoded representation using a second set of soft membership functions; and processing the second set of soft membership functions and dense feature representation using a neural image decoder model to generate an output image.
-
公开(公告)号：US20240404220A1
公开(公告)日：2024-12-05
申请号：US18798370
申请日：2024-08-08
Applicant: Snap Inc.
Inventor： Madiyar Aitbayev , Brian Fulkerson , Riza Alp Guler , Georgios Papandreou , Himmy Tam
Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a person depicted in an image. The operations include receiving an image that includes data representing a depiction of a person; generating a segmentation of the data representing the person depicted in the image; extracting a portion of the image corresponding to the segmentation of the data representing the person depicted in the image; applying a machine learning model to the portion of the image to predict a surface normal tensor for the data representing the depiction of the person, the surface normal tensor representing surface normals of each pixel within the portion of the image; and applying one or more augmented reality (AR) elements to the image based on the surface normal tensor.
-
公开(公告)号：US20240161242A1
公开(公告)日：2024-05-16
申请号：US18068383
申请日：2022-12-19
Applicant: Snap Inc.
Inventor： Avihay Assouline , Nir Malbin , Iason Kokkinos , Riza Alp Guler , Himmy Tam , Mohammad Rami Koujan
CPC classification number: G06T5/50 , G06T7/70 , G06V10/761 , G06V10/82 , G06T2207/20221 , G06T2207/30196
Abstract: Methods and systems are disclosed for transferring garments from one real-world object to another in real time using body landmarks. The system receives a first image that includes a depiction of a first person wearing a fashion item in a first pose. The system obtains a second image that includes a depiction of a second person in a second pose and generates a first set of body landmarks corresponding the first person in the first pose and a second set of body landmarks corresponding the second person wearing in the first pose. The system computes a deviation between the first set of body landmarks and the second set of body landmarks. The system generates a new image that depicts the second person wearing the fashion item worn by the first person based on the deviation between the first set of body landmarks and the second set of body landmarks.
-
公开(公告)号：US20240046587A1
公开(公告)日：2024-02-08
申请号：US18382898
申请日：2023-10-23
Applicant: Snap Inc.
Inventor： Matan Zohar , Yanli Zhao , Brian Fulkerson , Riza Alp Guler
CPC classification number: G06T19/006 , G06T7/20 , G06T7/60 , G06T11/001 , G06T17/20 , G06T2219/2016 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; determining UV positions of the real-world object depicted in the video to obtain pixel values associated with the UV positions; generating an external mesh and associated augmented reality (AR) element representing the real-world object based on the pixel values associated with the UV positions; deforming the external mesh based on changes to the 3D body mesh and a deformation parameter; and modifying the video to replace the real-world object with the AR element based on the deformed external mesh.
-
公开(公告)号：US20240029280A1
公开(公告)日：2024-01-25
申请号：US18477146
申请日：2023-09-28
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Iason Kokkinos
IPC: G06T7/50 , G06T7/73 , G06N3/02 , G06T17/00 , G06T19/20 , G06V20/64 , G06V10/764 , G06V10/82 , G06V10/44 , G06V10/22 , G06V40/10
CPC classification number: G06T7/50 , G06T7/75 , G06N3/02 , G06T17/005 , G06T19/20 , G06V20/64 , G06V10/764 , G06V10/82 , G06V10/454 , G06V10/225 , G06V40/103 , G06T2207/20084 , G06T2207/20221 , G06T2207/30196 , G06T2219/2004
Abstract: This disclosure relates to reconstructing three-dimensional models of objects from two-dimensional images. According to a first aspect, this specification describes a computer implemented method for creating a three-dimensional reconstruction from a two-dimensional image, the method comprising: receiving a two-dimensional image; identifying an object in the image to be reconstructed and identifying a type of said object; spatially anchoring a pre-determined set of object landmarks within the image; extracting a two-dimensional image representation from each object landmark; estimating a respective three-dimensional representation for the respective two-dimensional image representations; and combining the respective three-dimensional representations resulting in a fused three-dimensional representation of the object.
-
-
-
-
-
-
-
-
-
Search Results
26
records
(took 0.022 seconds)
