-
公开(公告)号：US20240290043A1
公开(公告)日：2024-08-29
申请号：US18135599
申请日：2023-04-17
Applicant: Snap Inc.
Inventor： Kai Zhou , Laura Rosalia Luidolt , Himmy Tam , Riza Alp Guler , Iason Kokkinos , Avihay Assouline
CPC classification number: G06T19/006 , G06T13/40 , G06T2210/16
Abstract: Methods and systems are disclosed for transferring garments from a real-world object to a virtual object. The system receives, by a client device, an image that includes a depiction of a real-world object having a fashion item in a real-world environment. The system accesses a three-dimensional (3D) avatar model of a human and generates a graphic item corresponding to the fashion item being worn by the real-world object depicted in the image. The system modifies the 3D avatar model of the human based on the graphic item and presents the 3D avatar model that has been modified based on the graphic item within a view of the real-world environment on the client device.
-
公开(公告)号：US20240029382A1
公开(公告)日：2024-01-25
申请号：US18376607
申请日：2023-10-04
Applicant: Snap Inc.
Inventor： Daniel Monteiro Stoddart , Efstratios Skordos , Iason Kokkinos
IPC: G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06T7/70 , G06T19/00 , G06T7/50
CPC classification number: G06T19/20 , G06V10/764 , G06V10/7747 , G06V10/776 , G06T7/70 , G06T19/006 , G06T7/50 , G06T2207/20084 , G06T2219/2016 , G06T2207/20228 , G06T2207/20081 , G06T2207/30196
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including: receiving an image that includes a depiction of a first real-world body part in a real-world environment; applying a machine learning technique to the image to generate a plurality of dense outputs each associated with a respective pixel of a plurality of pixels in the image; applying a first task-specific decoder to the plurality of dense outputs to identify a pixel corresponding to a center of the first real-world body part; applying a second task-specific decoder using the identified pixel to retrieve a 3D rotation, translation and scale of first real-world body part from the plurality of dense outputs; modifying an AR object based on the 3D rotation, translation, and scale of first real-world body part; and modifying the image to include a depiction of the modified AR object.
-
公开(公告)号：US12169975B2
公开(公告)日：2024-12-17
申请号：US17596697
申请日：2020-06-17
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Georgios Papandreou , Iason Kokkinos
Abstract: This specification relates to reconstructing three-dimensional (3D) scenes from two-dimensional (2D) images using a neural network. According to a first aspect of this specification, there is described a method for creating a three-dimensional reconstruction of a scene with multiple objects from a single two-dimensional image, the method comprising: receiving a single two-dimensional image; identifying all objects in the image to be reconstructed and identifying the type of said objects; estimating a three-dimensional representation of each identified object; estimating a three-dimensional plane physically supporting all three-dimensional objects; and positioning all three-dimensional objects in space relative to the supporting plane.
-
公开(公告)号：US20220375247A1
公开(公告)日：2022-11-24
申请号：US17812864
申请日：2022-07-15
Applicant: Snap inc.
Inventor： Iason Kokkinos , Georgios Papandreou , Riza Alp Guler
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: receiving a two-dimensional continuous surface representation of a three-dimensional object, the continuous surface comprising a plurality of landmark locations; determining a first set of soft membership functions based on a relative location of points in the two-dimensional continuous surface representation and the landmark locations; receiving a two-dimensional input image, the input image comprising an image of the object; extracting a plurality of features from the input image using a feature recognition model; generating an encoded. feature representation of the extracted features using the first set of soft membership functions; generating a dense feature representation of the extracted features from the encoded representation using a second set of soft membership functions; and processing the second set of soft membership functions and dense feature representation using a neural image decoder model to generate an output image.
-
公开(公告)号：US11915365B2
公开(公告)日：2024-02-27
申请号：US16949781
申请日：2020-11-13
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Haoyang Wang , Iason Kokkinos , Stefanos Zafeiriou
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: receiving a plurality of bone scale coefficients each corresponding to respective bones of a skeleton model; receiving a plurality of joint angle coefficients that collectively define a pose for the skeleton model; generating the skeleton model based on the received bone scale coefficients and the received joint angle coefficients; generating a base surface based on the plurality of bone scale coefficients; generating an identity surface by deformation of the base surface; and generating the 3D body model by mapping the identity surface onto the posed skeleton model.
-
Patent Agency Ranking
公开(公告)号：US11823346B2
公开(公告)日：2023-11-21
申请号：US17690504
申请日：2022-03-09
Applicant: Snap Inc.
Inventor： Daniel Monteiro Stoddart , Efstratios Skordos , Iason Kokkinos
IPC: G06F9/30 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06T7/70 , G06T19/00 , G06T7/50
CPC classification number: G06T19/20 , G06T7/50 , G06T7/70 , G06T19/006 , G06V10/764 , G06V10/776 , G06V10/7747 , G06T2207/20081 , G06T2207/20084 , G06T2207/20228 , G06T2207/30196 , G06T2219/2016
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including: receiving an image that includes a depiction of a first real-world body part in a real-world environment; applying a machine learning technique to the image to generate a plurality of dense outputs each associated with a respective pixel of a plurality of pixels in the image; applying a first task-specific decoder to the plurality of dense outputs to identify a pixel corresponding to a center of the first real-world body part; applying a second task-specific decoder using the identified pixel to retrieve a 3D rotation, translation and scale of first real-world body part from the plurality of dense outputs; modifying an AR object based on the 3D rotation, translation, and scale of first real-world body part; and modifying the image to include a depiction of the modified AR object.
-
公开(公告)号：US20230267687A1
公开(公告)日：2023-08-24
申请号：US18142190
申请日：2023-05-02
Applicant: Snap Inc.
Inventor： Georgios Papandreou , Iason Kokkinos
CPC classification number: G06T17/20 , G06N20/00 , G06T2210/56 , G06T2210/32 , G06T2219/2016
Abstract: Systems and methods for reconstructing 3D models of human bodies from 2D images that counts for perspective and/or distortion effects are provided. The systems and methods include reconstructing a three-dimensional model of an object in a three-dimensional scene from a two-dimensional image comprising an image of the object. The systems and methods include determining an absolute depth of a key point of the object in the image; determining, using the absolute depth of the key point, a three-dimensional position of the key point in the three-dimensional scene; generating, using a neural network, a three-dimensional representation of the object, the three-dimensional representation comprising mesh nodes defined in a coordinate system relative to the key point; and positioning the three-dimensional representation of the object in the scene based on the position of the key point by applying a position dependent rotation to the three-dimensional object.
-
公开(公告)号：US11430247B2
公开(公告)日：2022-08-30
申请号：US16949773
申请日：2020-11-13
Applicant: Snap Inc.
Inventor： Iason Kokkinos , Georgios Papandreou , Riza Alp Guler
Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: receiving a two-dimensional continuous surface representation of a three-dimensional object, the continuous surface comprising a plurality of landmark locations; determining a first set of soft membership functions based on a relative location of points in the two-dimensional continuous surface representation and the landmark locations; receiving a two-dimensional input image, the input image comprising an image of the object; extracting a plurality of features from the input image using a feature recognition model; generating an encoded feature representation of the extracted features using the first set of soft membership functions; generating a dense feature representation of the extracted features from the encoded representation using a second set of soft membership functions; and processing the second set of soft membership functions and dense feature representation using a neural image decoder model to generate an output image.
-
公开(公告)号：US20250061730A1
公开(公告)日：2025-02-20
申请号：US18936477
申请日：2024-11-04
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Georgios Papandreou , Iason Kokkinos
Abstract: This specification relates to reconstructing three-dimensional (3D) scenes from two-dimensional (2D) images using a neural network. According to a first aspect of this specification, there is described a method for creating a three-dimensional reconstruction of a scene with multiple objects from a single two-dimensional image, the method comprising: receiving a single two-dimensional image; identifying all objects in the image to be reconstructed and identifying the type of said objects; estimating a three-dimensional representation of each identified object; estimating a three-dimensional plane physically supporting all three-dimensional objects; and positioning all three-dimensional objects in space relative to the supporting plane.
-
公开(公告)号：US11816850B2
公开(公告)日：2023-11-14
申请号：US17301926
申请日：2021-04-19
Applicant: Snap Inc.
Inventor： Riza Alp Guler , Iason Kokkinos
IPC: G06T7/73 , G06T17/00 , G06T19/20 , G06T7/50 , G06N3/02 , G06V20/64 , G06V10/764 , G06V10/82 , G06V10/44 , G06V10/22 , G06V40/10
CPC classification number: G06T7/50 , G06N3/02 , G06T7/75 , G06T17/005 , G06T19/20 , G06V10/225 , G06V10/454 , G06V10/764 , G06V10/82 , G06V20/64 , G06V40/103 , G06T2207/20084 , G06T2207/20221 , G06T2207/30196 , G06T2219/2004
Abstract: This disclosure relates to reconstructing three-dimensional models of objects from two-dimensional images. According to a first aspect, this specification describes a computer implemented method for creating a three-dimensional reconstruction from a two-dimensional image, the method comprising: receiving a two-dimensional image; identifying an object in the image to be reconstructed and identifying a type of said object; spatially anchoring a pre-determined set of object landmarks within the image; extracting a two-dimensional image representation from each object landmark; estimating a respective three-dimensional representation for the respective two-dimensional image representations; and combining the respective three-dimensional representations resulting in a fused three-dimensional representation of the object.
-
-
-
-
-
-
-
-
-
Search Results
17
records
(took 0.019 seconds)
