-
公开(公告)号:US11688136B2
公开(公告)日:2023-06-27
申请号:US17249441
申请日:2021-03-02
Applicant: Snap Inc.
Inventor: Georgios Papandreou , Iason Kokkinos
CPC classification number: G06T17/20 , G06N20/00 , G06T2210/32 , G06T2210/56 , G06T2219/2016
Abstract: Systems and methods for reconstructing 3D models of human bodies from 2D images that counts for perspective and/or distortion effects are provided. The systems and methods include reconstructing a three-dimensional model of an object in a three-dimensional scene from a two-dimensional image comprising an image of the object. The systems and methods include determining an absolute depth of a key point of the object in the image; determining, using the absolute depth of the key point, a three-dimensional position of the key point in the three-dimensional scene; generating, using a neural network, a three-dimensional representation of the object, the three-dimensional representation comprising mesh nodes defined in a coordinate system relative to the key point; and positioning the three-dimensional representation of the object in the scene based on the position of the key point by applying a position dependent rotation to the three-dimensional object.
-
公开(公告)号:US20250037333A1
公开(公告)日:2025-01-30
申请号:US18369935
申请日:2023-09-19
Applicant: Snap Inc.
Inventor: Mohammad Rami Koujan , Iason Kokkinos
Abstract: An artificial intelligence (AI) network or neural network is trained, using a relatively small number of reference images of a target garment, to enable virtual clothing try-ons of the target garment. Example methods include determining a pose for a person depicted in an input image, determining an area of the input image to replace with a target garment, changing values of pixels within the area, and inputting the pose, the area, and a text prompt describing the target garment, into a neural network, to generate an output image, wherein the neural network is trained to generate the target garment. Example methods include training the neural network with images of clothing in a same class or category as the target garment to teach the neural network to shape the target garment in accordance with a pose of the person and to preserve other clothing and the background.
-
公开(公告)号:US12198287B2
公开(公告)日:2025-01-14
申请号:US18376607
申请日:2023-10-04
Applicant: Snap Inc.
Inventor: Daniel Monteiro Stoddart , Efstratios Skordos , Iason Kokkinos
IPC: G06T19/00 , G06T7/50 , G06T7/70 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including: receiving an image that includes a depiction of a first real-world body part in a real-world environment; applying a machine learning technique to the image to generate a plurality of dense outputs each associated with a respective pixel of a plurality of pixels in the image; applying a first task-specific decoder to the plurality of dense outputs to identify a pixel corresponding to a center of the first real-world body part; applying a second task-specific decoder using the identified pixel to retrieve a 3D rotation, translation and scale of first real-world body part from the plurality of dense outputs; modifying an AR object based on the 3D rotation, translation, and scale of first real-world body part; and modifying the image to include a depiction of the modified AR object.
-
公开(公告)号:US20240161242A1
公开(公告)日:2024-05-16
申请号:US18068383
申请日:2022-12-19
Applicant: Snap Inc.
Inventor: Avihay Assouline , Nir Malbin , Iason Kokkinos , Riza Alp Guler , Himmy Tam , Mohammad Rami Koujan
CPC classification number: G06T5/50 , G06T7/70 , G06V10/761 , G06V10/82 , G06T2207/20221 , G06T2207/30196
Abstract: Methods and systems are disclosed for transferring garments from one real-world object to another in real time using body landmarks. The system receives a first image that includes a depiction of a first person wearing a fashion item in a first pose. The system obtains a second image that includes a depiction of a second person in a second pose and generates a first set of body landmarks corresponding the first person in the first pose and a second set of body landmarks corresponding the second person wearing in the first pose. The system computes a deviation between the first set of body landmarks and the second set of body landmarks. The system generates a new image that depicts the second person wearing the fashion item worn by the first person based on the deviation between the first set of body landmarks and the second set of body landmarks.
-
公开(公告)号:US20240127563A1
公开(公告)日:2024-04-18
申请号:US17967230
申请日:2022-10-17
Applicant: Snap Inc.
Inventor: Mohammad Rami Koujan , Iason Kokkinos
CPC classification number: G06T19/20 , G06T7/11 , G06T17/20 , G06T2200/24 , G06T2207/10016 , G06T2207/20021 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196 , G06T2219/024 , G06T2219/2024
Abstract: Methods and systems are disclosed for performing real-time stylizing operations. The system receives an image that includes a depiction of a whole body of a real-world person. The system applies a machine learning model to the image to generate a stylized version of the whole body of the real-world person corresponding to a given style, the machine learning model being trained using training data to establish a relationship between a plurality of training images depicting synthetically rendered whole bodies of persons and corresponding ground-truth stylized versions of the whole bodies of the persons of the given style. The system replaces the depiction of the whole body of the real-world person in the image with the generated stylized version of the whole body of the real-world person.
-
公开(公告)号:US20240029280A1
公开(公告)日:2024-01-25
申请号:US18477146
申请日:2023-09-28
Applicant: Snap Inc.
Inventor: Riza Alp Guler , Iason Kokkinos
IPC: G06T7/50 , G06T7/73 , G06N3/02 , G06T17/00 , G06T19/20 , G06V20/64 , G06V10/764 , G06V10/82 , G06V10/44 , G06V10/22 , G06V40/10
CPC classification number: G06T7/50 , G06T7/75 , G06N3/02 , G06T17/005 , G06T19/20 , G06V20/64 , G06V10/764 , G06V10/82 , G06V10/454 , G06V10/225 , G06V40/103 , G06T2207/20084 , G06T2207/20221 , G06T2207/30196 , G06T2219/2004
Abstract: This disclosure relates to reconstructing three-dimensional models of objects from two-dimensional images. According to a first aspect, this specification describes a computer implemented method for creating a three-dimensional reconstruction from a two-dimensional image, the method comprising: receiving a two-dimensional image; identifying an object in the image to be reconstructed and identifying a type of said object; spatially anchoring a pre-determined set of object landmarks within the image; extracting a two-dimensional image representation from each object landmark; estimating a respective three-dimensional representation for the respective two-dimensional image representations; and combining the respective three-dimensional representations resulting in a fused three-dimensional representation of the object.
-
公开(公告)号:US20230230332A1
公开(公告)日:2023-07-20
申请号:US17690504
申请日:2022-03-09
Applicant: Snap Inc.
Inventor: Daniel Monteiro Stoddart , Efstratios Skordos , Iason Kokkinos
IPC: G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06T7/70 , G06T7/50 , G06T19/00
CPC classification number: G06T19/20 , G06V10/764 , G06V10/7747 , G06V10/776 , G06T7/70 , G06T7/50 , G06T19/006 , G06T2219/2016 , G06T2207/20228 , G06T2207/20081 , G06T2207/30196 , G06T2207/20084
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including: receiving an image that includes a depiction of a first real-world body part in a real-world environment; applying a machine learning technique to the image to generate a plurality of dense outputs each associated with a respective pixel of a plurality of pixels in the image; applying a first task-specific decoder to the plurality of dense outputs to identify a pixel corresponding to a center of the first real-world body part; applying a second task-specific decoder using the identified pixel to retrieve a 3D rotation, translation and scale of first real-world body part from the plurality of dense outputs; modifying an AR object based on the 3D rotation, translation, and scale of first real-world body part; and modifying the image to include a depiction of the modified AR object.
-
-
-
-
-
-