-
公开(公告)号：US12131448B2
公开(公告)日：2024-10-29
申请号：US17937734
申请日：2022-10-03
Applicant: Snap Inc.
Inventor： Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Gal Sasson , Matan Zohar
CPC classification number: G06T5/77 , G06T5/50 , G06T7/11 , G06T7/20 , G06T11/00 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221 , G06T2207/30196 , G06T2207/30244
Abstract: Aspects of the present disclosure involve a system for performing real-time in-painting using machine learning techniques. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system accesses a segmentation associated with the real-world object and removes a depiction of the real-world object from a region of a first frame of the video. The system processes, by a machine learning model, the first frame and one or more previous frames of the video that precede the first frame to generate a new frame in which portions of the first frame have been blended into the region from which the depiction of the real-world object has been removed.
-
公开(公告)号：US12086946B2
公开(公告)日：2024-09-10
申请号：US18475813
申请日：2023-09-27
Applicant: Snap Inc.
Inventor： Matan Zohar , Yanli Zhao , Brian Fulkerson
CPC classification number: G06T19/006 , G06T7/251 , G06T13/40 , G06T13/80 , G06T17/20 , G06T19/20 , G06T2200/24 , G06T2207/10016 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality (AR) element; automatically establishing a correspondence between a portion of the 3D body mesh associated with the real-world object and the external mesh; blending the portion of the 3D body mesh into the external mesh according to a blending parameter; and as the portion of the 3D body mesh is being blended into the external mesh, modifying the video to depict a portion of the real-world object being changed into the AR element.
-
公开(公告)号：US20240249444A1
公开(公告)日：2024-07-25
申请号：US18159554
申请日：2023-01-25
Applicant: Snap Inc.
Inventor： Matan Zohar , Omri Berg , Itamar Berger , Gal Sasson
IPC: G06T11/00 , G06Q30/0601 , G06T15/20
CPC classification number: G06T11/00 , G06Q30/0643 , G06T15/205 , G06T2210/16
Abstract: Aspects of the present disclosure involve a system for synthetically generating a view of an object to present one or more AR fashion items in an image. The system accesses a first image depicting a first portion of a body of a person from a first camera view. The system detects a fashion item in the first image that is being worn by the person in the first image, the fashion item being depicted in the first image from the first camera view. The system generates an augmented reality (AR) item that visually resembles the fashion item from the second camera view and modifies the second image with the AR item to present a synthetic view of the second portion of the body of the person wearing the AR item corresponding to the fashion item.
-
公开(公告)号：US20240249346A1
公开(公告)日：2024-07-25
申请号：US18159509
申请日：2023-01-25
Applicant: Snap Inc.
Inventor： Matan Zohar , Omri Berg , Gal Sasson , Itamar Berger
IPC: G06Q30/0601 , G06F3/01 , G06T19/00
CPC classification number: G06Q30/0643 , G06F3/017 , G06T19/006
Abstract: Aspects of the present disclosure involve a system for automatically zooming in on objects in an image. The system accesses a video comprising a frame depicting a person and detects a fashion item being worn by the person in the frame of the video. The system, in response to detecting the fashion item being worn by the person, extracts, from the frame, a portion comprising a depiction of the fashion item being worn by the person. The system generates a focus image of the fashion item using the portion extracted from the frame and presents the focus image of the fashion item together with the video comprising the frame depicting the person.
-
公开(公告)号：US11983826B2
公开(公告)日：2024-05-14
申请号：US17490167
申请日：2021-09-30
Applicant: Snap Inc.
Inventor： Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
CPC classification number: G06T19/006 , A63F13/65 , G06Q30/0641 , G06T7/11 , G06T7/20 , G06T7/70 , G06T17/00 , G06T19/20 , A63F2300/69 , G06T2207/10016 , G06T2207/30196 , G06T2219/2004 , G06T2219/2016 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.
-
Patent Agency Ranking
公开(公告)号：US20240112314A1
公开(公告)日：2024-04-04
申请号：US17937734
申请日：2022-10-03
Applicant: Snap Inc.
Inventor： Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi , Gal Sasson , Matan Zohar
CPC classification number: G06T5/005 , G06T5/50 , G06T7/11 , G06T7/20 , G06T11/00 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221 , G06T2207/30196 , G06T2207/30244
Abstract: Aspects of the present disclosure involve a system for performing real-time in-painting using machine learning techniques. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system accesses a segmentation associated with the real-world object and removes a depiction of the real-world object from a region of a first frame of the video. The system processes, by a machine learning model, the first frame and one or more previous frames of the video that precede the first frame to generate a new frame in which portions of the first frame have been blended into the region from which the depiction of the real-world object has been removed.
-
公开(公告)号：US20240070986A1
公开(公告)日：2024-02-29
申请号：US18502634
申请日：2023-11-06
Applicant: Snap Inc.
Inventor： Matan Zohar , Artem Bondich , Yanli Zhao , Brian Fulkerson
CPC classification number: G06T17/205 , G06T7/251 , G06T7/70 , G06T19/006 , G06T2207/10016
Abstract: Methods and systems are disclosed for performing operations for deforming an external mesh. The operations comprise receiving a video that includes a depiction of a real-world object. The operations comprise generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video. The operations comprise obtaining an external mesh associated with an Augmented-Reality (AR) element. The operations comprise accessing a plurality of deformation attributes associated with the external mesh, each attribute corresponding to a different deformation model. The operations comprise separately deforming, based on respective deformation models, a first portion of the external mesh and a second portion of the external mesh. The operations comprise modifying the video to include a display of the AR element based on the separately deformed first and second portions of the external mesh.
-
公开(公告)号：US11900506B2
公开(公告)日：2024-02-13
申请号：US17470231
申请日：2021-09-09
Applicant: Snap Inc.
Inventor： Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: G06T11/00 , G06V40/16 , G06Q30/0601
CPC classification number: G06T11/00 , G06Q30/0643 , G06V40/168 , G06V40/174
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; identifying a facial expression of the user depicted in the image; and in response to identifying the facial expression, applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.
-
公开(公告)号：US20240013463A1
公开(公告)日：2024-01-11
申请号：US17888786
申请日：2022-08-16
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Riza Alp Guler , Antonios Kakolyris , Frank Lu , Haoyang Wang , Matan Zohar
CPC classification number: G06T13/40 , G06T19/006 , H04L51/10
Abstract: Aspects of the present disclosure involve a system for providing virtual experiences. The system accesses, by a messaging application, an image depicting a person. The system generates, by the messaging application, a three-dimensional (3D) avatar based on the person depicted in the image. The system receives input that selects a pose for the 3D avatar and one or more fashion items to be worn by the 3D avatar and places, by the messaging application, the 3D avatar in the selected pose and wearing the one or more fashion items in an augmented reality (AR) experience.
-
公开(公告)号：US11836866B2
公开(公告)日：2023-12-05
申请号：US17448158
申请日：2021-09-20
Applicant: Snap Inc.
Inventor： Matan Zohar , Yanli Zhao , Brian Fulkerson , Riza Alp Guler
CPC classification number: G06T19/006 , G06T7/20 , G06T7/60 , G06T11/001 , G06T17/20 , G06T2219/2016 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; determining UV positions of the real-world object depicted in the video to obtain pixel values associated with the UV positions; generating an external mesh and associated augmented reality (AR) element representing the real-world object based on the pixel values associated with the UV positions; deforming the external mesh based on changes to the 3D body mesh and a deformation parameter; and modifying the video to replace the real-world object with the AR element based on the deformed external mesh.
-
-
-
-
-
-
-
-
-
Search Results
110
records
(took 0.028 seconds)
