-
公开(公告)号:US20220327709A1
公开(公告)日:2022-10-13
申请号:US17301690
申请日:2021-04-12
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Nir Malbin , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a user wearing a garment; generating a segmentation of the garment worn by the user in the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the garment worn by the user to provide a smoothed segmentation of the garment worn by the user; and applying one or more visual effects to the monocular image based on the smoothed segmentation of the garment worn by the user.
-
公开(公告)号:US20220270261A1
公开(公告)日:2022-08-25
申请号:US17249239
申请日:2021-02-24
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Chia-Hao Hsieh , Sergei Korolev , Ma'ayan Shuvi
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a whole body of a user; generating a segmentation of the whole body of the user based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the whole body generated based on the monocular image to provide a smoothed segmentation; and applying one or more visual effects to the monocular image based on the smoothed segmentation.
-
公开(公告)号:US12299832B2
公开(公告)日:2025-05-13
申请号:US18435793
申请日:2024-02-07
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
IPC: G06V20/20 , G06T19/00 , G06T19/20 , G06V10/764 , G06V10/774 , G06V10/776 , G06V10/82
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system performs operations including receiving a video that includes a depiction of one or more real-world objects in a real-world environment and obtaining depth data related to the real-world environment. The operations include generating a three-dimensional (3D) model of the real-world environment based on the video and the depth data and adding an augmented reality (AR) item to the video based on the 3D model of the real-world environment. The operations include determining that the AR item has been placed on a vertical plane of the real-world environment and modifying an orientation of the AR item to correspond to an orientation of the vertical plane.
-
公开(公告)号:US20240404224A1
公开(公告)日:2024-12-05
申请号:US18325868
申请日:2023-05-30
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel
Abstract: Methods and systems are disclosed for generating mirrored 3D assets for an extended reality (XR) experience. The system receives a three-dimensional (3D) object comprising a target and analyzes the 3D object using one or more machine learning models to generate data associated with a mirrored version of the target of the 3D object. The system applies the mirrored version of the target to a mirrored version of the 3D object using the generated data and generates a new 3D object comprising the mirrored version of the 3D object and the mirrored version of the target.
-
公开(公告)号:US12154232B2
公开(公告)日:2024-11-26
申请号:US17937153
申请日:2022-09-30
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi
Abstract: Aspects of the present disclosure involve a system for presenting AR items. The system receives a video that includes a depiction of a real-world object in a real-world environment. The system generates a three-dimensional (3D) bounding box for the real-world object and stabilizes the 3D bounding box based on one or more sensors of the device. The system determines a position, orientation, and dimensions of the real-world object based on the stabilized 3D bounding box and renders a display of an augmented reality (AR) item within the video based on the position, orientation, and dimensions of the real-world object.
-
公开(公告)号:US12100156B2
公开(公告)日:2024-09-24
申请号:US17301690
申请日:2021-04-12
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Nir Malbin , Ma'ayan Shuvi , Matan Zohar
CPC classification number: G06T7/11 , G06F18/2155 , G06N3/04 , G06N20/00 , G06T5/70 , G06V40/103 , G06T2207/30124 , G06T2207/30196
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a user wearing a garment; generating a segmentation of the garment worn by the user in the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the garment worn by the user to provide a smoothed segmentation of the garment worn by the user; and applying one or more visual effects to the monocular image based on the smoothed segmentation of the garment worn by the user.
-
公开(公告)号:US20240249474A1
公开(公告)日:2024-07-25
申请号:US18100546
申请日:2023-01-23
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel
IPC: G06T17/20 , G06Q30/0241 , G06T5/50
CPC classification number: G06T17/20 , G06Q30/0276 , G06T5/50 , G06T2207/20212
Abstract: Aspects of the present disclosure involve a system for generating images that depict a real-world object in a scene. The system receives image content comprising a depth map of a scene and a three-dimensional (3D) model of a real-world object. The system receives a textual description for a background. The system applies the image content and the textual description to a machine learning model to generate a scene image that depicts the real-world object on the background corresponding to the textual description.
-
公开(公告)号:US20240037858A1
公开(公告)日:2024-02-01
申请号:US17815831
申请日:2022-07-28
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Ma'ayan Mishin Shuvi
CPC classification number: G06T19/006 , G06Q30/0643 , G06N3/082 , G06T2200/24 , G06T2200/08 , G06T2210/16 , G06T2219/024
Abstract: Aspects of the present disclosure involve a system for providing AR experiences. The system accesses, by a messaging application, an image depicting a real-world fashion item of a user and generates a three-dimensional (3D) virtual fashion item based on the real-world fashion item depicted in the image. The system stores the 3D virtual fashion item in a database that includes a virtual wardrobe comprising a plurality of 3D virtual fashion items associated with the user. The system generates, by the messaging application, an augmented reality (AR) experience that allows the user to interact with the virtual wardrobe.
-
公开(公告)号:US11790531B2
公开(公告)日:2023-10-17
申请号:US17249239
申请日:2021-02-24
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Chia-Hao Hsieh , Sergei Korolev , Ma'ayan Shuvi
CPC classification number: G06T7/11 , G06F18/214 , G06F18/217 , G06T5/002 , G06T11/00 , G06V40/10 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a whole body of a user; generating a segmentation of the whole body of the user based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the whole body generated based on the monocular image to provide a smoothed segmentation; and applying one or more visual effects to the monocular image based on the smoothed segmentation.
-
公开(公告)号:US20230215105A1
公开(公告)日:2023-07-06
申请号:US17566070
申请日:2021-12-30
Applicant: Snap Inc.
Inventor: Avilhay Assouline , Itamar Berger , Gal Dudovitch , Peleg Harel , Gal Sasson
CPC classification number: G06T19/006 , H04N5/232939 , G06T19/20 , G06V20/20 , G06V10/945 , G06V10/82 , G06V10/764 , G06N3/08 , G06T2219/2016 , G06T2200/24
Abstract: Aspects of the present disclosure involve a system for presenting augmented reality (AR) items. The system performs operations including receiving a video that includes a depiction of a real-world environment and generating a 3D model of the real-world environment based on the video. The operations include determining, based on the 3D model of the real-world environment, that an AR item has been placed in the video at a particular 3D position and identifying a portion of the 3D model corresponding to the real-world environment currently being displayed on a screen. The operations include determining that the 3D position of the AR item is excluded from the portion of the 3D model currently being displayed on the screen and in response, displaying an indicator that identifies the 3D position of the AR item in the 3D model relative to the portion of the 3D model currently being displayed on a screen.
-
-
-
-
-
-
-
-
-