-
公开(公告)号:US20220327608A1
公开(公告)日:2022-10-13
申请号:US17301692
申请日:2021-04-12
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Nir Malbin , Ma'ayan Shuvi
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of one or more objects in a room within a home; determining a room classification for the room by processing the one or more objects depicted in the video; selecting one or more augmented reality items available for purchase based on the room classification and the one or more objects depicted in the video; and generating, for display within the video, the one or more augmented reality items that have been selected at a display position within the video corresponding to the one or more objects depicted in the video.
-
公开(公告)号:US20230176805A1
公开(公告)日:2023-06-08
申请号:US17544403
申请日:2021-12-07
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Stephanie Engle , Christie Marie Heikkinen , Ma'ayan Shuvi
IPC: G06F3/14 , H04L65/403 , G06F3/04815 , G06T7/70 , G06T7/11 , G06T7/30 , G06T3/40 , G06F3/04845 , A63F13/847 , A63F13/69 , A63F13/87
CPC classification number: G06F3/1454 , H04L65/403 , G06F3/04815 , G06T7/70 , G06T7/11 , G06T7/30 , G06T3/40 , G06F3/04845 , A63F13/847 , A63F13/69 , A63F13/87 , G06T2207/30196 , A63F2300/8064 , A63F2300/8094 , A63F2300/609
Abstract: Methods and systems are disclosed for performing operations for providing a shared augmented reality unboxing experience. The operations include causing concurrent display of a shared augmented reality experience comprising a shared virtual box that is in a closed state on a plurality of client devices associated with a plurality of users and obtaining a sequence of triggers associated with the shared virtual box. First and second inputs are received respectively from first and second client devices. The operations include determining that the first and second inputs correspond to the sequence of triggers associated with the shared virtual box. The operations include modifying the shared virtual box from being displayed on the plurality of devices in the closed state to being displayed in the open state.
-
公开(公告)号:US20230116652A1
公开(公告)日:2023-04-13
申请号:US17498475
申请日:2021-10-11
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.
-
公开(公告)号:US20230103125A1
公开(公告)日:2023-03-30
申请号:US17490167
申请日:2021-09-30
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.
-
公开(公告)号:US11544884B2
公开(公告)日:2023-01-03
申请号:US17119202
申请日:2020-12-11
Applicant: Snap Inc.
Inventor: Ma'ayan Shuvi , Avihay Assouline , Itamar Berger
IPC: G06T11/60 , G06T3/00 , G06T7/11 , G06T5/50 , G06T11/00 , G06T5/40 , G06N3/08 , G06N3/04 , H04L51/046
Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.
-
公开(公告)号:US20220327709A1
公开(公告)日:2022-10-13
申请号:US17301690
申请日:2021-04-12
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Nir Malbin , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a user wearing a garment; generating a segmentation of the garment worn by the user in the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the garment worn by the user to provide a smoothed segmentation of the garment worn by the user; and applying one or more visual effects to the monocular image based on the smoothed segmentation of the garment worn by the user.
-
公开(公告)号:US20220270261A1
公开(公告)日:2022-08-25
申请号:US17249239
申请日:2021-02-24
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Chia-Hao Hsieh , Sergei Korolev , Ma'ayan Shuvi
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a whole body of a user; generating a segmentation of the whole body of the user based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the whole body generated based on the monocular image to provide a smoothed segmentation; and applying one or more visual effects to the monocular image based on the smoothed segmentation.
-
公开(公告)号:US20220189087A1
公开(公告)日:2022-06-16
申请号:US17119202
申请日:2020-12-11
Applicant: Snap Inc.
Inventor: Ma'ayan Shuvi , Avihay Assouline , Itamar Berger
Abstract: A messaging system performs virtual clothing try-on. A method of virtual clothing try-on may include accessing a target garment image and a person image of a person wearing a source garment and processing the person image to generate a source garment mask and a person mask. The method may further include processing the source garment mask, the person mask, the target garment image, and a target garment mask to generate a warping, the warping indicating a warping to apply to the target garment image. The method may further include processing the target garment to warp the target garment in accordance with the warping to generate a warped target garment image, processing the warped target garment image to blend with the person image to generate a person with a blended target garment image, and processing the person with blended target garment image to fill in holes to generate an output image.
-
公开(公告)号:US12198664B2
公开(公告)日:2025-01-14
申请号:US17446757
申请日:2021-09-02
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a person wearing an article of clothing; generating a segmentation of the article of clothing worn by the person in the monocular image; obtaining one or more audio-track related augmented reality elements; and applying the one or more audio-track related augmented reality elements to the article of clothing worn by the person based on the segmentation of the article of clothing worn by the person.
-
公开(公告)号:US12106486B2
公开(公告)日:2024-10-01
申请号:US17249241
申请日:2021-02-24
Applicant: Snap Inc.
Inventor: Gal Dudovitch , Peleg Harel , Chia-Hao Hsieh , Sergei Korolev , Ma'ayan Shuvi
IPC: G06T7/194 , G06F3/04842 , G06F3/04845 , G06T7/11 , G06T7/13 , G06T11/60
CPC classification number: G06T7/194 , G06F3/04842 , G06F3/04845 , G06T7/11 , G06T7/13 , G06T11/60 , G06T2207/20081
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a whole body of a user; generating a segmentation of the whole body of the user based on the monocular image by applying one or more machine learning techniques; receiving input that selects a visualization mode; and applying one or more visual effects corresponding to the visualization mode to the monocular image based on the segmentation.
-
-
-
-
-
-
-
-
-