-
公开(公告)号:US20210248373A1
公开(公告)日:2021-08-12
申请号:US17240457
申请日:2021-04-26
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
IPC: G06K9/00 , G06K9/62 , H04N21/4402
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.
-
公开(公告)号:US20210201530A1
公开(公告)日:2021-07-01
申请号:US16729078
申请日:2019-12-27
Applicant: Snap Inc.
Inventor: Piers Cowburn , David Li , Isac Andreas MÜller Sandvik , Qi Pan , Matan Zohar
Abstract: Method for creating marker-based shared augmented reality (AR) session starts with initializing a shared AR session by a first device and by a second device. The first device displays on a display a marker. The second device detects the marker using a camera included in the second device and captures an image of the marker using the camera. The second device determines a transformation between the first device and the second device using the image of the marker. A common coordinate frame is then determined using the transformation, the shared AR session is generated using the common coordinate frame, and the shared AR session is caused to be displayed by the first device and by the second device. Other embodiments are described herein.
-
公开(公告)号:US12243173B2
公开(公告)日:2025-03-04
申请号:US18100080
申请日:2023-01-23
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.
-
公开(公告)号:US12217453B2
公开(公告)日:2025-02-04
申请号:US18231025
申请日:2023-08-07
Applicant: Snap Inc.
Inventor: Matan Zohar , Yanli Zhao , Brian Fulkerson , Itamar Berger
IPC: G06T7/70 , G06F18/214 , G06F18/24 , G06T19/00 , G06V40/10
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person. The operations further include identifying a set of skeletal joints of the person. The operations further include identifying a pose of the person depicted in the video based on positioning of the set of skeletal joints (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device). The operations further include determining, based on the pose of the person (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device), that the video comprises a mirror reflection of the person. The operations further include, in response to determining that the video comprises the mirror reflection of the person, causing display of a 3D virtual object in the video.
-
公开(公告)号:US20240371197A1
公开(公告)日:2024-11-07
申请号:US18773011
申请日:2024-07-15
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Jean Luo , Matan Zohar
IPC: G06V40/16 , A61B90/00 , G06F3/01 , G06Q30/0601 , G06T19/00 , G06T19/20 , G06V20/00 , G06V20/20 , H04N13/00
Abstract: Methods and systems are disclosed for performing operations comprising: receiving, by one or more processors, an image that includes a depiction of a face of a user; computing a real-world scale of the face of the user based on a selected subset of landmarks of the face of the user; obtaining an augmented reality graphical element comprising augmented reality eyewear; scaling the augmented reality graphical element based on the computed real-world scale of the face; and positioning the scaled augmented reality graphical element within the image on the face of the user.
-
公开(公告)号:US20240273613A1
公开(公告)日:2024-08-15
申请号:US18107856
申请日:2023-02-09
Applicant: Snap Inc.
Inventor: Matan Zohar , Itamar Berger , Gal Sasson , Omri Berg
IPC: G06Q30/0601 , G06F16/958 , G06T19/00
CPC classification number: G06Q30/0643 , G06F16/986 , G06T19/006 , G06T2210/16
Abstract: Aspects of the present disclosure involve a system for providing a browsing-based augmented reality (AR) try-on experience. The system displays a graphical user interface (GUI) comprising a set of fashion items. The system receives a real-time video feed from a camera of the device, the real-time video feed depicting a person. The system retrieves a first AR fashion item corresponding to a first fashion item in the set of fashion items included in the GUI. The system modifies the real-time video feed based on application of the first AR fashion item to the depiction of the person in the real-time video feed. The system presents the modified real-time video feed together with the GUI comprising the set of fashion items.
-
公开(公告)号:US12056832B2
公开(公告)日:2024-08-06
申请号:US18138269
申请日:2023-04-24
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: G06T19/00
CPC classification number: G06T19/006
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.
-
公开(公告)号:US20240153214A1
公开(公告)日:2024-05-09
申请号:US18413423
申请日:2024-01-16
Applicant: Snap Inc.
Inventor: Yanli Zhao , Matan Zohar , Brian Fulkerson , Georgios Papandreou , Haoyang Wang
IPC: G06T17/20 , G06T19/00 , G06T19/20 , H04L51/046 , H04L51/10
CPC classification number: G06T17/205 , G06T19/006 , G06T19/20 , H04L51/046 , H04L51/10 , G06T2219/2016
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality element; automatically establishing a correspondence between the 3D body mesh associated with the real-world object and the external mesh; deforming the external mesh based on movement of the real-world object and the established correspondence with the 3D body mesh; and modifying the video to include a display of the augmented reality element based on the deformed external mesh.
-
公开(公告)号:US11941767B2
公开(公告)日:2024-03-26
申请号:US18119433
申请日:2023-03-09
Applicant: Snap Inc.
Inventor: Itamar Berger , Amar Boghani , Maria Jose Garcia Sopo , Isac Andreas Müller Sandvik , Qi Pan , Matan Zohar
IPC: G06T19/00 , G06K7/14 , G06Q10/087 , G06Q20/12 , G06Q30/0601 , G06Q50/00 , H04L51/046 , H04L67/131
CPC classification number: G06T19/006 , G06K7/1413 , G06Q10/087 , G06Q30/0623 , G06Q30/0643 , G06Q50/01 , H04L51/046 , H04L67/131 , G06Q20/1235 , G06Q30/0633
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a request from a client device of a first user to engage in a shared augmented reality (AR) shopping experience with a second user; generating, for display on respective client devices of the first and second users, the shared AR shopping experience comprising a plurality of AR items that represent real-world products overlaid on a shared real-world environment of the first and second users; determining that the second user is interacting with a first AR item of the plurality of AR items; and in response to detecting that the second user is depicted in an image captured by the client device of the first user, overlaying the first AR item on the second user in the image.
-
公开(公告)号:US11908083B2
公开(公告)日:2024-02-20
申请号:US17446533
申请日:2021-08-31
Applicant: Snap Inc.
Inventor: Yanli Zhao , Matan Zohar , Brian Fulkerson , Georgios Papandreou , Haoyang Wang
IPC: G06T17/20 , G06T19/00 , G06T19/20 , H04L51/046 , H04L51/10
CPC classification number: G06T17/205 , G06T19/006 , G06T19/20 , H04L51/046 , H04L51/10 , G06T2219/2016
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality element; automatically establishing a correspondence between the 3D body mesh associated with the real-world object and the external mesh; deforming the external mesh based on movement of the real-world object and the established correspondence with the 3D body mesh; and modifying the video to include a display of the augmented reality element based on the deformed external mesh.
-
-
-
-
-
-
-
-
-