-
公开(公告)号:US12229860B2
公开(公告)日:2025-02-18
申请号:US18222799
申请日:2023-07-17
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
IPC: G06T13/40 , G06T7/246 , G06T19/00 , G06V40/20 , H04L67/131
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.
-
公开(公告)号:US12198664B2
公开(公告)日:2025-01-14
申请号:US17446757
申请日:2021-09-02
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a person wearing an article of clothing; generating a segmentation of the article of clothing worn by the person in the monocular image; obtaining one or more audio-track related augmented reality elements; and applying the one or more audio-track related augmented reality elements to the article of clothing worn by the person based on the segmentation of the article of clothing worn by the person.
-
公开(公告)号:US12198376B2
公开(公告)日:2025-01-14
申请号:US18144171
申请日:2023-05-06
Applicant: Snap Inc.
Inventor: Piers Cowburn , David Li , Isac Andreas Müller Sandvik , Qi Pan , Matan Zohar
Abstract: Method for creating marker-based shared augmented reality (AR) session starts with initializing a shared AR session by a first device and by a second device. The first device displays on a display a marker. The second device detects the marker using a camera included in the second device and captures an image of the marker using the camera. The second device determines a transformation between the first device and the second device using the image of the marker. A common coordinate frame is then determined using the transformation, the shared AR session is generated using the common coordinate frame, and the shared AR session is caused to be displayed by the first device and by the second device. Other embodiments are described herein.
-
公开(公告)号:US12198281B2
公开(公告)日:2025-01-14
申请号:US18382898
申请日:2023-10-23
Applicant: Snap Inc.
Inventor: Matan Zohar , Yanli Zhao , Brian Fulkerson , Riza Alp Guler
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; determining UV positions of the real-world object depicted in the video to obtain pixel values associated with the UV positions; generating an external mesh and associated augmented reality (AR) element representing the real-world object based on the pixel values associated with the UV positions; deforming the external mesh based on changes to the 3D body mesh and a deformation parameter; and modifying the video to replace the real-world object with the AR element based on the deformed external mesh.
-
公开(公告)号:US20240348762A1
公开(公告)日:2024-10-17
申请号:US18748730
申请日:2024-06-20
Applicant: Snap Inc.
Inventor: Sagi KATZ , Matan Zohar , Ilya Levin
IPC: H04N13/111 , G02B27/01 , G06T3/10 , G06T3/18 , G06T7/521 , H04N13/271
CPC classification number: H04N13/111 , G02B27/0176 , G06T3/10 , G06T3/18 , G06T7/521 , H04N13/271 , G02B2027/0178
Abstract: A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.
-
公开(公告)号:US12067804B2
公开(公告)日:2024-08-20
申请号:US17208208
申请日:2021-03-22
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Jean Luo , Matan Zohar
IPC: G06V40/16 , A61B90/00 , G06F3/01 , G06Q30/0601 , G06T19/00 , G06T19/20 , G06V20/00 , G06V20/20 , H04N13/00
CPC classification number: G06V40/171 , G06F3/011 , G06Q30/0631 , G06T19/006 , G06T19/20 , G06V20/00 , G06V20/20 , G06V40/165 , A61B2090/365 , G06T2207/10028 , G06T2219/2004 , G06T2219/2016 , G06T2219/2021 , G06T2219/2024 , H04N2013/0081
Abstract: Methods and systems are disclosed for performing operations comprising: receiving, by one or more processors, an image that includes a depiction of a face of a user; computing a real-world scale of the face of the user based on a selected subset of landmarks of the face of the user; obtaining an augmented reality graphical element comprising augmented reality eyewear; scaling the augmented reality graphical element based on the computed real-world scale of the face; and positioning the scaled augmented reality graphical element within the image on the face of the user.
-
公开(公告)号:US20240265608A1
公开(公告)日:2024-08-08
申请号:US18104840
申请日:2023-02-02
Applicant: Snap Inc.
Inventor: Matan Zohar , Itamar Berger
IPC: G06T13/40 , G06N3/0475 , G06T19/00 , G06T19/20
CPC classification number: G06T13/40 , G06N3/0475 , G06T19/006 , G06T19/20 , G06T2219/2012 , G06T2219/2021
Abstract: Aspects of the present disclosure involve a system for providing an AR try-on experience for a friend. The system accesses a plurality of images that depict one or more persons. The system receives input that identifies a given person of the one or more persons who is depicted in an individual image of the plurality of images. The system extracts features of the given person depicted in the individual image. The system applies a machine learning model to the extracted features of the given person to generate an avatar that resembles the given person. The system applies one or more augmented reality (AR) fashion items to the avatar to generate an image that resembles the given person wearing the one or more AR fashion items.
-
公开(公告)号:US20240257484A1
公开(公告)日:2024-08-01
申请号:US18631860
申请日:2024-04-10
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
CPC classification number: G06T19/006 , A63F13/65 , G06Q30/0641 , G06T7/11 , G06T7/20 , G06T7/70 , G06T17/00 , G06T19/20 , A63F2300/69 , G06T2207/10016 , G06T2207/30196 , G06T2219/2004 , G06T2219/2016 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a three-dimensional (3D) model of the person depicted in the video; generating a segmentation of the fashion item worn by the person depicted in the video; outlining a portion of the 3D model based on the segmentation of the fashion item; tracking movement of the portion of the 3D model in the video; and in response to tracking the movement of the portion of the 3D model in the video, modifying a display position of one or more augmented reality elements on the fashion item in the video.
-
公开(公告)号:US20240257473A1
公开(公告)日:2024-08-01
申请号:US18162453
申请日:2023-01-31
Applicant: Snap Inc.
Inventor: Matan Zohar , Itamar Berger , Gal Sasson , Omri Berg
CPC classification number: G06T19/006 , G06F3/017
Abstract: Aspects of the present disclosure involve a system for providing a footwear mirror experience. The system accesses a video stream captured by a camera directed at feet of users. The system detects a depiction of one or more feet of a user in the video stream captured by the camera. The system, in response to detecting the one or more feet in the video stream captured by the camera, activates a display screen that is positioned at an eye-level of the user and presents the video stream including the depiction of the one or more feet of the user on the display screen.
-
公开(公告)号:US20230274461A1
公开(公告)日:2023-08-31
申请号:US18144171
申请日:2023-05-06
Applicant: Snap Inc.
Inventor: Piers George Cowburn , David Li , Isac Andreas Müller Sandvik , Qi Pan , Matan Zohar
CPC classification number: G06T7/74 , G06F3/011 , G06T19/006 , G06T2207/30204 , G06T2219/004 , G06T2219/024
Abstract: Method for creating marker-based shared augmented reality (AR) session starts with initializing a shared AR session by a first device and by a second device. The first device displays on a display a marker. The second device detects the marker using a camera included in the second device and captures an image of the marker using the camera. The second device determines a transformation between the first device and the second device using the image of the marker. A common coordinate frame is then determined using the transformation, the shared AR session is generated using the common coordinate frame, and the shared AR session is caused to be displayed by the first device and by the second device. Other embodiments are described herein.
-
-
-
-
-
-
-
-
-