-
公开(公告)号:US20230215116A1
公开(公告)日:2023-07-06
申请号:US18119433
申请日:2023-03-09
Applicant: Snap Inc.
Inventor: Itamar Berger , Amar Boghani , Maria Jose Garcia Sopo , Isac Andreas Müller Sandvik , Qi Pan , Matan Zohar
IPC: G06T19/00 , H04L67/131 , G06K7/14 , G06Q10/087 , G06Q30/0601 , G06Q50/00 , H04L51/046
CPC classification number: G06T19/006 , H04L67/131 , G06K7/1413 , G06Q10/087 , G06Q30/0623 , G06Q30/0643 , G06Q50/01 , H04L51/046 , G06Q20/1235
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a request from a client device of a first user to engage in a shared augmented reality (AR) shopping experience with a second user; generating, for display on respective client devices of the first and second users, the shared AR shopping experience comprising a plurality of AR items that represent real-world products overlaid on a shared real-world environment of the first and second users; determining that the second user is interacting with a first AR item of the plurality of AR items; and in response to detecting that the second user is depicted in an image captured by the client device of the first user, overlaying the first AR item on the second user in the image.
-
公开(公告)号:US11673054B2
公开(公告)日:2023-06-13
申请号:US17468379
申请日:2021-09-07
Applicant: Snap Inc.
Inventor: Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: A63F13/655 , A63F13/426 , A63F13/46 , G06F3/01
CPC classification number: A63F13/655 , A63F13/426 , A63F13/46 , G06F3/017 , A63F2300/308 , A63F2300/8082
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; generating one or more game-based augmented reality elements; and applying the one or more game-based augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.
-
公开(公告)号:US20230115531A1
公开(公告)日:2023-04-13
申请号:US17498394
申请日:2021-10-11
Applicant: Snap Inc.
Inventor: Matan Zohar , Artem Bondich , Yanli Zhao , Brian Fulkerson
Abstract: Methods and systems are disclosed for performing operations for deforming an external mesh. The operations comprise receiving a video that includes a depiction of a real-world object. The operations comprise generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video. The operations comprise obtaining an external mesh associated with an Augmented-Reality (AR) element. The operations comprise accessing a plurality of deformation attributes associated with the external mesh, each attribute corresponding to a different deformation model. The operations comprise separately deforming, based on respective deformation models, a first portion of the external mesh and a second portion of the external mesh. The operations comprise modifying the video to include a display of the AR element based on the separately deformed first and second portions of the external mesh.
-
公开(公告)号:US11615592B2
公开(公告)日:2023-03-28
申请号:US17081178
申请日:2020-10-27
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.
-
公开(公告)号:US20230074826A1
公开(公告)日:2023-03-09
申请号:US17468774
申请日:2021-09-08
Applicant: Snap Inc.
Inventor: Matan Zohar , Yanli Zhao , Brian Fulkerson
Abstract: Methods and systems are disclosed for performing operations comprising: receiving video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality (AR) element; determining that a first portion of the external mesh is associated with movement information of the 3D body mesh; determining that a second portion of the external mesh is associated with movement information of an external force model; deforming the first and second portions of the external mesh separately based on movement information of the 3D body mesh and movement information of the external force model; and modifying the video to include a display of the AR element based on the deformed first and second portions of the external mesh.
-
公开(公告)号:US11508087B2
公开(公告)日:2022-11-22
申请号:US15929333
申请日:2020-04-27
Applicant: Snap Inc.
Inventor: Matan Zohar , Avihay Assouline , Gal Dudovitch , Itamar Berger
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising: receiving a monocular image that includes a depiction of a body of a user in a given pose; detecting a plurality of skeletal joints of the body depicted in the monocular image; generating an outline of the body of the user based on the plurality of skeletal joints; retrieving a mask that represents a target pose; comparing the outline of the body depicted in the monocular image with the mask that represents the target pose; and determining that the given pose of the body of the user matches the target pose in response to comparing the outline of the body with the mask.
-
公开(公告)号:US20220157025A1
公开(公告)日:2022-05-19
申请号:US16951939
申请日:2020-11-18
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.
-
公开(公告)号:US20220130115A1
公开(公告)日:2022-04-28
申请号:US17081178
申请日:2020-10-27
Applicant: Snap Inc.
Inventor: Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.
-
公开(公告)号:US20220078391A1
公开(公告)日:2022-03-10
申请号:US17526136
申请日:2021-11-15
Applicant: Snap Inc.
Inventor: Sagi Katz , Matan Zohar , Ilya Levin
IPC: H04N13/111 , G02B27/01 , H04N13/271 , G06T3/00 , G06T7/521
Abstract: A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.
-
公开(公告)号:US11178375B1
公开(公告)日:2021-11-16
申请号:US16658370
申请日:2019-10-21
Applicant: Snap Inc.
Inventor: Sagi Katz , Matan Zohar , Ilya Levin
IPC: H04N13/00 , H04N13/111 , G02B27/01 , H04N13/271 , G06T3/00 , G06T7/521
Abstract: A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.
-
-
-
-
-
-
-
-
-