-
公开(公告)号：US12100156B2
公开(公告)日：2024-09-24
申请号：US17301690
申请日：2021-04-12
Applicant: Snap Inc.
Inventor： Gal Dudovitch , Peleg Harel , Nir Malbin , Ma'ayan Shuvi , Matan Zohar
CPC classification number: G06T7/11 , G06F18/2155 , G06N3/04 , G06N20/00 , G06T5/70 , G06V40/103 , G06T2207/30124 , G06T2207/30196
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a user wearing a garment; generating a segmentation of the garment worn by the user in the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the garment worn by the user to provide a smoothed segmentation of the garment worn by the user; and applying one or more visual effects to the monocular image based on the smoothed segmentation of the garment worn by the user.
-
公开(公告)号：US12002175B2
公开(公告)日：2024-06-04
申请号：US18216958
申请日：2023-06-30
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
CPC classification number: G06T19/006 , G06T7/251 , G06T17/20 , G06V40/10 , G06T2207/10016 , G06T2207/10024 , G06T2207/20212
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.
-
公开(公告)号：US11836862B2
公开(公告)日：2023-12-05
申请号：US17498394
申请日：2021-10-11
Applicant: Snap Inc.
Inventor： Matan Zohar , Artem Bondich , Yanli Zhao , Brian Fulkerson
CPC classification number: G06T17/205 , G06T7/251 , G06T7/70 , G06T19/006 , G06T2207/10016
Abstract: Methods and systems are disclosed for performing operations for deforming an external mesh. The operations comprise receiving a video that includes a depiction of a real-world object. The operations comprise generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video. The operations comprise obtaining an external mesh associated with an Augmented-Reality (AR) element. The operations comprise accessing a plurality of deformation attributes associated with the external mesh, each attribute corresponding to a different deformation model. The operations comprise separately deforming, based on respective deformation models, a first portion of the external mesh and a second portion of the external mesh. The operations comprise modifying the video to include a display of the AR element based on the separately deformed first and second portions of the external mesh.
-
公开(公告)号：US20230360301A1
公开(公告)日：2023-11-09
申请号：US18222799
申请日：2023-07-17
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
IPC: G06T13/40 , G06T7/246 , G06V40/20 , H04L67/131 , G06T19/00
CPC classification number: G06T13/40 , G06T7/246 , G06V40/23 , H04L67/131 , G06T19/006 , G06T2200/24 , G06T2219/024
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.
-
公开(公告)号：US11798238B2
公开(公告)日：2023-10-24
申请号：US17447614
申请日：2021-09-14
Applicant: Snap Inc.
Inventor： Matan Zohar , Yanli Zhao , Brian Fulkerson
CPC classification number: G06T19/006 , G06T7/251 , G06T13/40 , G06T13/80 , G06T17/20 , G06T19/20 , G06T2200/24 , G06T2207/10016 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality (AR) element; automatically establishing a correspondence between a portion of the 3D body mesh associated with the real-world object and the external mesh; blending the portion of the 3D body mesh into the external mesh according to a blending parameter; and as the portion of the 3D body mesh is being blended into the external mesh, modifying the video to depict a portion of the real-world object being changed into the AR element.
-
Patent Agency Ranking
公开(公告)号：US11790614B2
公开(公告)日：2023-10-17
申请号：US17498510
申请日：2021-10-11
Applicant: Snap Inc.
Inventor： Matan Zohar , Yanli Zhao , Brian Fulkerson , Itamar Berger
CPC classification number: G06T19/006 , G06T7/70 , G06V40/10 , G10L15/08 , G10L2015/088
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.
-
公开(公告)号：US20230281936A1
公开(公告)日：2023-09-07
申请号：US18138269
申请日：2023-04-24
Applicant: Snap Inc.
Inventor： Itamar Berger , Gal Dudovitch , Gal Sasson , Ma'ayan Shuvi , Matan Zohar
IPC: G06T19/00
CPC classification number: G06T19/006
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.
-
公开(公告)号：US20230269355A1
公开(公告)日：2023-08-24
申请号：US18142202
申请日：2023-05-02
Applicant: Snap Inc.
Inventor： Sagi KATZ , Matan Zohar , Ilya Levin
IPC: H04N13/111 , G02B27/01 , H04N13/271 , G06T3/00 , G06T7/521
CPC classification number: H04N13/111 , G02B27/0176 , G06T3/0056 , G06T3/0093 , G06T7/521 , H04N13/271 , G02B2027/0178
Abstract: A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.
-
公开(公告)号：US11734894B2
公开(公告)日：2023-08-22
申请号：US16951939
申请日：2020-11-18
Applicant: Snap Inc.
Inventor： Avihay Assouline , Itamar Berger , Gal Dudovitch , Matan Zohar
CPC classification number: G06T19/006 , G06T7/251 , G06T17/20 , G06V40/10 , G06T2207/10016 , G06T2207/10024 , G06T2207/20212
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.
-
公开(公告)号：US11663792B2
公开(公告)日：2023-05-30
申请号：US17468774
申请日：2021-09-08
Applicant: Snap Inc.
Inventor： Matan Zohar , Yanli Zhao , Brian Fulkerson
CPC classification number: G06T19/006 , G06T19/20 , G06T2219/2021
Abstract: Methods and systems are disclosed for performing operations comprising: receiving video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality (AR) element; determining that a first portion of the external mesh is associated with movement information of the 3D body mesh; determining that a second portion of the external mesh is associated with movement information of an external force model; deforming the first and second portions of the external mesh separately based on movement information of the 3D body mesh and movement information of the external force model; and modifying the video to include a display of the AR element based on the deformed first and second portions of the external mesh.
-
-
-
-
-
-
-
-
-
Search Results
110
records
(took 0.03 seconds)
