公开(公告)号：US11671572B2

公开(公告)日：2023-06-06

申请号：US17526136

申请日：2021-11-15

Applicant: Snap Inc.

Inventor： Sagi Katz ,  Matan Zohar ,  Ilya Levin

IPC: H04N13/111 ,  G02B27/01 ,  H04N13/271 ,  G06T3/00 ,  G06T7/521

CPC classification number: H04N13/111 ,  G02B27/0176 ,  G06T3/0056 ,  G06T3/0093 ,  G06T7/521 ,  H04N13/271 ,  G02B2027/0178

Abstract: A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.

公开(公告)号：US20230169739A1

公开(公告)日：2023-06-01

申请号：US18101673

申请日：2023-01-26

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T19/00 ,  G06T19/20 ,  G06V10/26 ,  G06V10/60 ,  G06T7/90

CPC classification number: G06T19/006 ,  G06T7/90 ,  G06T19/20 ,  G06V10/26 ,  G06V10/60 ,  G06T2207/20224 ,  G06T2219/2012 ,  G06T2219/2016

Abstract: Methods and systems are disclosed for performing operations for recoloring a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item. The operations include estimating lights and shadows being cast on the fashion item in the portion of the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the lights and shadows being cast on the fashion item.

公开(公告)号：US11660022B2

公开(公告)日：2023-05-30

申请号：US16949607

申请日：2020-11-06

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: A61B5/11 ,  G06T19/00 ,  A61B5/00 ,  G06T5/00

CPC classification number: A61B5/1113 ,  A61B5/744 ,  G06T5/002 ,  G06T19/006 ,  G06T2207/20182 ,  G06T2210/41

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the video; tracking movement of the plurality of skeletal joints across a set of frames of the video; and smoothing the movement of a first set of the plurality of skeletal joints between frames in the first set of frames independently of smoothing movement of a second set of the plurality of skeletal joints in the first set of frames.

公开(公告)号：US20230154129A1

公开(公告)日：2023-05-18

申请号：US18098799

申请日：2023-01-19

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Mishin Shuvi ,  Matan Zohar

IPC: G06T19/20 ,  G06T17/00 ,  G06T19/00 ,  G06T7/10

CPC classification number: G06T19/20 ,  G06T17/00 ,  G06T19/006 ,  G06T7/10 ,  G06T2207/20084

Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item; estimating an angle of each pixel in the portion of the image relative to a camera used to capture the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the estimated angle of each pixel in the portion of the image relative to the camera used to capture the image.

公开(公告)号：US20230154042A1

公开(公告)日：2023-05-18

申请号：US18156519

申请日：2023-01-19

Applicant: Snap Inc.

Inventor： Avihay Assouline ,  Itamar Berger ,  Gal Dudovitch ,  Matan Zohar

IPC: G06T7/73 ,  H04N21/4402 ,  G06V20/20 ,  G06V20/40 ,  G06V20/64 ,  G06V40/20 ,  G06F18/214 ,  G06V40/10

CPC classification number: G06T7/73 ,  H04N21/4402 ,  G06V20/20 ,  G06V20/46 ,  G06V20/647 ,  G06V40/23 ,  G06F18/214 ,  G06V40/103 ,  H04L51/04

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user, The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.

公开(公告)号：US11636662B2

公开(公告)日：2023-04-25

申请号：US17490209

申请日：2021-09-30

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T19/20 ,  G06T19/00 ,  G06T17/00 ,  G06T7/10

Abstract: Methods and systems are disclosed for performing operations for applying augmented reality elements to a fashion item. The operations include receiving an image that includes a depiction of a person wearing a fashion item. The operations include generating a segmentation of the fashion item worn by the person depicted in the image. The operations include extracting a portion of the image corresponding to the segmentation of the fashion item; estimating an angle of each pixel in the portion of the image relative to a camera used to capture the image. The operations include applying one or more augmented reality elements to the fashion item in the image based on the estimated angle of each pixel in the portion of the image relative to the camera used to capture the image.

公开(公告)号：US20230090645A1

公开(公告)日：2023-03-23

申请号：US17448158

申请日：2021-09-20

Applicant: Snap Inc

Inventor： Matan Zohar ,  Yanli Zhao ,  Brian Fulkerson ,  Riza Alp Guler

IPC: G06T19/00 ,  G06T7/20 ,  G06T17/20 ,  G06T7/60 ,  G06T11/00

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; determining UV positions of the real-world object depicted in the video to obtain pixel values associated with the UV positions; generating an external mesh and associated augmented reality (AR) element representing the real-world object based on the pixel values associated with the UV positions; deforming the external mesh based on changes to the 3D body mesh and a deformation parameter; and modifying the video to replace the real-world object with the AR element based on the deformed external mesh.

公开(公告)号：US20230080584A1

公开(公告)日：2023-03-16

申请号：US17447614

申请日：2021-09-14

Applicant: Snap Inc.

Inventor： Matan Zohar ,  Yanli Zhao ,  Brian Fulkerson

IPC: G06T19/00 ,  G06T7/246 ,  G06T17/20 ,  G06T13/40 ,  G06T13/80 ,  G06T19/20

Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality (AR) element; automatically establishing a correspondence between a portion of the 3D body mesh associated with the real-world object and the external mesh; blending the portion of the 3D body mesh into the external mesh according to a blending parameter; and as the portion of the 3D body mesh is being blended into the external mesh, modifying the video to depict a portion of the real-world object being changed into the AR element.

公开(公告)号：US20230075256A1

公开(公告)日：2023-03-09

申请号：US17468379

申请日：2021-09-07

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: A63F13/655 ,  A63F13/426 ,  G06F3/01 ,  A63F13/46

Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; generating one or more game-based augmented reality elements; and applying the one or more game-based augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.

公开(公告)号：US20230070631A1

公开(公告)日：2023-03-09

申请号：US17470231

申请日：2021-09-09

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Gal Dudovitch ,  Gal Sasson ,  Ma'ayan Shuvi ,  Matan Zohar

IPC: G06T11/00 ,  G06K9/00 ,  G06Q30/06

Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; identifying a facial expression of the user depicted in the image; and in response to identifying the facial expression, applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.