公开(公告)号：US11995780B2

公开(公告)日：2024-05-28

申请号：US17941301

申请日：2022-09-09

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Maxim Maximov Lazarov ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06T19/00 ,  G06F3/01 ,  G06T7/70 ,  G06V40/20

CPC classification number: G06T19/006 ,  G06F3/017 ,  G06T7/70 ,  G06V40/28 ,  G06T2207/30196

Abstract: The subject technology receives a set of frames. The subject technology detect a first gesture correspond to an open trigger finger gesture. The subject technology receives a second set of frames. The subject technology detects from the second set of frames, a second gesture correspond to a closed trigger finger gesture. The subject technology detects a location and a position of a representation of a finger from the closed trigger finger gesture. The subject technology generates a first virtual object based at least in part on the location and the position of the representation of the finger. The subject technology renders a movement of the first virtual object along a vector away from the location and the position of the representation of the finger within a first scene. The subject technology provides for display the rendered movement of the first virtual object along the vector within the first scene.

公开(公告)号：US20240161425A1

公开(公告)日：2024-05-16

申请号：US18419163

申请日：2024-01-22

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maximov Lazarov ,  Tony Mathew ,  Andrew Andrew McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/04883 ,  G06T15/80 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06F3/012 ,  G06F3/04883 ,  G06T15/80 ,  G06T19/20 ,  G06T2219/2004

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.

公开(公告)号：US20240104959A1

公开(公告)日：2024-03-28

申请号：US18535771

申请日：2023-12-11

Applicant: Snap Inc.

Inventor： Dylan Shane Eirinberg ,  Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06V40/20 ,  G02B27/01 ,  G06F3/01 ,  G06F3/0482 ,  G06F3/14

CPC classification number: G06V40/23 ,  G02B27/0172 ,  G06F3/013 ,  G06F3/0482 ,  G06F3/1454 ,  G06V40/28 ,  G02B2027/0178

Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; displaying, by one or more processors of the electronic mirroring device, one or more menu options on the video feed that depicts the user, the one or more menu options relating to a first level in a hierarchy of levels; detecting a gesture performed by the user in the video feed; and in response to detecting the gesture, displaying a set of options related to a given option of the one or more menu options, the set of options relating to a second level in the hierarchy of levels.

公开(公告)号：US20240087242A1

公开(公告)日：2024-03-14

申请号：US17941293

申请日：2022-09-09

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Maxim Maximov Lazarov ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06T19/00 ,  G06T7/70 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06T7/70 ,  G06T19/20 ,  G06T2200/24 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2210/21 ,  G06T2219/2016

Abstract: The subject technology detects a location and a position of a representation of a finger. The subject technology generates a first virtual object based on the location and the position of the representation of the finger. The subject technology detects a first collision event. The subject technology in response to the first collision event, modifies a set of dimensions of the second virtual object to a second set of dimensions. The subject technology detects a second location and a second position of the representation of the finger. The subject technology detects a second collision event. The subject technology modifies a set of dimensions of the third virtual object to a third set of dimensions. The subject technology renders the third virtual object based on the third set of dimensions within a third scene, the third scene comprising a modified scene from a second scene.

公开(公告)号：US11908243B2

公开(公告)日：2024-02-20

申请号：US17249848

申请日：2021-03-16

Applicant: Snap Inc.

Inventor： Dylan Shane Eirinberg ,  Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06F3/0482 ,  G06F3/01 ,  G06F3/0481 ,  G06V40/20 ,  G06F3/14 ,  G02B27/01

CPC classification number: G06V40/23 ,  G02B27/0172 ,  G06F3/013 ,  G06F3/0482 ,  G06F3/1454 ,  G06V40/28 ,  G02B2027/0178

Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; displaying, by one or more processors of the electronic mirroring device, one or more menu options on the video feed that depicts the user, the one or more menu options relating to a first level in a hierarchy of levels; detecting a gesture performed by the user in the video feed; and in response to detecting the gesture, displaying a set of options related to a given option of the one or more menu options, the set of options relating to a second level in the hierarchy of levels.

公开(公告)号：US20240028132A1

公开(公告)日：2024-01-25

申请号：US18375763

申请日：2023-10-02

Applicant: Snap Inc.

Inventor： Dylan Shane Eirinberg ,  Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06F3/01 ,  G06F3/0482 ,  G06T7/20 ,  G06F3/04815 ,  G06V40/10

CPC classification number: G06F3/017 ,  G06F3/011 ,  G06F3/0482 ,  G06T7/20 ,  G06F3/04815 ,  G06V40/107 ,  G06T2207/30241 ,  G06T2207/10016 ,  G06T2207/30196

Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; identifying a finger of a hand of the user in the video feed; determining a direction within the video feed to which the finger is pointing; and accessing a first menu option based on the direction within the video feed to which the finger is pointing.

公开(公告)号：US20230410450A1

公开(公告)日：2023-12-21

申请号：US18240380

申请日：2023-08-31

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/20 ,  G06N20/00 ,  G06F3/04842 ,  G06F3/04883 ,  G06T15/50 ,  G06T7/507 ,  G06V40/16

CPC classification number: G06T19/20 ,  G06N20/00 ,  G06F3/04842 ,  G06F3/04883 ,  G06T15/50 ,  G06T7/507 ,  G06V40/171 ,  G06T2219/2012 ,  G06T2219/2024

Abstract: The subject technology applies, to image data and depth data, a 3D effect including at least one beautification operation based on an augmented reality content generator, the 3D effect including a beautification operation, the beautification operation comprising modifying image data, the image data including a region corresponding to a representation of a face, the beautification operation comprising using a machine learning model for at least one of smoothing blemishes or preserving facial skin texture. The subject technology generates a depth map using at least the depth data. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation.

公开(公告)号：US20230410442A1

公开(公告)日：2023-12-21

申请号：US18240373

申请日：2023-08-31

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/0482 ,  G06F3/0488 ,  G06T5/00 ,  G06F3/04815

CPC classification number: G06T19/006 ,  G06F3/0482 ,  G06F3/0488 ,  G06T5/005 ,  G06F3/04815 ,  G06T2207/10028

Abstract: The subject technology generates a segmentation mask based on first image data. The subject technology applies the segmentation mask on first depth data to reduce a set of artifacts in a depth map based on the first depth data. The subject technology generates a packed depth map based at least in part on the depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels. The subject technology applies, to the first image data and the first depth data, a first augmented reality content generator corresponding to a selected first selectable graphical item, the first image data and the first depth data being captured with a camera. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.

公开(公告)号：US20230386157A1

公开(公告)日：2023-11-30

申请号：US18450193

申请日：2023-08-15

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/00 ,  G06T7/194 ,  G06T7/50 ,  H04L67/131

CPC classification number: G06T19/006 ,  G06T7/194 ,  G06T7/50 ,  H04L67/131 ,  G06T2207/30201 ,  G06T2207/10028

Abstract: The subject technology applies a three-dimensional (3D) effect to image data and depth data based at least in part on an augmented reality content generator. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a packed depth map based at least in part on the a depth map of the depth data. The subject technology generates, using the processor, a message including information related to the applied 3D effect, the image data, and the depth data.

公开(公告)号：US11783556B2

公开(公告)日：2023-10-10

申请号：US18056099

申请日：2022-11-16

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/0482 ,  G06F3/0488 ,  G06T5/00 ,  G06F3/04815

CPC classification number: G06T19/006 ,  G06F3/0482 ,  G06F3/0488 ,  G06F3/04815 ,  G06T5/005 ,  G06T2207/10028

Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.