公开(公告)号：US20240012549A1

公开(公告)日：2024-01-11

申请号：US18471056

申请日：2023-09-20

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06F3/04845 ,  G06F3/04842 ,  G06F3/04847 ,  G06F3/04815 ,  G06T19/00 ,  G06T19/20 ,  G02B27/01 ,  G06F3/04883 ,  G06F3/01 ,  G06F3/0484

CPC classification number: G06F3/04845 ,  G06F3/04842 ,  G06F3/04847 ,  G06F3/04815 ,  G06T19/006 ,  G06T19/20 ,  G02B27/0172 ,  G06F3/04883 ,  G06F3/017 ,  G06F3/0484 ,  G06T2219/2024 ,  G06T2219/2012 ,  G06F2203/04808

Abstract: Systems and methods are provided for performing operations comprising: displaying a plurality of augmented reality painting options; detecting, by a touch input interface of the eyewear device, a first touch input comprising a single finger touching the touch input interface; selecting a first augmented reality painting option of the plurality of augmented reality painting options in response to the first touch input; while continuing to detect continuous touch between the single finger and the touch input interface following selection of the first augmented reality painting option, displaying a second augmented reality painting option related to the first augmented reality painting option; and performing a selection associated with the second augmented reality painting option in response to detecting, by the touch input interface, movement of the single finger along the touch input interface while continuing to detect the continuous touch.

公开(公告)号：US11825065B2

公开(公告)日：2023-11-21

申请号：US17950761

申请日：2022-09-22

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: H04N13/128 ,  G06T19/00 ,  H04N13/239 ,  G06T7/593 ,  G06T7/571 ,  H04N13/111 ,  H04L67/131 ,  H04N13/00

CPC classification number: H04N13/128 ,  G06T7/571 ,  G06T7/593 ,  G06T19/006 ,  H04L67/131 ,  H04N13/111 ,  H04N13/239 ,  G06T2200/24 ,  G06T2207/30201 ,  H04N2013/0081

Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.

公开(公告)号：US20230362318A1

公开(公告)日：2023-11-09

申请号：US18224228

申请日：2023-07-20

Applicant: Snap Inc

Inventor： Kyle Goodrich ,  Sanuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: H04N5/262 ,  H04L51/046 ,  H04N5/272 ,  H04L51/10

CPC classification number: H04N5/2621 ,  H04L51/046 ,  H04N5/2628 ,  H04N5/272 ,  H04L51/10

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image from a camera of a user device; receiving input that selects a user-customizable effects option for activating a user-customizable effects mode; in response to receiving the input, displaying an array of a plurality of effect options together with the image proximate to the user-customizable effects option; and applying a first effect associated with a first effect option of the plurality of effect options to the image.

公开(公告)号：US11809633B2

公开(公告)日：2023-11-07

申请号：US17249857

申请日：2021-03-16

Applicant: Snap Inc.

Inventor： Dylan Shane Eirinberg ,  Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G09G5/00 ,  G06F3/01 ,  G06F3/0482 ,  G06T7/20 ,  G06F3/04815 ,  G06V40/10

CPC classification number: G06F3/017 ,  G06F3/011 ,  G06F3/0482 ,  G06F3/04815 ,  G06T7/20 ,  G06V40/107 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2207/30241

Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; identifying a finger of a hand of the user in the video feed; determining a direction within the video feed to which the finger is pointing; and accessing a first menu option based on the direction within the video feed to which the finger is pointing.

公开(公告)号：US20230343004A1

公开(公告)日：2023-10-26

申请号：US17662745

申请日：2022-05-10

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Pedram Javidpour ,  Maxim Maximov Lazarov ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06T11/60 ,  H04N5/232 ,  H04N5/225

CPC classification number: G06T11/60 ,  H04N5/23216 ,  H04N5/2258

Abstract: Methods and systems are disclosed for generating AR experiences on a messaging platform. The methods and systems perform operations including: detecting a real-world object depicted in a first image captured by a first camera of a client device, the client device comprising a second camera; extracting one or more textures from the real-world object depicted in the first image; selecting a target object depicted in a second image captured by the second camera, the second image being captured by the second camera simultaneously with the first image captured by the first camera; generating an augmented reality (AR) element comprising the target object modified based on the one or more textures extracted from the real-world object depicted in the first image; and causing display of the AR element within the second image.

公开(公告)号：US11782577B2

公开(公告)日：2023-10-10

申请号：US17410814

申请日：2021-08-24

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06F3/0482 ,  G06F3/04847 ,  G06F3/0488

CPC classification number: G06F3/0482 ,  G06F3/0488 ,  G06F3/04847 ,  G06F2203/04808

Abstract: Systems and methods are provided for performing operations comprising: displaying, by one or more processors of an eyewear device, a plurality of media content control options; detecting, by a touch input interface of the eyewear device, a first touch input comprising a single finger touching the touch input interface; based on detecting the first touch input, causing a cursor to track the first touch input to navigate through the plurality of media content control options; based on detecting that the single finger has not been released from touching the touch input interface, displaying a second media content control option related to the first media content control option; and performing a selection associated with the second media content control option based on movement of the single finger along the touch input interface.

公开(公告)号：US20230316683A1

公开(公告)日：2023-10-05

申请号：US18207013

申请日：2023-06-07

Applicant: Snap Inc

Inventor： Samuel Edward Hare ,  Andrew James McPhee ,  Tony Mathew

IPC: G06T19/00 ,  G06T7/70 ,  H04N9/87 ,  G11B27/036 ,  G06F3/04817 ,  G06F3/04845

CPC classification number: G06T19/006 ,  G06T7/70 ,  H04N9/8715 ,  G11B27/036 ,  G06F3/04817 ,  G06F3/04845 ,  G06F3/0488

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering a three-dimensional virtual object in a video clip. The method and system include capturing, using a camera-enabled device, video content of a real-world scene and movement information collected by the camera-enabled device during capture of the video content. The captured video and movement information are stored. The stored captured video content is processed to identify a real-world object in the scene. An interactive augmented reality display is generated that: adds a virtual object to the stored video content to create augmented video content comprising the real-world scene and the virtual object; and adjusts, during playback of the augmented video content, an on-screen position of the virtual object within the augmented video content based at least in part on the stored movement information.

公开(公告)号：US11776233B2

公开(公告)日：2023-10-03

申请号：US17878635

申请日：2022-08-01

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/20 ,  G06N20/00 ,  G06F3/04842 ,  G06F3/04883 ,  G06T15/50 ,  G06T7/507 ,  G06V40/16

CPC classification number: G06T19/20 ,  G06F3/04842 ,  G06F3/04883 ,  G06N20/00 ,  G06T7/507 ,  G06T15/50 ,  G06V40/171 ,  G06T2219/2012 ,  G06T2219/2024

Abstract: The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.

公开(公告)号：US11775165B2

公开(公告)日：2023-10-03

申请号：US17530181

申请日：2021-11-18

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06T19/20 ,  G06T7/194 ,  G06K9/32 ,  G06F3/0488 ,  G06T7/73 ,  G06F3/04817 ,  G06F3/04847 ,  G06F3/04815 ,  G06V10/20 ,  G06V20/20 ,  G06V40/16

CPC classification number: G06F3/0488 ,  G06F3/04815 ,  G06F3/04817 ,  G06F3/04847 ,  G06T7/194 ,  G06T7/74 ,  G06T19/006 ,  G06T19/20 ,  G06V10/255 ,  G06V20/20 ,  G06V40/161 ,  G06T2200/24 ,  G06T2207/30201 ,  G06T2210/22

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image generated by a camera of a user; displaying an option to crop an object depicted in the image, determining whether the object is depicted in the image; selectively enabling selection of the option to crop the object based on determining whether the object is depicted in the image; receiving input that selects the option to crop an object depicted in the image when the option is enabled; in response to receiving the input, segmenting the image to separate the object from other portions depicted in the image; extracting the object from the image; and adding the extracted object to a new image as a virtual object.

公开(公告)号：US11748957B2

公开(公告)日：2023-09-05

申请号：US17525612

申请日：2021-11-12

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/00 ,  G06T7/194 ,  G06T7/50 ,  H04L67/131

CPC classification number: G06T19/006 ,  G06T7/194 ,  G06T7/50 ,  H04L67/131 ,  G06T2207/10028 ,  G06T2207/30201

Abstract: The subject technology receives image data and depth data. The subject technology selects an augmented reality content generator corresponding to a three-dimensional (3D) effect. The subject technology applies the 3D effect to the image data and the depth data based at least in part on the selected augmented reality content generator. The subject technology generates, using a processor, a message including information related to the applied 3D effect, the image data, and the depth data.