公开(公告)号：US20240048678A1

公开(公告)日：2024-02-08

申请号：US18489688

申请日：2023-10-18

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: H04N13/128 ,  G06T19/00 ,  H04N13/239 ,  G06T7/593 ,  G06T7/571 ,  H04N13/111 ,  H04L67/131

CPC classification number: H04N13/128 ,  G06T19/006 ,  H04N13/239 ,  G06T7/593 ,  G06T7/571 ,  H04N13/111 ,  H04L67/131 ,  H04N2013/0081

Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.

公开(公告)号：US11836859B2

公开(公告)日：2023-12-05

申请号：US17506478

申请日：2021-10-20

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Andrew James McPhee ,  Daniel Moreno ,  Kyle Goodrich

IPC: G06T17/20 ,  G06T15/04 ,  G06T19/20 ,  G06T7/246 ,  G06T3/20 ,  G06T3/40 ,  G06T7/20 ,  G06T11/60 ,  G06T13/20 ,  G06T15/00 ,  G06T19/00

CPC classification number: G06T17/20 ,  G06T3/20 ,  G06T3/40 ,  G06T7/20 ,  G06T7/251 ,  G06T11/60 ,  G06T13/20 ,  G06T15/00 ,  G06T15/04 ,  G06T19/006 ,  G06T19/20 ,  G06F2218/00 ,  G06T2219/2004 ,  G06T2219/2012 ,  G06T2219/2016

Abstract: Systems and methods are provided for receiving a two-dimensional (2D) image comprising a 2D object; identifying a contour of the 2D object; generating a three-dimensional (3D) mesh based on the contour of the 2D object; and applying a texture of the 2D object to the 3D mesh to output a 3D object representing the 2D object.

公开(公告)号：US20230316649A1

公开(公告)日：2023-10-05

申请号：US18195012

申请日：2023-05-09

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Andrew James McPhee ,  Daniel Moreno ,  Kyle Goodrich

IPC: G06T17/20 ,  G06T15/04 ,  G06T19/20 ,  G06T7/246 ,  G06T3/20 ,  G06T3/40 ,  G06T7/20 ,  G06T11/60 ,  G06T13/20 ,  G06T15/00 ,  G06T19/00

CPC classification number: G06T17/20 ,  G06T3/20 ,  G06T3/40 ,  G06T7/20 ,  G06T7/251 ,  G06T11/60 ,  G06T13/20 ,  G06T15/00 ,  G06T15/04 ,  G06T19/006 ,  G06T19/20 ,  G06F2218/00 ,  G06T2219/2004 ,  G06T2219/2012 ,  G06T2219/2016

Abstract: Systems and methods are provided for receiving a two-dimensional (2D) image comprising a 2D object; identifying a contour of the 2D object; generating a three-dimensional (3D) mesh based on the contour of the 2D object; and applying a texture of the 2D object to the 3D mesh to output a 3D object representing the 2D object.

公开(公告)号：US20230245401A1

公开(公告)日：2023-08-03

申请号：US18132940

申请日：2023-04-10

Applicant: Snap Inc.

Inventor： Andrew James McPhee ,  Ebony James Charlton ,  Samuel Edward Hare ,  Michael John Evans ,  Jokubas Dargis ,  Ricardo Sanchez-Saez

IPC: G06T19/00 ,  G06T15/60 ,  G06F3/0346 ,  G06T15/20 ,  G06F3/01

CPC classification number: G06T19/006 ,  G06T15/60 ,  G06F3/0346 ,  G06T15/205 ,  G06F3/011

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real-world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real-world through utilization of a redundant tracking system comprising multiple tracking sub-systems. Virtual object rendering can be with respect to a reference surface in a real-world three-dimensional space depicted in a camera view of a mobile computing device.

公开(公告)号：US11645843B2

公开(公告)日：2023-05-09

申请号：US17248393

申请日：2021-01-22

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Fedir Poliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang ,  Shah Tanmay Anilkumar

IPC: G06V20/40 ,  G06T7/246 ,  G06T1/20

CPC classification number: G06V20/40 ,  G06T1/20 ,  G06T7/248 ,  G06V20/46 ,  G06T2200/28 ,  G06T2207/10016 ,  G06T2207/20081

Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.

公开(公告)号：US11620791B2

公开(公告)日：2023-04-04

申请号：US17319399

申请日：2021-05-13

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/20 ,  G06T17/20 ,  G06T15/04 ,  G06K9/00 ,  G06T7/246 ,  G06T3/20 ,  G06T3/40 ,  G06T7/20 ,  G06T11/60 ,  G06T13/20 ,  G06T15/00 ,  G06T19/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.

公开(公告)号：US11580698B2

公开(公告)日：2023-02-14

申请号：US17319399

申请日：2021-05-13

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/20 ,  G06T17/20 ,  G06T15/04 ,  G06K9/00 ,  G06T7/246 ,  G06T3/20 ,  G06T3/40 ,  G06T7/20 ,  G06T11/60 ,  G06T13/20 ,  G06T15/00 ,  G06T19/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.

公开(公告)号：US20230037233A1

公开(公告)日：2023-02-02

申请号：US17963090

申请日：2022-10-10

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Wentao Shang

IPC: G06T19/00 ,  G06T7/194 ,  G06T7/11 ,  G06F3/01 ,  G06T15/20 ,  G06T19/20

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for rendering virtual modifications to real-world environments depicted in image content. A reference surface is detected in a three-dimensional (3D) space captured within a camera feed produced by a camera of a computing device. An image mask is applied to the reference surface within the 3D space captured within the camera feed. A visual effect is applied to the image mask corresponding to the reference surface in the 3D space. The application of the visual effect to the image mask causes a modified surface to be rendered in presenting the camera feed on a display of the computing device.

公开(公告)号：US11532133B2

公开(公告)日：2022-12-20

申请号：US16949922

申请日：2020-11-20

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Jokubas Dargis ,  Michael John Evans ,  Samuel Edward Hare ,  Andrew James McPhee ,  Robert Cornelius Murphy ,  Eitan Pilipski

IPC: G06T19/20 ,  G06T19/00 ,  G06F3/16

Abstract: Systems and methods for receiving audio data; identifying one or more graphical interface elements that correspond to the audio data; generating a display of the identified one or more graphical interface elements, wherein a first portion of the one or more graphical interface elements is persistently displayed, and wherein a second portion of the one or more graphical interface elements is temporarily displayed for a predetermined period of time together with the first portion of the one or more graphical interface elements; and at expiry of the predetermined period of time, ceasing display of the second portion while maintaining display of the first portion.

公开(公告)号：US20220375178A1

公开(公告)日：2022-11-24

申请号：US17817491

申请日：2022-08-04

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Andrew James McPhee ,  Maxim Maximov Lazarov ,  Wentao Shang ,  Kyle Goodrich ,  Tony Mathew

IPC: G06T19/00 ,  G06T19/20 ,  H04L51/04 ,  H04N5/247 ,  H04N5/272

Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.