公开(公告)号：US20210074069A1

公开(公告)日：2021-03-11

申请号：US16949922

申请日：2020-11-20

Applicant: Snap Inc

Inventor： Ebony James Charlton ,  Jokubas Dargis ,  Michael John Evans ,  Samuel Edward Hare ,  Andrew James McPhee ,  Robert Cornelius Murphy ,  Eitan Pilipski

IPC: G06T19/00 ,  G06T19/20 ,  G06F3/16

Abstract: Systems and methods for receiving audio data; identifying one or more graphical interface elements that correspond to the audio data; generating a display of the identified one or more graphical interface elements, wherein a first portion of the one or more graphical interface elements is persistently displayed, and wherein a second portion of the one or more graphical interface elements is temporarily displayed for a predetermined period of time together with the first portion of the one or more graphical interface elements; and at expiry of the predetermined period of time, ceasing display of the second portion while maintaining display of the first portion.

公开(公告)号：US20210067756A1

公开(公告)日：2021-03-04

申请号：US17006507

申请日：2020-08-28

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: H04N13/128 ,  G06T19/00 ,  H04L29/06 ,  H04N13/239 ,  H04N13/111 ,  G06T7/593 ,  G06T7/571

Abstract: The subject technology selects a set of augmented reality content generators from a plurality of available augmented reality content generator based on metadata associated with each respective augmented reality content generator. The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology captures image data and depth data using at least one camera of the client device. The subject technology applies, to the image data and the depth data, the 3D effect based at least in part on the augmented reality content generator

公开(公告)号：US20200327734A1

公开(公告)日：2020-10-15

申请号：US16696600

申请日：2019-11-26

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazerov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06T15/00 ,  G06T13/20 ,  G06T11/60 ,  G06T19/20 ,  G06T7/20 ,  G06T3/40 ,  G06T3/20

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.

公开(公告)号：US20200250888A1

公开(公告)日：2020-08-06

申请号：US16853356

申请日：2020-04-20

Applicant: Snap Inc

Inventor： Andrew James McPhee ,  Samuel Edward Hare ,  Peicheng Yu ,  Robert Cornelius Murphy ,  Dhritiman Sagar

IPC: G06T19/00 ,  G06T7/246 ,  G06F3/03 ,  G06F3/038 ,  G06F3/0346 ,  A63F13/211 ,  G06F3/01 ,  G06F11/08 ,  G06T15/20

Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.

公开(公告)号：US20200167995A1

公开(公告)日：2020-05-28

申请号：US16460519

申请日：2019-07-02

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Andrew James McPhee ,  Daniel Moreno ,  Kyle Goodrich

IPC: G06T17/20 ,  G06T15/04 ,  G06T19/20 ,  G06T7/246 ,  G06K9/00

Abstract: Systems and methods are provided for receiving a two-dimensional (2D) image comprising a 2D object; identifying a contour of the 2D object; generating a three-dimensional (3D) mesh based on the contour of the 2D object; and applying a texture of the 2D object to the 3D mesh to output a 3D object representing the 2D object.

公开(公告)号：US20180131878A1

公开(公告)日：2018-05-10

申请号：US15806021

申请日：2017-11-07

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Michael John Evans ,  Samuel Edward Hare ,  Andrew James McPhee ,  Robert Cornelius Murphy ,  Eitan Pilipski

IPC: H04N5/272 ,  H04N5/232

CPC classification number: H04N5/272 ,  G11B27/11 ,  G11B27/34 ,  H04N5/23216 ,  H04N5/23293 ,  H04N5/232933

Abstract: Systems, devices, media, and methods are presented for presentation of modified objects within a video stream. The systems and methods receive a selection at a user interface of a computing device and determine a modifier context based at least in part on the selection and a position within the user interface. The systems and methods identify at least one set of modifiers based on the modifier context. The systems and methods determine an order for the set of modifiers based on the modifier context and cause presentation of modifier icons for the set of modifiers within the user interface.

公开(公告)号：US20250097376A1

公开(公告)日：2025-03-20

申请号：US18967192

申请日：2024-12-03

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Michael John Evans ,  Samuel Edward Hare ,  Andrew James McPhee ,  Robert Cornelius Murphy ,  Eitan Pilipski

IPC: H04N5/272 ,  G11B27/11 ,  G11B27/34 ,  H04N23/62 ,  H04N23/63

Abstract: Systems, devices, media and methods are presented for presentation of modified objects within a video stream. The systems and methods select an object of interest depicted within a user interface based on an associated image modifier, determine a modifier context based at least in part on one or more characteristics of the selected object, identify a set of image modifiers based on the modifier context, rank a first portion of the identified set of image modifiers based on a primary ordering characteristic, rank a second portion of the identified set of image modifiers based on a secondary ordering characteristic and cause presentation of the modifier icons for the ranked set of image modifiers.

公开(公告)号：US20240404208A1

公开(公告)日：2024-12-05

申请号：US18805005

申请日：2024-08-14

Applicant: Snap Inc.

Inventor： Andrew James McPhee ,  Samuel Edward Hare ,  Peicheng Yu ,  Robert Cornelius Murphy ,  Dhritiman Sagar

IPC: G06T19/00 ,  A63F13/211 ,  G06F3/01 ,  G06F3/03 ,  G06F3/0346 ,  G06F3/038 ,  G06F11/08 ,  G06T7/246 ,  G06T15/20

Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.

公开(公告)号：US12075190B2

公开(公告)日：2024-08-27

申请号：US18221702

申请日：2023-07-13

Applicant: Snap Inc.

Inventor： Lidiia Bogdanovych ,  William Brendel ,  Samuel Edward Hare ,  Fedir Poliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang

IPC: G06T7/11 ,  G06F18/214 ,  G06F18/24 ,  G06N3/04 ,  G06N3/08 ,  G06T7/194 ,  G06V10/82 ,  G06V30/19 ,  G06V30/242 ,  H04N7/14 ,  H04N5/445 ,  H04N5/76

CPC classification number: H04N7/147 ,  G06F18/214 ,  G06F18/24765 ,  G06N3/04 ,  G06N3/08 ,  G06T7/11 ,  G06T7/194 ,  G06V10/82 ,  G06V30/19173 ,  G06V30/242 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20024 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221 ,  G06T2207/30201 ,  H04N5/44504 ,  H04N5/76 ,  H04N7/141

Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.

公开(公告)号：US11830209B2

公开(公告)日：2023-11-28

申请号：US17651524

申请日：2022-02-17

Applicant: Snap Inc.

Inventor： Travis Chen ,  Samuel Edward Hare ,  Yuncheng Li ,  Tony Mathew ,  Jonathan Solichin ,  Jianchao Yang ,  Ning Zhang

IPC: G06T7/50 ,  G06T19/20 ,  G06T7/20 ,  G06T19/00 ,  G06T7/73 ,  G06V10/20 ,  G06V20/20 ,  G06V20/40 ,  G06V10/764 ,  G06V20/64

CPC classification number: G06T7/50 ,  G06T7/20 ,  G06T7/73 ,  G06T19/006 ,  G06T19/20 ,  G06V10/255 ,  G06V10/764 ,  G06V20/20 ,  G06V20/40 ,  G06V20/64 ,  G06T2207/10016 ,  G06T2207/20084 ,  G06T2210/12 ,  G06T2219/2016

Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.