公开(公告)号：US20200250888A1

公开(公告)日：2020-08-06

申请号：US16853356

申请日：2020-04-20

Applicant: Snap Inc

Inventor： Andrew James McPhee ,  Samuel Edward Hare ,  Peicheng Yu ,  Robert Cornelius Murphy ,  Dhritiman Sagar

IPC: G06T19/00 ,  G06T7/246 ,  G06F3/03 ,  G06F3/038 ,  G06F3/0346 ,  A63F13/211 ,  G06F3/01 ,  G06F11/08 ,  G06T15/20

Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.

公开(公告)号：US20200167995A1

公开(公告)日：2020-05-28

申请号：US16460519

申请日：2019-07-02

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Andrew James McPhee ,  Daniel Moreno ,  Kyle Goodrich

IPC: G06T17/20 ,  G06T15/04 ,  G06T19/20 ,  G06T7/246 ,  G06K9/00

Abstract: Systems and methods are provided for receiving a two-dimensional (2D) image comprising a 2D object; identifying a contour of the 2D object; generating a three-dimensional (3D) mesh based on the contour of the 2D object; and applying a texture of the 2D object to the 3D mesh to output a 3D object representing the 2D object.

公开(公告)号：US10593116B2

公开(公告)日：2020-03-17

申请号：US15581994

申请日：2017-04-28

Applicant: Snap Inc.

Inventor： Ozi Egri ,  David Ben Ezra ,  Andrew James McPhee ,  Qi Pan ,  Eyal Zak

IPC: G06T19/00 ,  G06T19/20 ,  G06F3/0481

Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow different virtual objects to be moved onto different physical surfaces, as well as manipulated in other ways.

公开(公告)号：US20180210628A1

公开(公告)日：2018-07-26

申请号：US15804550

申请日：2017-11-06

Applicant: Snap Inc.

Inventor： Andrew James McPhee ,  Trevor Stephenson ,  Pedram Javidpour ,  Ebony James Charlton

IPC: G06F3/0481 ,  G06F3/0488 ,  G06T19/00 ,  G06T19/20

CPC classification number: G06F3/04815 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0346 ,  G06F3/04845 ,  G06F3/0488 ,  G06F3/04883 ,  G06T19/006 ,  G06T19/20 ,  G06T2219/2021 ,  G06T2219/2024

Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow virtual objects to be moved relative to a real-world environment and manipulated in other ways.

公开(公告)号：US20180131878A1

公开(公告)日：2018-05-10

申请号：US15806021

申请日：2017-11-07

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Michael John Evans ,  Samuel Edward Hare ,  Andrew James McPhee ,  Robert Cornelius Murphy ,  Eitan Pilipski

IPC: H04N5/272 ,  H04N5/232

CPC classification number: H04N5/272 ,  G11B27/11 ,  G11B27/34 ,  H04N5/23216 ,  H04N5/23293 ,  H04N5/232933

Abstract: Systems, devices, media, and methods are presented for presentation of modified objects within a video stream. The systems and methods receive a selection at a user interface of a computing device and determine a modifier context based at least in part on the selection and a position within the user interface. The systems and methods identify at least one set of modifiers based on the modifier context. The systems and methods determine an order for the set of modifiers based on the modifier context and cause presentation of modifier icons for the set of modifiers within the user interface.

公开(公告)号：US12283276B2

公开(公告)日：2025-04-22

申请号：US17646271

申请日：2021-12-28

Applicant: Snap Inc.

Inventor： Alex Edelsburg ,  Kyle Goodrich ,  Pedram Javidpour ,  Andrew James McPhee ,  Daniel Moreno ,  Jeremy Baker Voss

IPC: G06F3/04886 ,  G06F3/0481 ,  G06F3/04883 ,  G06F3/16 ,  G10L15/26 ,  H04L51/10

Abstract: A messaging system, which hosts a backend service for an associated messaging client application, includes a voice notes system that addresses the technical problem of serving an audio message to the recipient in a manner that permits the recipient to consume the message in a text format as a transcription. A chat user interface (UI) provided with the voice notes system permits a user to play an audio message or request generation of the transcription of the audio message on-demand to prevent unnecessary cluttering of the UI real estate.

公开(公告)号：US20250078427A1

公开(公告)日：2025-03-06

申请号：US18950395

申请日：2024-11-18

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lavarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/04847 ,  G06F3/04883 ,  G06T19/20 ,  H04L51/10

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by one or more processors that implement a messaging application, a video feed from a camera of a user device; detecting, by the messaging application, a face in the video feed; in response to detecting the face in the video feed, retrieving a three-dimensional (3D) caption; modifying the video feed to include the 3D caption at a position in 3D space of the video feed proximate to the face; and displaying a modified video feed that includes the face and the 3D caption.

公开(公告)号：US12231609B2

公开(公告)日：2025-02-18

申请号：US18489688

申请日：2023-10-18

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: H04N13/128 ,  G06T7/571 ,  G06T7/593 ,  G06T19/00 ,  H04L67/131 ,  H04N13/00 ,  H04N13/111 ,  H04N13/239

Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.

公开(公告)号：US12175613B2

公开(公告)日：2024-12-24

申请号：US18375693

申请日：2023-10-02

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/01 ,  G06F3/04847 ,  G06F3/04883 ,  G06T19/20 ,  H04L51/10

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by one or more processors that implement a messaging application, a video feed from a camera of a user device; detecting, by the messaging application, a face in the video feed; in response to detecting the face in the video feed, retrieving a three-dimensional (3D) caption; modifying the video feed to include the 3D caption at a position in 3D space of the video feed proximate to the face; and displaying a modified video feed that includes the face and the 3D caption.

公开(公告)号：US12106441B2

公开(公告)日：2024-10-01

申请号：US18073280

申请日：2022-12-01

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06T15/00

CPC classification number: G06T19/006 ,  G06T15/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.