公开(公告)号：US11107279B1

公开(公告)日：2021-08-31

申请号：US16832992

申请日：2020-03-27

Applicant: Snap Inc.

Inventor： Piers George Cowburn ,  Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  David Li ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Isac Andreas Müller Sandvik ,  Wentao Shang

IPC: G06T17/20 ,  G06T19/20 ,  G06T11/20

Abstract: Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.

公开(公告)号：US20210258511A1

公开(公告)日：2021-08-19

申请号：US15929484

申请日：2020-05-05

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: H04N5/262 ,  H04L12/58 ,  H04N5/272

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image from a camera of a user device; receiving input that selects a user-customizable effects option for activating a user-customizable effects mode; in response to receiving the input, displaying an array of a plurality of effect options together with the image proximate to the user-customizable effects option; and applying a first effect associated with a first effect option of the plurality of effect options to the image.

公开(公告)号：US20210074074A1

公开(公告)日：2021-03-11

申请号：US16747318

申请日：2020-01-20

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/20 ,  G06T19/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for rendering a virtual object in a real-world environment depicted in image content based on contextual information. A virtual object template is selected. One or more stylizations for the virtual object template are determined based on contextual information associated with a computing device. A virtual object is generated by applying the one or more stylizations to the virtual object template. The virtual object is rendered within a 3D space captured within a camera feed of the computing device.

公开(公告)号：US20200258313A1

公开(公告)日：2020-08-13

申请号：US15929374

申请日：2020-04-29

Applicant: Snap Inc.

Inventor： Travis Chen ,  Samuel Edward Hare ,  Yuncheng Li ,  Tony Mathew ,  Jonathan Solichin ,  Jianchao Yang ,  Ning Zhang

IPC: G06T19/20 ,  G06T7/20 ,  G06T19/00 ,  G06T7/73 ,  G06K9/32 ,  G06K9/00

Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.

公开(公告)号：US20200074738A1

公开(公告)日：2020-03-05

申请号：US16242708

申请日：2019-01-08

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Andrew James McPhee ,  Tony Mathew

IPC: G06T19/00 ,  G06T7/70 ,  H04N9/87 ,  G11B27/036 ,  G06F3/0484 ,  G06F3/0481

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering a three-dimensional virtual object in a video clip. The method and system include capturing, using a camera-enabled device, video content of a real-world scene and movement information collected by the camera-enabled device during capture of the video content. The captured video and movement information are stored. The stored captured video content is processed to identify a real-world object in the scene. An interactive augmented reality display is generated that: adds a virtual object to the stored video content to create augmented video content comprising the real-world scene and the virtual object; and adjusts, during playback of the augmented video content, an on-screen position of the virtual object within the augmented video content based at least in part on the stored movement information.