公开(公告)号：US20200074738A1

公开(公告)日：2020-03-05

申请号：US16242708

申请日：2019-01-08

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Andrew James McPhee ,  Tony Mathew

IPC: G06T19/00 ,  G06T7/70 ,  H04N9/87 ,  G11B27/036 ,  G06F3/0484 ,  G06F3/0481

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering a three-dimensional virtual object in a video clip. The method and system include capturing, using a camera-enabled device, video content of a real-world scene and movement information collected by the camera-enabled device during capture of the video content. The captured video and movement information are stored. The stored captured video content is processed to identify a real-world object in the scene. An interactive augmented reality display is generated that: adds a virtual object to the stored video content to create augmented video content comprising the real-world scene and the virtual object; and adjusts, during playback of the augmented video content, an on-screen position of the virtual object within the augmented video content based at least in part on the stored movement information.

公开(公告)号：US20190325561A1

公开(公告)日：2019-10-24

申请号：US16392138

申请日：2019-04-23

Applicant: Snap Inc.

Inventor： Shah Tanmay Anilkumar ,  Samuel Edward Hare ,  Guohui Wang

IPC: G06T3/40 ,  G06T5/50 ,  G06T7/11 ,  G06T7/174

Abstract: Systems and methods are provided for initiating transfer of image data corresponding to at least one predetermined level of an image pyramid comprising higher resolution to a graphic processing unit (GPU) of the computing device, calculating, by the central processing unit (CPU) of the computing device, optical flow of at least one predetermined coarse level of the image pyramid, transferring, by the CPU of the computing device, the calculated optical flow of the at least one predetermined coarse level of the image pyramid to the GPU, calculating, by the GPU of the computing device, the optical flow of the at least one predetermined level of the image pyramid comprising higher resolution, and outputting, by the GPU of the computing device, the optical flow of the image data.

公开(公告)号：US10402689B1

公开(公告)日：2019-09-03

申请号：US15706057

申请日：2017-09-15

Applicant: Snap Inc.

Inventor： Lidiia Bogdanovych ,  William Brendel ,  Samuel Edward Hare ,  Fedir Poliakov ,  Guohui Wang ,  Xuehan Xiong ,  Jianchao Yang ,  Linjie Yang

IPC: G06T7/11 ,  G06K9/62 ,  G06K9/74 ,  G06T7/194 ,  G06N3/08 ,  G06N3/04 ,  G06K9/68 ,  H04N7/14 ,  H04N5/445 ,  H04N5/76

Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.

公开(公告)号：US10242503B2

公开(公告)日：2019-03-26

申请号：US15863575

申请日：2018-01-05

Applicant: Snap Inc.

Inventor： Andrew James McPhee ,  Ebony James Charlton ,  Samuel Edward Hare ,  Michael John Evans ,  Jokubas Dargis ,  Ricardo Sanchez-Saez

IPC: G06T19/00 ,  G06T15/60 ,  G06F3/0346 ,  G06T15/20 ,  G06F3/01

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real world, and the three-dimensional virtual object can exist similarly for multiple users. Virtual object rendering can be with respect to a reference surface in a real world environment, which reference surface can be selected by a user as part of the virtual object rendering process.

公开(公告)号：US20180197343A1

公开(公告)日：2018-07-12

申请号：US15863575

申请日：2018-01-05

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Andrew James McPhee

IPC: G06T19/00 ,  G06T15/20 ,  G06F3/0346 ,  G06T15/60

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06F3/0346 ,  G06T15/205 ,  G06T15/60

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real world, and the three-dimensional virtual object can exist similarly for multiple users. Virtual object rendering can be with respect to a reference surface in a real world environment, which reference surface can be selected by a user as part of the virtual object rendering process.

公开(公告)号：US20180114364A1

公开(公告)日：2018-04-26

申请号：US15792347

申请日：2017-10-24

Applicant: Snap Inc

Inventor： Andrew James McPhee ,  Samuel Edward Hare ,  Peicheng Yu ,  Robert Cornelius Murphy ,  Dhritiman Sagar

IPC: G06T19/00 ,  G06F11/08 ,  G06F3/01 ,  G06T15/20 ,  A63F13/211

Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.

公开(公告)号：US20180075651A1

公开(公告)日：2018-03-15

申请号：US15816795

申请日：2017-11-17

Applicant: Snap Inc.

Inventor： Samuel Edward Hare ,  Ebony James Charlton ,  Andrew James McPhee ,  Michael John Evans

IPC: G06T17/20 ,  G06K9/00 ,  G06T7/55 ,  G06F3/0484 ,  G06F3/0481 ,  G06F3/01

CPC classification number: G06T17/20 ,  G06K9/00201 ,  G06K9/00261 ,  G06K9/00912 ,  G06T7/55 ,  G06T2200/08 ,  G06T2200/24 ,  G06T2207/30201

Abstract: In various example embodiments, a system and methods are presented for generation and manipulation of three dimensional (3D) models. The system and methods cause presentation of an interface frame encompassing a field of view of an image capture device. The systems and methods detect an object of interest within the interface frame, generate a movement instruction with respect to the object of interest, and detect a first change in position and a second change in position of the object of interest. The systems and methods generate a 3D model of the object of interest based on the first change in position and the second change in position.