-
公开(公告)号:US20210358215A1
公开(公告)日:2021-11-18
申请号:US17386998
申请日:2021-07-28
Applicant: Snap Inc.
Inventor: Piers George Cowburn , Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , David Li , Tony Mathew , Andrew James Mcphee , Daniel Moreno , Isac Andreas Müller Sandvik , Wentao Shang
Abstract: Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.
-
公开(公告)号:US11030813B2
公开(公告)日:2021-06-08
申请号:US16242708
申请日:2019-01-08
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Andrew James McPhee , Tony Mathew
IPC: G06T19/00 , G06T7/70 , H04N9/87 , G11B27/036 , G06F3/0481 , G06F3/0484 , G06F3/0488
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering a three-dimensional virtual object in a video clip. The method and system include capturing, using a camera-enabled device, video content of a real-world scene and movement information collected by the camera-enabled device during capture of the video content. The captured video and movement information are stored. The stored captured video content is processed to identify a real-world object in the scene. An interactive augmented reality display is generated that: adds a virtual object to the stored video content to create augmented video content comprising the real-world scene and the virtual object; and adjusts, during playback of the augmented video content, an on-screen position of the virtual object within the augmented video content based at least in part on the stored movement information.
-
公开(公告)号:US20210065464A1
公开(公告)日:2021-03-04
申请号:US17006471
申请日:2020-08-28
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/20 , G06N20/00 , G06F3/0484 , G06F3/0488 , G06T7/507 , G06T15/50 , G06K9/00
Abstract: The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.
-
公开(公告)号:US20210065454A1
公开(公告)日:2021-03-04
申请号:US17006438
申请日:2020-08-28
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
Abstract: The subject technology receives image data and depth data. The subject technology selects an augmented reality content generator corresponding to a three-dimensional (3D) effect. The subject technology applies the 3D effect to the image data and the depth data based at least in part on the selected augmented reality content generator. The subject technology generates, using a processor, a message including information related to the applied 3D effect, the image data, and the depth data.
-
公开(公告)号:US10901714B1
公开(公告)日:2021-01-26
申请号:US16535935
申请日:2019-08-08
Applicant: Snap Inc.
Inventor: Guohui Wang , Fenglei Tian , Samuel Edward Hare , Sumant Hanumante , Tony Mathew
Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer software and systems by facilitating the automatic performance optimization of a software application based on the particular platform upon which the application runs. In some embodiments, the system can automatically choose a set of parameters or methods at run-time from a design space with pre-selected optimization methods and parameters (e.g., algorithms, software libraries, and/or hardware accelerators) for a specific task.
-
公开(公告)号:US20200050866A1
公开(公告)日:2020-02-13
申请号:US16654898
申请日:2019-10-16
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US10445936B1
公开(公告)日:2019-10-15
申请号:US15666349
申请日:2017-08-01
Applicant: Snap Inc.
Inventor: Ebony James Charlton , Jokubas Dargis , Michael John Evans , Samuel Edward Hare , Andrew James McPhee , Robert Cornelius Murphy , Eitan Pilipski
Abstract: Systems, devices, media, and methods are presented for generating responsive augmented reality elements in a graphical user interface. The systems and methods receive a video stream having one or more frames containing image data and audio data. The systems and methods identify a set of coordinates within a portion of the one or more frames and identify one or more audio characteristics within the audio data of the video stream. In response to the one or more audio characteristics, the systems and methods generate one or more graphical interface elements and detect a change in the audio data within the video stream. The systems and methods modify the one or more graphical interface elements in a second portion of the video stream in response to the change in the audio data.
-
公开(公告)号:US20190087660A1
公开(公告)日:2019-03-21
申请号:US15706096
申请日:2017-09-15
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang , Shah Tanmay Anilkumar
Abstract: A mobile device can generate real-time complex visual image effects using asynchronous processing pipeline. A first pipeline applies a complex image process, such as a neural network, to keyframes of a live image sequence. A second pipeline generates flow maps that describe feature transformations in the image sequence. The flow maps can be used to process non-keyframes on the fly. The processed keyframes and non-keyframes can be used to display a complex visual effect on the mobile device in real-time or near real-time.
-
公开(公告)号:US20250078427A1
公开(公告)日:2025-03-06
申请号:US18950395
申请日:2024-11-18
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lavarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/01 , G06F3/04847 , G06F3/04883 , G06T19/20 , H04L51/10
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by one or more processors that implement a messaging application, a video feed from a camera of a user device; detecting, by the messaging application, a face in the video feed; in response to detecting the face in the video feed, retrieving a three-dimensional (3D) caption; modifying the video feed to include the 3D caption at a position in 3D space of the video feed proximate to the face; and displaying a modified video feed that includes the face and the 3D caption.
-
公开(公告)号:US12231609B2
公开(公告)日:2025-02-18
申请号:US18489688
申请日:2023-10-18
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: H04N13/128 , G06T7/571 , G06T7/593 , G06T19/00 , H04L67/131 , H04N13/00 , H04N13/111 , H04N13/239
Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.
-
-
-
-
-
-
-
-
-