-
公开(公告)号:US11636657B2
公开(公告)日:2023-04-25
申请号:US17528697
申请日:2021-11-17
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06T19/20 , G06F3/04883 , G06F3/01 , G06T15/80
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.
-
公开(公告)号:US11625895B2
公开(公告)日:2023-04-11
申请号:US17386998
申请日:2021-07-28
Applicant: Snap Inc.
Inventor: Piers George Cowburn , Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , David Li , Tony Mathew , Andrew James McPhee , Daniel Moreno , Isac Andreas Müller Sandvik , Wentao Shang
Abstract: Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.
-
公开(公告)号:US20230024608A1
公开(公告)日:2023-01-26
申请号:US17816563
申请日:2022-08-01
Applicant: Snap Inc.
Inventor: Guohui Wang , Fenglei Tian , Samuel Edward Hare , Sumant Milind Hanumante , Tony Mathew
Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer software and systems by facilitating the automatic performance optimization of a software application based on the particular platform upon which the application runs. In some embodiments, the system can automatically choose a set of parameters or methods at run-time from a design space with pre-selected optimization methods and parameters (e.g., algorithms, software libraries, and/or hardware accelerators) for a specific task.
-
公开(公告)号:US11288879B2
公开(公告)日:2022-03-29
申请号:US15929374
申请日:2020-04-29
Applicant: Snap Inc.
Inventor: Travis Chen , Samuel Edward Hare , Yuncheng Li , Tony Mathew , Jonathan Solichin , Jianchao Yang , Ning Zhang
Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.
-
公开(公告)号:US20220076500A1
公开(公告)日:2022-03-10
申请号:US17530181
申请日:2021-11-18
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06T19/20 , G06T7/194 , G06T7/73 , G06K9/32 , G06K9/46 , G06F3/0481 , G06F3/0488 , G06F3/0484
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image generated. by a camera of a user; displaying an option to crop an object depicted in the image; determining whether the object is depicted in the image; selectively enabling selection of the option to crop the object based on determining whether the object is depicted in the image; receiving input that selects the option to crop an object depicted in the image when the option is enabled; in response to receiving the input, segmenting the image to separate the object from other portions depicted in the image; extracting the object from the image; and adding the extracted object to a new image as a virtual object.
-
公开(公告)号:US20220076497A1
公开(公告)日:2022-03-10
申请号:US17528697
申请日:2021-11-17
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06T15/80 , G06F3/01 , G06T19/20 , G06F3/0488
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.
-
公开(公告)号:US11263817B1
公开(公告)日:2022-03-01
申请号:US16721418
申请日:2019-12-19
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/0488 , G06F3/0484 , G06T19/20 , H04L12/58 , G06F3/01 , G06F3/04883 , G06F3/04847 , H04L51/10
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by one or more processors that implement a messaging application, a video feed from a camera of a user device; detecting, by the messaging application, a face in the video feed; in response to detecting the face in the video feed, retrieving a three-dimensional (3D) caption; modifying the video feed to include the 3D caption at a position in 3D space of the video feed proximate to the face; and displaying a modified video feed that includes the face and the 3D caption.
-
公开(公告)号:US11217020B2
公开(公告)日:2022-01-04
申请号:US15929355
申请日:2020-04-28
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T17/00 , G06T3/00 , G06T19/00 , G06T19/20 , G06T7/194 , G06T7/73 , G06K9/32 , G06K9/46 , G06F3/0481 , G06F3/0488 , G06F3/0484
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, an image generated by a camera of a user; displaying an option to crop an object depicted in the image; determining whether the object is depicted in the image; selectively enabling selection of the option to crop the object based on determining whether the object is depicted in the image; receiving input that selects the option to crop an object depicted in the image when the option is enabled; in response to receiving the input, segmenting the image to separate the object from other portions depicted in the image; extracting the object from the image; and adding the extracted object to a new image as a virtual object.
-
公开(公告)号:US20210358215A1
公开(公告)日:2021-11-18
申请号:US17386998
申请日:2021-07-28
Applicant: Snap Inc.
Inventor: Piers George Cowburn , Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , David Li , Tony Mathew , Andrew James Mcphee , Daniel Moreno , Isac Andreas Müller Sandvik , Wentao Shang
Abstract: Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.
-
公开(公告)号:US11030813B2
公开(公告)日:2021-06-08
申请号:US16242708
申请日:2019-01-08
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Andrew James McPhee , Tony Mathew
IPC: G06T19/00 , G06T7/70 , H04N9/87 , G11B27/036 , G06F3/0481 , G06F3/0484 , G06F3/0488
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering a three-dimensional virtual object in a video clip. The method and system include capturing, using a camera-enabled device, video content of a real-world scene and movement information collected by the camera-enabled device during capture of the video content. The captured video and movement information are stored. The stored captured video content is processed to identify a real-world object in the scene. An interactive augmented reality display is generated that: adds a virtual object to the stored video content to create augmented video content comprising the real-world scene and the virtual object; and adjusts, during playback of the augmented video content, an on-screen position of the virtual object within the augmented video content based at least in part on the stored movement information.
-
-
-
-
-
-
-
-
-