-
公开(公告)号:US11734959B2
公开(公告)日:2023-08-22
申请号:US17249845
申请日:2021-03-16
Applicant: Snap Inc.
Inventor: Dylan Shane Eirinberg , Kyle Goodrich , Andrew James McPhee , Daniel Moreno
CPC classification number: G06V40/28 , G02B27/0172 , G06F3/011 , G06V40/23 , G09G5/10 , H04N23/611 , H04N23/632 , G02B2027/0178 , G09G2320/0626
Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; in response to capturing the video feed, evaluating a set of conditions for activating a hands-free mode of operating the electronic mirroring device; in response to determining that the set of conditions are satisfied, activating the hands-free mode of operating the electronic mirroring device; and performing one or more functions on the electronic mirroring device based on detection of one or more gestures performed by the user in the video feed.
-
公开(公告)号:US11715268B2
公开(公告)日:2023-08-01
申请号:US17307354
申请日:2021-05-04
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Andrew James McPhee , Tony Mathew
IPC: G06T19/00 , G06T7/70 , G06F3/04817 , G06F3/04845 , G06F3/0488 , H04N9/87 , G11B27/036
CPC classification number: G06T19/006 , G06F3/04817 , G06F3/04845 , G06T7/70 , G11B27/036 , H04N9/8715 , G06F3/0488 , G06T2200/04 , G06T2200/24
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering a three-dimensional virtual object in a video clip. The method and system include capturing, using a camera-enabled device, video content of a real-world scene and movement information collected by the camera-enabled device during capture of the video content. The captured video and movement information are stored. The stored captured video content is processed to identify a real-world object in the scene. An interactive augmented reality display is generated that: adds a virtual object to the stored video content to create augmented video content comprising the real-world scene and the virtual object and adjusts, during playback of the augmented video content, an on-screen position of the virtual object within the augmented video content based at least in part on the stored movement information.
-
公开(公告)号:US20230215117A1
公开(公告)日:2023-07-06
申请号:US18121893
申请日:2023-03-15
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06T19/20 , G06T15/80 , G06F3/01 , G06F3/04883
CPC classification number: G06T19/006 , G06F3/012 , G06F3/04883 , G06T15/80 , G06T19/20 , G06T2219/2004
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.
-
公开(公告)号:US11676342B2
公开(公告)日:2023-06-13
申请号:US17952051
申请日:2022-09-23
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/00 , G06F3/04842 , G06T7/50 , H04L51/42
CPC classification number: G06T19/00 , G06F3/04842 , G06T7/50 , H04L51/42 , G06T2207/20084
Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.
-
公开(公告)号:US11657580B2
公开(公告)日:2023-05-23
申请号:US17505370
申请日:2021-10-19
Applicant: Snap Inc.
Inventor: Andrew James McPhee , Ebony James Charlton , Samuel Edward Hare , Michael John Evans , Jokubas Dargis , Ricardo Sanchez-Saez
IPC: G06T19/00 , G06T15/20 , G06T15/60 , G06F3/0346 , G06F3/01
CPC classification number: G06T19/006 , G06F3/011 , G06F3/0346 , G06T15/205 , G06T15/60
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real-world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real-world through utilization of a redundant tracking system comprising multiple tracking sub-systems. Virtual object rendering can be with respect to a reference surface in a real-world three-dimensional space depicted in a camera view of a mobile computing device.
-
公开(公告)号:US11636657B2
公开(公告)日:2023-04-25
申请号:US17528697
申请日:2021-11-17
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06T19/20 , G06F3/04883 , G06F3/01 , G06T15/80
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.
-
公开(公告)号:US11625895B2
公开(公告)日:2023-04-11
申请号:US17386998
申请日:2021-07-28
Applicant: Snap Inc.
Inventor: Piers George Cowburn , Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , David Li , Tony Mathew , Andrew James McPhee , Daniel Moreno , Isac Andreas Müller Sandvik , Wentao Shang
Abstract: Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.
-
公开(公告)号:US20230055634A1
公开(公告)日:2023-02-23
申请号:US17821741
申请日:2022-08-23
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Andrew James McPhee , Daniel Moreno
IPC: G06F3/0482 , G06F3/04847 , G06F3/0488
Abstract: Systems and methods are provided for navigating messaging application interfaces. The systems and methods include operations for: displaying, by a messaging application of a user device, a menu comprising a first set of options relating to a first level in a hierarchy of levels; detecting, by a touch sensor, one finger touch of a first option of the first set of options; in response to detecting the one finger touch of the first option, displaying, by the messaging application, a second set of options related to the first option, the second set of options relating to a second level in the hierarchy of levels; detecting, by the touch sensor, two finger touch of a second option of the second set of options; and in response to detecting the two finger touch of the second option, re-displaying, by the messaging application, the first set of options.
-
公开(公告)号:US20230005223A1
公开(公告)日:2023-01-05
申请号:US17932019
申请日:2022-09-14
Applicant: Snap Inc.
Inventor: Andrew James McPhee , Samuel Edward Hare , Peicheng Yu , Robert Cornelius Murphy , Dhritiman Sagar
IPC: G06T19/00 , G06F11/08 , G06F3/01 , G06F3/0346 , G06F3/03 , G06T7/246 , A63F13/211 , G06F3/038 , G06T15/20
Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.
-
公开(公告)号:US20220300732A1
公开(公告)日:2022-09-22
申请号:US17249855
申请日:2021-03-16
Applicant: Snap Inc.
Inventor: Dylan Shane Eirinberg , Kyle Goodrich , Andrew James McPhee , Daniel Moreno
IPC: G06K9/00 , G06F3/14 , G06F3/01 , G02B27/01 , G06F3/0482 , G06F3/0484
Abstract: Systems and methods are provided for performing operations comprising: capturing, by an electronic mirroring device, a video feed received from a camera of the electronic mirroring device, the video feed depicting a user; displaying, by one or more processors of the electronic mirroring device, one or more menu options on the video feed that depicts the user; identifying a hand of the user in the video feed; determining that a position of the hand in the video feed overlaps a position of a given menu option of the one or more menu options; and performing an operation associated with the given menu option in response to determining that the position of the hand in the video feed overlaps the position of the given menu option.
-
-
-
-
-
-
-
-
-