-
公开(公告)号:US10964114B2
公开(公告)日:2021-03-30
申请号:US16457461
申请日:2019-06-28
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Andrew James McPhee , Maxim Maximov Lazarov , Wentao Shang , Kyle Goodrich , Tony Mathew
Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
-
公开(公告)号:US10803664B2
公开(公告)日:2020-10-13
申请号:US16853356
申请日:2020-04-20
Applicant: Snap Inc.
Inventor: Andrew James McPhee , Samuel Edward Hare , Peicheng Yu , Robert Cornelius Murphy , Dhritiman Sagar
IPC: G06T19/00 , G06T7/246 , G06F3/03 , G06F3/038 , A63F13/211 , G06F3/01 , G06F11/08 , G06T15/20 , G06F3/0346
Abstract: A redundant tracking system comprising multiple redundant tracking sub-systems, enabling seamless transitions between such tracking sub-systems, provides a solution to this problem by merging multiple tracking approaches into a single tracking system. This system is able to combine tracking objects with six degrees of freedom (6DoF) and 3DoF through combining and transitioning between multiple tracking systems based on the availability of tracking indicia tracked by the tracking systems. Thus, as the indicia tracked by any one tracking system becomes unavailable, the redundant tracking system seamlessly switches between tracking in 6DoF and 3DoF thereby providing the user with an uninterrupted experience.
-
公开(公告)号:US10776663B1
公开(公告)日:2020-09-15
申请号:US16521956
申请日:2019-07-25
Applicant: Snap Inc.
Inventor: Lidiia Bogdanovych , William Brendel , Samuel Edward Hare , Fedir Poliakov , Guohui Wang , Xuehan Xiong , Jianchao Yang , Linjie Yang
IPC: G06K9/62 , G06T7/11 , G06T7/194 , G06N3/08 , G06N3/04 , G06K9/68 , G06K9/74 , H04N5/76 , H04N5/445 , H04N7/14
Abstract: A machine learning system can generate an image mask (e.g., a pixel mask) comprising pixel assignments for pixels. The pixels can be assigned to classes, including, for example, face, clothes, body skin, or hair. The machine learning system can be implemented using a convolutional neural network that is configured to execute efficiently on computing devices having limited resources, such as mobile phones. The pixel mask can be used to more accurately display video effects interacting with a user or subject depicted in the image.
-
公开(公告)号:US20200213534A1
公开(公告)日:2020-07-02
申请号:US16815804
申请日:2020-03-11
Applicant: Snap Inc.
Inventor: Ebony James Charlton , Michael John Evans , Samuel Edward Hare , Andrew James McPhee , Robert Cornelius Murphy , Eitan Pilipski
Abstract: Systems, devices, media and methods are presented for presentation of modified objects within a video stream. The systems and methods select an object of interest depicted within a user interface based on an associated image modifier, determine a modifier context based at least in part on one or more characteristics of the selected object, identify a set of image modifiers based on the modifier context, rank a first portion of the identified set of image modifiers based on a primary ordering characteristic, rank a second portion of the identified set of image modifiers based on a secondary ordering characteristic and cause presentation of the modifier icons for the ranked set of image modifiers.
-
公开(公告)号:US20200066037A1
公开(公告)日:2020-02-27
申请号:US16674892
申请日:2019-11-05
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Ebony James Chariton , Andrew James McPhee , Michael John Evans
Abstract: In various example embodiments, a system and methods are presented for generation and manipulation of three dimensional (3D) models. The system and methods cause presentation of an interface frame encompassing a field of view of an image capture device. The systems and methods detect an object of interest within the interface frame, generate a movement instruction with respect to the object of interest, and detect a first change in position and a second change in position of the object of interest. The systems and methods generate a 3D model of the object of interest based on the first change in position and the second change in position.
-
公开(公告)号:US20190188920A1
公开(公告)日:2019-06-20
申请号:US16283482
申请日:2019-02-22
Applicant: Snap Inc.
Inventor: Andrew James McPhee , Ebony James Charlton , Samuel Edward Hare , Michael John Evans , Jokubas Dargis , Ricardo Sanchez-Saez
IPC: G06T19/00 , G06T15/20 , G06F3/01 , G06T15/60 , G06F3/0346
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real-world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real-world through utilization of a redundant tracking system comprising multiple tracking sub-systems. Virtual object rendering can be with respect to a reference surface in a real-world three-dimensional space depicted in a camera view of a mobile computing device.
-
公开(公告)号:US20250086909A1
公开(公告)日:2025-03-13
申请号:US18955887
申请日:2024-11-21
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/04815 , G06F3/0482 , G06F3/0488 , G06T5/77
Abstract: The subject technology generates a segmentation mask based on first image data. The subject technology applies the segmentation mask on first depth data to reduce a set of artifacts in a depth map based on the first depth data. The subject technology generates a packed depth map based at least in part on the depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels. The subject technology applies, to the first image data and the first depth data, a first augmented reality content generator corresponding to a selected first selectable graphical item, the first image data and the first depth data being captured with a camera. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.
-
公开(公告)号:US12231804B2
公开(公告)日:2025-02-18
申请号:US18221778
申请日:2023-07-13
Applicant: Snap Inc.
Inventor: Ebony James Charlton , Michael John Evans , Samuel Edward Hare , Andrew James McPhee , Robert Cornelius Murphy , Eitan Pilipski
Abstract: Systems, devices, media and methods are presented for presentation of modified objects within a video stream. The systems and methods select an object of interest depicted within a user interface based on an associated image modifier, determine a modifier context based at least in part on one or more characteristics of the selected object, identify a set of image modifiers based on the modifier context, rank a first portion of the identified set of image modifiers based on a primary ordering characteristic, rank a second portion of the identified set of image modifiers based on a secondary ordering characteristic and cause presentation of the modifier icons for the ranked set of image modifiers.
-
公开(公告)号:US20240362873A1
公开(公告)日:2024-10-31
申请号:US18763468
申请日:2024-07-03
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
CPC classification number: G06T19/006 , G06T15/00
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.
-
公开(公告)号:US11908093B2
公开(公告)日:2024-02-20
申请号:US18121893
申请日:2023-03-15
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06T19/20 , G06F3/04883 , G06F3/01 , G06T15/80
CPC classification number: G06T19/006 , G06F3/012 , G06F3/04883 , G06T15/80 , G06T19/20 , G06T2219/2004
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for performing operations comprising: receiving, by a messaging application, a video feed from a camera of a user device that depicts a face; receiving a request to add a 3D caption to the video feed; identifying a graphical element that is associated with context of the 3D caption; and displaying the 3D caption and the identified graphical element in the video feed at a position in 3D space of the video feed proximate to the face depicted in the video feed.
-
-
-
-
-
-
-
-
-