-
公开(公告)号:US20230386157A1
公开(公告)日:2023-11-30
申请号:US18450193
申请日:2023-08-15
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/00 , G06T7/194 , G06T7/50 , H04L67/131
CPC classification number: G06T19/006 , G06T7/194 , G06T7/50 , H04L67/131 , G06T2207/30201 , G06T2207/10028
Abstract: The subject technology applies a three-dimensional (3D) effect to image data and depth data based at least in part on an augmented reality content generator. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a packed depth map based at least in part on the a depth map of the depth data. The subject technology generates, using the processor, a message including information related to the applied 3D effect, the image data, and the depth data.
-
公开(公告)号:US11783556B2
公开(公告)日:2023-10-10
申请号:US18056099
申请日:2022-11-16
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/0482 , G06F3/0488 , G06T5/00 , G06F3/04815
CPC classification number: G06T19/006 , G06F3/0482 , G06F3/0488 , G06F3/04815 , G06T5/005 , G06T2207/10028
Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.
-
公开(公告)号:US20230281930A1
公开(公告)日:2023-09-07
申请号:US18144058
申请日:2023-05-05
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/00 , G06F3/04842 , G06T7/50 , H04L51/42
CPC classification number: G06T19/00 , G06F3/04842 , G06T7/50 , H04L51/42 , G06T2207/20084
Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.
-
公开(公告)号:US20230073310A1
公开(公告)日:2023-03-09
申请号:US18056099
申请日:2022-11-16
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/0482 , G06F3/0488 , G06T5/00 , G06F3/04815
Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.
-
公开(公告)号:US20230005233A1
公开(公告)日:2023-01-05
申请号:US17878635
申请日:2022-08-01
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/20 , G06N20/00 , G06F3/04842 , G06F3/04883 , G06T15/50 , G06T7/507 , G06V40/16
Abstract: The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.
-
公开(公告)号:US11443491B2
公开(公告)日:2022-09-13
申请号:US17249092
申请日:2021-02-19
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Andrew James McPhee , Maxim Maximov Lazarov , Wentao Shang , Kyle Goodrich , Tony Mathew
Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
-
公开(公告)号:US11410401B2
公开(公告)日:2022-08-09
申请号:US17006471
申请日:2020-08-28
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/20 , G06N20/00 , G06F3/04842 , G06F3/04883 , G06T15/50 , G06T7/507 , G06V40/16
Abstract: The subject technology receives a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator for applying a 3D effect, the 3D effect including at least one beautification operation. The subject technology captures image data and depth data using a camera. The subject technology applies, to the image data and the depth data, the 3D effect including the at least one beautification operation based at least in part on the augmented reality content generator, the beautification operation being performed as part of applying the 3D effect. The subject technology generates a 3D message based at least in part on the applied 3D effect including the at least one beautification operation. The subject technology renders a view of the 3D message based at least in part on the applied 3D effect including the at least one beautification operation.
-
公开(公告)号:US20220172448A1
公开(公告)日:2022-06-02
申请号:US17651524
申请日:2022-02-17
Applicant: Snap Inc.
Inventor: Travis Chen , Samuel Edward Hare , Yuncheng Li , Tony Mathew , Jonathan Solichin , Jianchao Yang , Ning Zhang
Abstract: Systems, devices, media, and methods are presented for object detection and inserting graphical elements into an image stream in response to detecting the object. The systems and methods detect an object of interest in received frames of a video stream. The systems and methods identify a bounding box for the object of interest and estimate a three-dimensional position of the object of interest based on a scale of the object of interest. The systems and methods generate one or more graphical elements having a size based on the scale of the object of interest and a position based on the three-dimensional position estimated for the object of interest. The one or more graphical elements are generated within the video stream to form a modified video stream. The systems and methods cause presentation of the modified video stream including the object of interest and the one or more graphical elements.
-
公开(公告)号:US11210850B2
公开(公告)日:2021-12-28
申请号:US16696600
申请日:2019-11-26
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T17/20 , G06T15/04 , G06T19/20 , G06K9/00 , G06T7/246 , G06T3/20 , G06T3/40 , G06T7/20 , G06T11/60 , G06T13/20 , G06T15/00 , G06T19/00
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.
-
公开(公告)号:US20210319625A1
公开(公告)日:2021-10-14
申请号:US17301735
申请日:2021-04-13
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/0482 , G06F3/0481 , G06F3/0488 , G06T5/00
Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.
-
-
-
-
-
-
-
-
-