-
公开(公告)号:US11189098B2
公开(公告)日:2021-11-30
申请号:US16457461
申请日:2019-06-28
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Andrew James McPhee , Maxim Maximov Lazarov , Wentao Shang , Kyle Goodrich , Tony Mathew
Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
-
公开(公告)号:US20210256773A1
公开(公告)日:2021-08-19
申请号:US17307354
申请日:2021-05-04
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Andrew James McPhee , Tony Mathew
IPC: G06T19/00 , G06T7/70 , H04N9/87 , G11B27/036 , G06F3/0481 , G06F3/0484
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering a three-dimensional virtual object in a video clip. The method and system include capturing, using a camera-enabled device, video content of a real-world scene and movement information collected by the camera-enabled device during capture of the video content. The captured video and movement information are stored. The stored captured video content is processed to identify a real-world object in the scene. An interactive augmented reality display is generated that: adds a virtual object to the stored video content to create augmented video content comprising the real-world scene and the virtual object and adjusts, during playback of the augmented video content, an on-screen position of the virtual object within the augmented video content based at least in part on the stored movement information.
-
公开(公告)号:US20210224050A1
公开(公告)日:2021-07-22
申请号:US17135365
申请日:2020-12-28
Applicant: Snap Inc.
Inventor: Guohui Wang , Fenglei Tian , Samuel Edward Hare , Sumant Hanumante , Tony Mathew
Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer software and systems by facilitating the automatic performance optimization of a software application based on the particular platform upon which the application runs. In some embodiments, the system can automatically choose a set of parameters or methods at run-time from a design space with pre-selected optimization methods and parameters (e.g., algorithms, software libraries, and/or hardware accelerators) for a specific task.
-
公开(公告)号:US10964114B2
公开(公告)日:2021-03-30
申请号:US16457461
申请日:2019-06-28
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Andrew James McPhee , Maxim Maximov Lazarov , Wentao Shang , Kyle Goodrich , Tony Mathew
Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
-
公开(公告)号:US12211159B2
公开(公告)日:2025-01-28
申请号:US18380577
申请日:2023-10-16
Applicant: Snap Inc.
Inventor: Samuel Edward Hare , Andrew James McPhee , Maxim Maximov Lazarov , Wentao Shang , Kyle Goodrich , Tony Mathew
Abstract: Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.
-
公开(公告)号:US12182951B2
公开(公告)日:2024-12-31
申请号:US18240373
申请日:2023-08-31
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/00 , G06F3/04815 , G06F3/0482 , G06F3/0488 , G06T5/77
Abstract: The subject technology generates a segmentation mask based on first image data. The subject technology applies the segmentation mask on first depth data to reduce a set of artifacts in a depth map based on the first depth data. The subject technology generates a packed depth map based at least in part on the depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels. The subject technology applies, to the first image data and the first depth data, a first augmented reality content generator corresponding to a selected first selectable graphical item, the first image data and the first depth data being captured with a camera. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.
-
公开(公告)号:US11961189B2
公开(公告)日:2024-04-16
申请号:US18144058
申请日:2023-05-05
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: G06T19/00 , G06F3/0482 , G06F3/04842 , G06T7/50 , H04L51/42
CPC classification number: G06T19/00 , G06F3/04842 , G06T7/50 , H04L51/42 , G06T2207/20084
Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.
-
公开(公告)号:US20240048678A1
公开(公告)日:2024-02-08
申请号:US18489688
申请日:2023-10-18
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Dhritiman Sagar , Wentao Shang
IPC: H04N13/128 , G06T19/00 , H04N13/239 , G06T7/593 , G06T7/571 , H04N13/111 , H04L67/131
CPC classification number: H04N13/128 , G06T19/006 , H04N13/239 , G06T7/593 , G06T7/571 , H04N13/111 , H04L67/131 , H04N2013/0081
Abstract: The subject technology receives, at a client device, a selection of a selectable graphical item from a plurality of selectable graphical items, the selectable graphical item comprising an augmented reality content generator including a 3D effect. The subject technology applies, to image data and depth data, the 3D effect based at least in part on the augmented reality content generator, the applying the 3D effect. The subject technology generates a depth map using at least the depth data, generates a segmentation mask based at least on the image data, and performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a 3D message based at least in part on the applied 3D effect.
-
公开(公告)号:US20230342988A1
公开(公告)日:2023-10-26
申请号:US17728494
申请日:2022-04-25
Applicant: Snap Inc.
Inventor: Kevin Yimeng Hong , Amar Boghani , Mansoor Basha Patan , Tony Mathew , Rastan Boroujerdi , Peng Deng
IPC: G06T11/00 , G06F3/0482 , G06F3/01
CPC classification number: G06T11/00 , G06F3/0482 , G06F3/011 , G06T2200/24
Abstract: Methods and systems are disclosed for generating AR experiences on a messaging platform. The methods and systems establish a shared augmented reality (AR) experience across a plurality of client devices and receive, from a first client device of the plurality of client devices, a request to perform a real-time interaction with a given AR element that is presented on displays of the plurality of client devices. In response to receiving the request, the methods and system enable the first client device to perform one or more modifications to the given AR element while preventing a second of the plurality of client devices from performing real-time interactions with the given AR element. The method and system synchronize the one or more modifications of the given AR element performed by the first client device across each of the plurality of client devices in real time.
-
公开(公告)号:US11620791B2
公开(公告)日:2023-04-04
申请号:US17319399
申请日:2021-05-13
Applicant: Snap Inc.
Inventor: Kyle Goodrich , Samuel Edward Hare , Maxim Maximov Lazarov , Tony Mathew , Andrew James McPhee , Daniel Moreno , Wentao Shang
IPC: G06T19/20 , G06T17/20 , G06T15/04 , G06K9/00 , G06T7/246 , G06T3/20 , G06T3/40 , G06T7/20 , G06T11/60 , G06T13/20 , G06T15/00 , G06T19/00
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and method for rendering three-dimensional captions (3D) in real-world environments depicted in image content. An editing interface is displayed on a client device. The editing interface includes an input component displayed with a view of a camera feed. A first input comprising one or more text characters is received. In response to receiving the first input, a two-dimensional (2D) representation of the one or more text characters is displayed. In response to detecting a second input, a preview interface is displayed. Within the preview interface, a 3D caption based on the one or more text characters is rendered at a position in a 3D space captured within the camera feed. A message is generated that includes the 3D caption rendered at the position in the 3D space captured within the camera feed.
-
-
-
-
-
-
-
-
-