公开(公告)号：US20230386157A1

公开(公告)日：2023-11-30

申请号：US18450193

申请日：2023-08-15

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/00 ,  G06T7/194 ,  G06T7/50 ,  H04L67/131

CPC classification number: G06T19/006 ,  G06T7/194 ,  G06T7/50 ,  H04L67/131 ,  G06T2207/30201 ,  G06T2207/10028

Abstract: The subject technology applies a three-dimensional (3D) effect to image data and depth data based at least in part on an augmented reality content generator. The subject technology generates a segmentation mask based at least on the image data. The subject technology performs background inpainting and blurring of the image data using at least the segmentation mask to generate background inpainted image data. The subject technology generates a packed depth map based at least in part on the a depth map of the depth data. The subject technology generates, using the processor, a message including information related to the applied 3D effect, the image data, and the depth data.

公开(公告)号：US20230362322A1

公开(公告)日：2023-11-09

申请号：US18221778

申请日：2023-07-13

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Michael John Evans ,  Samuel Edward Hare ,  Andrew James McPhee ,  Robert Cornelius Murphy ,  Eitan Pilipski

IPC: H04N5/272 ,  G11B27/34 ,  G11B27/11 ,  H04N23/62 ,  H04N23/63

CPC classification number: H04N5/272 ,  G11B27/34 ,  G11B27/11 ,  H04N23/62 ,  H04N23/631 ,  H04N23/635

Abstract: Systems, devices, media and methods are presented for presentation of modified objects within a video stream. The systems and methods select an object of interest depicted within a user interface based on an associated image modifier, determine a modifier context based at least in part on one or more characteristics of the selected object, identify a set of image modifiers based on the modifier context, rank a first portion of the identified set of image modifiers based on a primary ordering characteristic, rank a second portion of the identified set of image modifiers based on a secondary ordering characteristic and cause presentation of the modifier icons for the ranked set of image modifiers.

公开(公告)号：US11783556B2

公开(公告)日：2023-10-10

申请号：US18056099

申请日：2022-11-16

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/0482 ,  G06F3/0488 ,  G06T5/00 ,  G06F3/04815

CPC classification number: G06T19/006 ,  G06F3/0482 ,  G06F3/0488 ,  G06F3/04815 ,  G06T5/005 ,  G06T2207/10028

Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.

公开(公告)号：US20230281930A1

公开(公告)日：2023-09-07

申请号：US18144058

申请日：2023-05-05

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Dhritiman Sagar ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/04842 ,  G06T7/50 ,  H04L51/42

CPC classification number: G06T19/00 ,  G06F3/04842 ,  G06T7/50 ,  H04L51/42 ,  G06T2207/20084

Abstract: The subject technology generates depth data using a machine learning model based at least in part on captured image data from at least one camera of a client device. The subject technology applies, to the captured image data and the generated depth data, a 3D effect based at least in part on an augmented reality content generator. The subject technology generates a depth map using at least the depth data. The subject technology generates a packed depth map based at least in part on the depth map, the generating the packed depth map. The subject technology converts a single channel floating point texture to a raw depth map. The subject technology generates multiple channels based at least in part on the raw depth map. The subject technology generates a segmentation mask based at least on the captured image data. The subject technology performs background inpainting and blurring of the captured image data using at least the segmentation mask to generate background inpainted image data.

公开(公告)号：US11750767B2

公开(公告)日：2023-09-05

申请号：US17644501

申请日：2021-12-15

Applicant: Snap Inc.

Inventor： Ebony James Charlton ,  Michael John Evans ,  Samuel Edward Hare ,  Andrew James McPhee ,  Robert Cornelius Murphy ,  Eitan Pilipski

IPC: H04N5/272 ,  G11B27/34 ,  G11B27/11 ,  H04N23/62 ,  H04N23/63

CPC classification number: H04N5/272 ,  G11B27/11 ,  G11B27/34 ,  H04N23/62 ,  H04N23/631 ,  H04N23/635

Abstract: Systems, devices, media and methods are presented for presentation of modified objects within a video stream. The systems and methods select an object of interest depicted within a user interface based on an associated image modifier, determine a modifier context based at least in part on one or more characteristics of the selected object, identify a set of image modifiers based on the modifier context, rank a first portion of the identified set of image modifiers based on a primary ordering characteristic, rank a second portion of the identified set of image modifiers based on a secondary ordering characteristic and cause presentation of the modifier icons for the ranked set of image modifiers.

公开(公告)号：US11704878B2

公开(公告)日：2023-07-18

申请号：US17505370

申请日：2021-10-19

Applicant: Snap Inc.

Inventor： Andrew James McPhee ,  Ebony James Charlton ,  Samuel Edward Hare ,  Michael John Evans ,  Jokubas Dargis ,  Ricardo Sanchez-Saez

IPC: G06T19/00 ,  G06T15/20 ,  G06T15/60 ,  G06F3/0346 ,  G06F3/01

CPC classification number: G06T19/006 ,  G06F3/011 ,  G06F3/0346 ,  G06T15/205 ,  G06T15/60

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for rendering three-dimensional virtual objects within real-world environments. Virtual rendering of a three-dimensional virtual object can be altered appropriately as a user moves around the object in the real-world through utilization of a redundant tracking system comprising multiple tracking sub-systems. Virtual object rendering can be with respect to a reference surface in a real-world three-dimensional space depicted in a camera view of a mobile computing device.

公开(公告)号：US20230142438A1

公开(公告)日：2023-05-11

申请号：US18150041

申请日：2023-01-04

Applicant: Snap Inc.

Inventor： Ozi Egri ,  David Ben Ezra ,  Andrew James McPhee ,  Qi Pan ,  Eyal Zak

IPC: G06T19/00 ,  G06F3/04815 ,  G06T19/20

CPC classification number: G06T19/006 ,  G06F3/04815 ,  G06T19/20 ,  G06T2219/2004

Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow different virtual objects to be moved onto different physical surfaces, as well as manipulated in other ways.

公开(公告)号：US20230136013A1

公开(公告)日：2023-05-04

申请号：US17514314

申请日：2021-10-29

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Christie Marie Heikkinen ,  Pedram Javidpour ,  Andrew James McPhee ,  Daniel Moreno

IPC: G06T13/40 ,  G06T13/80 ,  G06F3/0482 ,  G06T11/60 ,  H04L12/58

Abstract: Methods and systems are disclosed for performing operations for generating a custom sticker. The operations include receiving, by a messaging application implemented on a first device, an image. The operations include receiving, by the messaging application, input that selects a region of the image. The operations include generating, by the messaging application, a graphical element comprising the region of the image selected by the input. The operations include applying, by the messaging application, one or more visual effects to the graphical element. The operations include causing the graphical element to be animated according to a given animation pattern selected from a plurality of animation patterns to generate an animated custom graphic. The operations include sending the animated custom graphic with the one or more visual effects from the first device to a second device.

公开(公告)号：US20230073310A1

公开(公告)日：2023-03-09

申请号：US18056099

申请日：2022-11-16

Applicant: Snap Inc.

Inventor： Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  Tony Mathew ,  Andrew James McPhee ,  Daniel Moreno ,  Wentao Shang

IPC: G06T19/00 ,  G06F3/0482 ,  G06F3/0488 ,  G06T5/00 ,  G06F3/04815

Abstract: The subject technology selects a set of augmented reality content generators from available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect. The subject technology causes display of a carousel interface including selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator. The subject technology receives a selection of a first selectable graphical item from the selectable graphical items, the first selectable graphical item including a first augmented reality content generator for applying a first 3D effect. The subject technology applies, to first image data and first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item. The subject technology generates a message including the applied first augmented reality content generator to the first image data and the first depth data.

公开(公告)号：US11580700B2

公开(公告)日：2023-02-14

申请号：US16790322

申请日：2020-02-13

Applicant: Snap Inc.

Inventor： Ozi Egri ,  David Ben Ezra ,  Andrew James McPhee ,  Qi Pan ,  Eyal Zak

IPC: G06T19/20 ,  G06T19/00 ,  G06F3/0481 ,  G06F3/04815

Abstract: Among other things, embodiments of the present disclosure improve the functionality of computer imaging software and systems by facilitating the manipulation of virtual content displayed in conjunction with images of real-world objects and environments. Embodiments of the present disclosure allow different virtual objects to be moved onto different physical surfaces, as well as manipulated in other ways.