公开(公告)号：US11488358B2

公开(公告)日：2022-11-01

申请号：US16782874

申请日：2020-02-05

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan ,  Matan Zohar

IPC: G06T19/00 ,  G06T7/73 ,  H04L65/1069 ,  H04L65/1089 ,  G06V40/10

Abstract: Methods and systems are disclosed for creating a shared augmented reality (AR) session. The methods and systems perform operations comprising: receiving, by a second device, a request to join an AR session initialized by a first device; in response to receiving the request, detecting a body corresponding to a user of the first device in one or more images captured by a camera of the second device; identifying a body part of the detected body corresponding to the user of the first device; determining, by the second device, a transformation in the AR session between the first device and the second device using the identified body part; and causing the AR session to be displayed by the second device based on the determined transformation.

公开(公告)号：US11481932B2

公开(公告)日：2022-10-25

申请号：US17373035

申请日：2021-07-12

Applicant: Snap Inc.

Inventor： David Li ,  Piers George Cowburn ,  Isac Andreas Müller Sandvik ,  Qi Pan

IPC: G06T11/00 ,  G06T15/04 ,  G06F3/04845

Abstract: Example embodiments described herein relate to an augmented-reality system to generate and cause display of interactive augmented reality content at a client device.

公开(公告)号：US20220148309A1

公开(公告)日：2022-05-12

申请号：US17584946

申请日：2022-01-26

Applicant: Snap Inc.

Inventor： David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan ,  Rastan Boroujerdi ,  Kevin Yimeng Hong ,  Peng Deng ,  Piers George Cowburn ,  Jonathan Tang ,  Junjie Wei

IPC: G06V20/20 ,  G06F3/01 ,  G09G3/00 ,  G06T19/00 ,  G06T7/73

Abstract: An augmented reality system to perform operations that include: accessing image data at a client device; determining a position of a user of the client device based on the image data; causing display of a projection that extends from the position of the user upon a presentation of the image data at the client device; detecting an intersection of the projection and a surface of an object; generating a request that includes an identification of the portion of the surface of the object at the client device; and presenting the portion of the surface of the object based on the graphical property of the projection at the client device in response to the request that includes the identification of the portion of the surface of the object.

公开(公告)号：US20210358215A1

公开(公告)日：2021-11-18

申请号：US17386998

申请日：2021-07-28

Applicant: Snap Inc.

Inventor： Piers George Cowburn ,  Kyle Goodrich ,  Samuel Edward Hare ,  Maxim Maximov Lazarov ,  David Li ,  Tony Mathew ,  Andrew James Mcphee ,  Daniel Moreno ,  Isac Andreas Müller Sandvik ,  Wentao Shang

IPC: G06T17/20 ,  G06T19/20 ,  G06T11/20

Abstract: Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.

公开(公告)号：US20210073572A1

公开(公告)日：2021-03-11

申请号：US16566474

申请日：2019-09-10

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan

IPC: G06K9/62 ,  G06T7/90 ,  H04W4/021 ,  G06T19/00 ,  H04L12/58 ,  H04W4/30

Abstract: An occlusion detection system to perform operations that include: capturing image data that depicts an environment at a client device, the environment including a target object at a position within the environment; causing display of a presentation of the environment at the client device, the presentation of the environment including a display of the target object at the position within the environment; detecting a first attribute of the display of the target object at the client device; performing a comparison of the first attribute of the display of the target object and a second attribute associated with the target object; and detecting an occlusion based on the comparison.

公开(公告)号：US10810782B1

公开(公告)日：2020-10-20

申请号：US16372215

申请日：2019-04-01

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan

IPC: G06T15/04 ,  G06T17/20 ,  G06K9/72 ,  G06T7/11 ,  G06K9/62

Abstract: A semantic texture map system to generate a semantic texture map based on a 3D model that comprises a plurality of vertices that include coordinate that indicate positions of the plurality of vertices, a UV map, and a semantic segmentation image that comprises a set of semantic labels.

公开(公告)号：US20200309558A1

公开(公告)日：2020-10-01

申请号：US16365256

申请日：2019-03-26

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan

IPC: G01C21/36 ,  H04W4/021 ,  G06T19/00 ,  H04W4/029 ,  G06K9/00

Abstract: Example embodiments described herein therefore relate to an AR guidance system to perform operations that include: detecting a client device at a location within a geo-fenced area, wherein the geo-fenced area may include within it, a destination of interest; determining a route to the destination of interest from the location of the client device within the geo-fenced area; causing display of a presentation of an environment within an AR interface at the client device; detecting a display of real-world signage within the presentation of the environment; generating a media item in response to the detecting the display of the signage within the presentation of the environment, wherein the media item is based on the route to the destination of interest; and causing display of the media item within the AR interface based on the position of the signage within the presentation of the environment.

公开(公告)号：US20200250858A1

公开(公告)日：2020-08-06

申请号：US16566379

申请日：2019-09-10

Applicant: Snap Inc.

Inventor： David Li ,  Piers Cowburn ,  Isac Andreas Müller Sandvik ,  Qi Pan

IPC: G06T11/00 ,  G06T15/04

Abstract: Example embodiments described herein relate to an augmented-reality system to generate and cause display of interactive augmented reality content at a client device.

公开(公告)号：US12266062B2

公开(公告)日：2025-04-01

申请号：US18133469

申请日：2023-04-11

Applicant: Snap Inc.

Inventor： Piers George Cowburn ,  Qi Pan ,  Isac Andreas Müller Sandvik

IPC: G06T19/00 ,  G06F3/0482 ,  G06F3/04842 ,  G06T1/00 ,  G06T15/20 ,  G06T19/20 ,  H04L67/01 ,  H04L67/131 ,  H04L67/52

Abstract: An augmented reality system to generate and cause display of a presentation of a space at a first client device, receive one or more selections of points within the presentation of the space at the first client device, and render graphical elements at the one or more points within the presentation of the space at the first client device. The augmented reality system is further configured to receive a display request to display the space at a second client device, and in response, may render a second presentation of the space at the second client device, wherein the second presentation of the space includes the graphical elements at the one or more points.

公开(公告)号：US12198376B2

公开(公告)日：2025-01-14

申请号：US18144171

申请日：2023-05-06

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan ,  Matan Zohar

IPC: G06T7/73 ,  G06F3/01 ,  G06T19/00

Abstract: Method for creating marker-based shared augmented reality (AR) session starts with initializing a shared AR session by a first device and by a second device. The first device displays on a display a marker. The second device detects the marker using a camera included in the second device and captures an image of the marker using the camera. The second device determines a transformation between the first device and the second device using the image of the marker. A common coordinate frame is then determined using the transformation, the shared AR session is generated using the common coordinate frame, and the shared AR session is caused to be displayed by the first device and by the second device. Other embodiments are described herein.