公开(公告)号：US11887322B2

公开(公告)日：2024-01-30

申请号：US18165201

申请日：2023-02-06

Applicant: Snap Inc.

Inventor： Piers George Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan

IPC: G06T7/536 ,  G06T19/00 ,  G06T17/00 ,  G06T7/70

CPC classification number: G06T7/536 ,  G06T7/70 ,  G06T17/00 ,  G06T19/006 ,  G06T2207/10016 ,  G06T2207/10028 ,  G06T2207/30201 ,  G06T2219/024

Abstract: Method of generating depth estimate based on biometric data starts with server receiving positioning data from first device associated with first user. First device generates positioning data based on analysis of a data stream comprising images of second user that is associated with second device. Server then receives a biometric data of second user from second device. Biometric data is based on output from a sensor or a camera included in second device. Server then determines a distance of second user from first device using positioning data and biometric data of the second user. Other embodiments are described herein.

公开(公告)号：US11776256B2

公开(公告)日：2023-10-03

申请号：US17584946

申请日：2022-01-26

Applicant: Snap Inc.

Inventor： David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan ,  Rastan Boroujerdi ,  Kevin Yimeng Hong ,  Peng Deng ,  Piers George Cowburn ,  Jonathan Tang ,  Junjie Wei

IPC: G06V20/20 ,  G06F3/01 ,  G09G3/00 ,  G06T19/00 ,  G06T7/73

CPC classification number: G06V20/20 ,  G06F3/011 ,  G06T7/74 ,  G06T19/006 ,  G09G3/003 ,  G09G2340/14 ,  G09G2354/00

Abstract: An augmented reality system to perform operations that include: accessing image data at a client device; determining a position of a user of the client device based on the image data; causing display of a projection that extends from the position of the user upon a presentation of the image data at the client device; detecting an intersection of the projection and a surface of an object; generating a request that includes an identification of the portion of the surface of the object at the client device; and presenting the portion of the surface of the object based on the graphical property of the projection at the client device in response to the request that includes the identification of the portion of the surface of the object.

公开(公告)号：US20230306208A1

公开(公告)日：2023-09-28

申请号：US18203824

申请日：2023-05-31

Applicant: Snap Inc.

Inventor： Piers George Cowburn ,  Qi Pan ,  Eitan Pilipski

IPC: G06F40/58 ,  G10L15/26 ,  G06T11/00 ,  G06F40/30 ,  G06F40/205 ,  G06T11/60 ,  G10L15/25 ,  G10L21/10 ,  G10L25/63 ,  G06V20/20 ,  G06V40/16

CPC classification number: G06F40/58 ,  G10L15/26 ,  G06T11/00 ,  G06F40/30 ,  G06F40/205 ,  G06T11/60 ,  G10L15/25 ,  G10L21/10 ,  G10L25/63 ,  G06V20/20 ,  G06V40/171 ,  G06V40/175

Abstract: Disclosed is an augmented reality system to generate and cause display of an augmented reality interface at a client device. Various embodiments may detect speech, identify a source of the speech, transcribe the speech to a text string, generate a speech bubble based on properties of the speech and that includes a presentation of the text string, and cause display of the speech bubble at a location in the augmented reality interface based on the source of the speech.

公开(公告)号：US20230274461A1

公开(公告)日：2023-08-31

申请号：US18144171

申请日：2023-05-06

Applicant: Snap Inc.

Inventor： Piers George Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan ,  Matan Zohar

IPC: G06T7/73 ,  G06F3/01 ,  G06T19/00

CPC classification number: G06T7/74 ,  G06F3/011 ,  G06T19/006 ,  G06T2207/30204 ,  G06T2219/004 ,  G06T2219/024

Abstract: Method for creating marker-based shared augmented reality (AR) session starts with initializing a shared AR session by a first device and by a second device. The first device displays on a display a marker. The second device detects the marker using a camera included in the second device and captures an image of the marker using the camera. The second device determines a transformation between the first device and the second device using the image of the marker. A common coordinate frame is then determined using the transformation, the shared AR session is generated using the common coordinate frame, and the shared AR session is caused to be displayed by the first device and by the second device. Other embodiments are described herein.

公开(公告)号：US11721025B2

公开(公告)日：2023-08-08

申请号：US17835538

申请日：2022-06-08

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan ,  Andrew Tristan Spek

IPC: G06K9/00 ,  G06T7/11 ,  G06T7/12 ,  G06T7/194 ,  G06T7/143 ,  G06T7/174

CPC classification number: G06T7/11 ,  G06T7/12 ,  G06T7/143 ,  G06T7/174 ,  G06T7/194 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Methods, systems, and devices for generating a persistent world-space ground (or floor) segmentation map (or “texture”) for use in augmented or virtual reality 3D experiences.

公开(公告)号：US20230245403A1

公开(公告)日：2023-08-03

申请号：US18133469

申请日：2023-04-11

Applicant: Snap Inc.

Inventor： Piers George Cowburn ,  Qi Pan ,  Isac Andreas Müller Sandvik

IPC: G06T19/00 ,  G06T15/20 ,  G06T19/20 ,  H04L67/52 ,  H04L67/131

CPC classification number: G06T19/006 ,  G06T15/20 ,  G06T19/20 ,  H04L67/52 ,  H04L67/131 ,  G06T2200/24 ,  G06T2219/024 ,  G06F3/04842

Abstract: An augmented reality system to generate and cause display of a presentation of a space at a first client device, receive one or more selections of points within the presentation of the space at the first client device, and render graphical elements at the one or more points within the presentation of the space at the first client device. The augmented reality system is further configured to receive a display request to display the space at a second client device, and in response, may render a second presentation of the space at the second client device, wherein the second presentation of the space includes the graphical elements at the one or more points.

公开(公告)号：US20230011686A1

公开(公告)日：2023-01-12

申请号：US17948813

申请日：2022-09-20

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  Isac Andreas Müller Sandvik ,  Qi Pan ,  David Li

IPC: G06T19/00 ,  G06T7/00 ,  G06T19/20 ,  G06F16/51 ,  G06F16/54 ,  H04L51/224 ,  H04L67/51

Abstract: A crowd-sourced modeling system to perform operations that include: receiving image data that comprises image attributes; accessing a 3D model based on at least the image attributes of the image data, wherein the 3D model comprises a plurality of parts that collectively depict an object or environment; identifying a change in the object or environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts; and generating an update to the part of the 3D model based on the image attributes of the image data.

公开(公告)号：US20220291787A1

公开(公告)日：2022-09-15

申请号：US17828885

申请日：2022-05-31

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  David Li ,  Isac Andreas Muller Sandvik ,  Qi Pan

IPC: G06F3/0481 ,  G06F3/04842 ,  G06F3/14 ,  G06K9/62 ,  G06T11/00 ,  H04L67/306

Abstract: An addressable media system for performing operations that include: accessing image data that depicts an object in an environment at a client device; causing display of a presentation of the image data within a graphical user interface at the client device; detecting the display of the object within the presentation of the image data based on at least a portion of the plurality of image features of the display of the object; identifying an object class based on at least the portion of the image features of the display of the object; receiving an input that selects the display of the object from the client device; and associating the object class that corresponds with the object with the user profile in response to the input that selects the display of the object.

公开(公告)号：US20220284656A1

公开(公告)日：2022-09-08

申请号：US17752331

申请日：2022-05-24

Applicant: : Snap Inc.

Inventor： Piers Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan

IPC: G06T15/04 ,  G06T7/11 ,  G06K9/62 ,  G06T17/20 ,  G06V30/262

Abstract: A semantic texture map system to generate a semantic texture map based on a 3D model that comprises a plurality of vertices that include coordinate that indicate positions of the plurality of vertices, a UV map, and a semantic segmentation image that comprises a set of semantic labels.

公开(公告)号：US11429618B2

公开(公告)日：2022-08-30

申请号：US16729775

申请日：2019-12-30

Applicant: Snap Inc.

Inventor： Jennica Pounds ,  Qi Pan ,  Brent Michael Barkman ,  Ozi Egri

IPC: G06F16/2457 ,  G06F16/2458 ,  G06F16/248 ,  G06F16/29 ,  G06T19/00

Abstract: Various embodiments provide for a registry for augmented reality (AR) objects, which can provide AR objects to a client device to support various software or hardware applications. For instance, some embodiments provide for an AR object registry that facilitates or enables registration of one or more AR objects in association with one or more locations across a planet.