公开(公告)号：US20250095203A1

公开(公告)日：2025-03-20

申请号：US18970043

申请日：2024-12-05

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan ,  Matan Zohar

IPC: G06T7/73 ,  G06F3/01 ,  G06T19/00

Abstract: Method for creating marker-based shared augmented reality (AR) session starts with initializing a shared AR session by a first device and by a second device. The first device displays on a display a marker. The second device detects the marker using a camera included in the second device and captures an image of the marker using the camera. The second device determines a transformation between the first device and the second device using the image of the marker. A common coordinate frame is then determined using the transformation, the shared AR session is generated using the common coordinate frame, and the shared AR session is caused to be displayed by the first device and by the second device. Other embodiments are described herein.

公开(公告)号：US20250094740A1

公开(公告)日：2025-03-20

申请号：US18969990

申请日：2024-12-05

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  Qi Pan ,  Eitan Pilipski

IPC: G06F40/58 ,  G06F40/205 ,  G06F40/30 ,  G06T11/00 ,  G06T11/60 ,  G06V20/20 ,  G06V40/16 ,  G10L15/25 ,  G10L15/26 ,  G10L21/10 ,  G10L25/63

Abstract: Disclosed is an augmented reality system to generate and cause display of an augmented reality interface at a client device. Various embodiments may detect speech, identify a source of the speech, transcribe the speech to a text string, generate a speech bubble based on properties of the speech and that includes a presentation of the text string, and cause display of the speech bubble at a location in the augmented reality interface based on the source of the speech.

公开(公告)号：US12203768B2

公开(公告)日：2025-01-21

申请号：US17991413

申请日：2022-11-21

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  David Li ,  Isac Andreas Müller Sandvik ,  Qi Pan

IPC: G01C21/36 ,  G06T19/00 ,  G06V30/413 ,  H04W4/021 ,  H04W4/029

Abstract: Example embodiments described herein therefore relate to an AR guidance system to perform operations that include: detecting a client device at a location within a geo-fenced area, wherein the geo-fenced area may include within it, a destination of interest; determining a route to the destination of interest from the location of the client device within the geo-fenced area; causing display of a presentation of an environment within an AR interface at the client device; detecting a display of real-world signage within the presentation of the environment; generating a media item in response to the detecting the display of the signage within the presentation of the environment, wherein the media item is based on the route to the destination of interest; and causing display of the media item within the AR interface based on the position of the signage within the presentation of the environment.

公开(公告)号：US12033253B2

公开(公告)日：2024-07-09

申请号：US17528981

申请日：2021-11-17

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  Qi Pan ,  Eitan Pilipski

IPC: G06K9/00 ,  G06T7/11 ,  G06T11/60 ,  G06V20/20 ,  G06V20/62 ,  G06V30/10

CPC classification number: G06T11/60 ,  G06T7/11 ,  G06V20/20 ,  G06V20/63 ,  G06V30/10

Abstract: Disclosed are augmented reality (AR) personalization systems to enable a user to edit and personalize presentations of real-world typography in real-time. The AR personalization system captures an image depicting a physical location via a camera coupled to a client device. For example, the client device may include a mobile device that includes a camera configured to record and display images (e.g., photos, videos) in real-time. The AR personalization system causes display of the image at the client device, and scans the image to detect occurrences of typography within the image (e.g., signs, billboards, posters, graffiti).

公开(公告)号：US20240193168A1

公开(公告)日：2024-06-13

申请号：US18582831

申请日：2024-02-21

Applicant: Snap Inc.

Inventor： Jennica Pounds ,  Qi Pan ,  Brent Michael Barkman ,  Ozi Egri

IPC: G06F16/2457 ,  G06F16/2458 ,  G06F16/248 ,  G06F16/29 ,  G06T19/00

CPC classification number: G06F16/24578 ,  G06F16/2477 ,  G06F16/248 ,  G06F16/29 ,  G06T19/006

Abstract: Various embodiments provide for a registry for augmented reality (AR) objects, which can provide AR objects to a client device to support various software or hardware applications. For instance, some embodiments provide for an AR object registry that facilitates or enables registration of one or more AR objects in association with one or more locations across a planet.

公开(公告)号：US20240153049A1

公开(公告)日：2024-05-09

申请号：US18415293

申请日：2024-01-17

Applicant: Snap Inc.

Inventor： Richard McCormack ,  Qi Pan

IPC: G06T5/80 ,  G06T19/00 ,  H04W4/021 ,  H04W4/029

CPC classification number: G06T5/80 ,  G06T19/006 ,  H04W4/021 ,  H04W4/029 ,  G06T2207/10028 ,  G06T2207/30184

Abstract: An Augmented-Reality which performs operations that include: accessing a data object that comprises image data, location data, and orientation data; applying a transformation to the data object to produce a rectified data object; generating a point cloud based on the rectified data object; assigning the point cloud to a location based on at least the location data of the data object; detecting a client device at the location; and loading the point cloud to the client device in response to the detecting the client device at the location.

公开(公告)号：US11978112B2

公开(公告)日：2024-05-07

申请号：US18097619

申请日：2023-01-17

Applicant: Snap Inc.

Inventor： Itamar Berger ,  Amar Boghani ,  Maria Jose Garcia Sopo ,  Qi Pan

IPC: G06Q30/0601 ,  G06Q10/087 ,  G06Q50/00 ,  G06T19/00 ,  G06V20/10 ,  G06K7/14 ,  G06Q20/12

CPC classification number: G06Q30/0643 ,  G06Q10/087 ,  G06Q30/0623 ,  G06Q30/0631 ,  G06Q50/01 ,  G06T19/006 ,  G06V20/10 ,  G06K7/1413 ,  G06Q20/1235 ,  G06Q30/0633 ,  G06T2200/24 ,  G06T2219/024

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving, from a client device of a first user, a request from the first user to engage in an AR shopping experience curated by a store; identifying a first real-world product available for purchase from the store; receiving an image of a real-world environment of the first user; generating a first AR item that represents the first real-world product; comparing visual attributes of the first AR item to physical layouts of a plurality of real-world objects depicted in the image of the real-world environment; and overlaying the first AR item on a first real-world object of the plurality of real-world objects in the image responsive to comparing the visual attributes of the first AR item to the physical layouts of the plurality of real-world objects.

公开(公告)号：US20230368476A1

公开(公告)日：2023-11-16

申请号：US18221179

申请日：2023-07-12

Applicant: Snap Inc.

Inventor： Qi Pan ,  Edward James Rosten ,  Andrew Tristan Spek ,  Supannee Tanathong

IPC: G06T19/00 ,  G06T7/70

CPC classification number: G06T19/006 ,  G06T7/70

Abstract: An augmented reality device generates an updated position and orientation (pose) value by initially determining, using image-based processing, a pose estimate from a current image frame, a previous image frame and a previous pose. An IMU pose is then obtained from data generated by an inertial measurement unit including motion sensors, and transformation between the pose estimate and the IMU pose is determined. The transformation is applied to the pose estimate to generate a pose update. Media content is applied to a position within an image, the position being based on the pose update.

公开(公告)号：US11798243B2

公开(公告)日：2023-10-24

申请号：US17948813

申请日：2022-09-20

Applicant: Snap Inc.

Inventor： Piers Cowburn ,  Isac Andreas Müller Sandvik ,  Qi Pan ,  David Li

IPC: G06T7/00 ,  G06T19/00 ,  G06T19/20 ,  G06F16/51 ,  G06F16/54 ,  H04L51/224 ,  H04L67/51 ,  H04L67/01

CPC classification number: G06T19/006 ,  G06F16/51 ,  G06F16/54 ,  G06T7/97 ,  G06T19/20 ,  H04L51/224 ,  H04L67/51 ,  G06T2219/024 ,  H04L67/01

Abstract: A crowd-sourced modeling system to perform operations that include: receiving image data that comprises image attributes; accessing a 3D model based on at least the image attributes of the image data, wherein the 3D model comprises a plurality of parts that collectively depict an object or environment; identifying a change in the object or environment based on a comparison of the image data with the plurality of parts of the 3D model, the change corresponding to a part of the 3D model from among the plurality of parts; and generating an update to the part of the 3D model based on the image attributes of the image data.

公开(公告)号：US11721072B2

公开(公告)日：2023-08-08

申请号：US17876941

申请日：2022-07-29

Applicant: Snap Inc.

Inventor： David Li ,  Piers George Cowburn ,  Isac Andreas Müller Sandvik ,  Qi Pan

IPC: G06T19/00 ,  G06T11/00 ,  G06T15/04 ,  G06T19/20 ,  G06F3/04845

CPC classification number: G06T19/00 ,  G06T11/00 ,  G06T15/04 ,  G06T19/006 ,  G06T19/20 ,  G06F3/04845 ,  G06T2200/24

Abstract: Example embodiments described herein relate to an augmented-reality system to generate and cause display of interactive augmented reality content at a client device.