公开(公告)号：US12190420B2

公开(公告)日：2025-01-07

申请号：US17959985

申请日：2022-10-04

Applicant: Snap Inc.

Inventor： Shin Hwun Kang ,  Lien Le Hong Tran

IPC: G06T11/60 ,  G06F3/01 ,  G06F3/0482 ,  G06T7/70

Abstract: An augmented reality (AR) content system is provided. The AR content system may analyze audio input obtained from a user to generate a search request. The AR content system may obtain search results in response to the search request and determine a layout by which to display the search results. The search results may be displayed in a user interface within an AR environment according to the layout. The AR content system may also analyze audio input to detect commands to perform with respect to content displayed in the user interface.

公开(公告)号：US12108011B2

公开(公告)日：2024-10-01

申请号：US17566979

申请日：2021-12-31

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang ,  Kristina Marrero

IPC: G06T15/00 ,  G06V20/20 ,  H04N13/111 ,  H04N13/366

CPC classification number: H04N13/111 ,  G06V20/20 ,  H04N13/366

Abstract: Systems, devices, media, and methods are presented for producing an augmented reality (AR) experience for display on a smart eyewear device. The AR production system includes a marker registration utility for setting and storing markers, a localization utility for locating the eyewear device relative to a marker location and to the mapped environment, and a virtual object rendering utility to presenting one or more virtual objects having a desired size, shape, and orientation. A high-definition camera captures an input image of the environment. If the input image includes a marker, the system retrieves from memory a set of data including a first marker location expressed in terms relative to a marker coordinate system. The localization utility determines a local position of the eyewear device relative to the marker location. The virtual object rendering utility prepares one or more virtual objects for display based on the eyewear location, the head pose of the wearer, and the location of one or more physical object landmarks in the environment.

公开(公告)号：US20240045494A1

公开(公告)日：2024-02-08

申请号：US18382737

申请日：2023-10-23

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang ,  Doug Mead

IPC: G06F3/01 ,  H04B1/3827 ,  H04W4/029 ,  G06T7/73 ,  G06F18/22

CPC classification number: G06F3/012 ,  H04B1/385 ,  H04W4/029 ,  G06T7/74 ,  G06F18/22 ,  H04B2001/3866

Abstract: Systems, devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device. A portable eyewear device includes a processor, a memory, and a display projected onto at least one lens assembly. The memory has programming stored therein that, when executed by the processor, captures information depicting an environment surrounding the device and identifies a match between objects in that information and predetermined objects in previously obtained information for the same environment. When the position of the eyewear device reaches a preselected location with respect to the matched objects, a physical output is provided to produce the immersive experience. The physical output changes as the position of the eyewear device moves to maintain the immersive experience.

公开(公告)号：US20220374131A1

公开(公告)日：2022-11-24

申请号：US17448169

申请日：2021-09-20

Applicant: Snap Inc.

Inventor： Karen Stolzenberg ,  David Meisenholder ,  Mathieu Emmanuel Vignau ,  Joseph Timothy Fortier ,  Kaveh Anvaripour ,  Daniel Moreno ,  Kyle Goodrich ,  Ilteris Kaan Canberk ,  Shin Hwun Kang

IPC: G06F3/0481 ,  G06F3/0485 ,  G06F3/0488 ,  G02B27/01 ,  G06T19/00

Abstract: Disclosed is a method of receiving and processing navigation inputs executed by one or more processors in a head-worn device system including one or more display devices, one or more cameras and a generally vertically-arranged touchpad. The method comprises displaying a first carousel of AR effects icons, receiving a first horizontal input on the touchpad, rotating the first carousel of AR effects icons in response to first horizontal input, receiving a first touch input on the touchpad to select a particular AR effects icon that is in a selection position in the first carousel, displaying a scene viewed by the one or more cameras, the scene being enhanced with AR effects corresponding to the particular AR effects icon, receiving content capture user input, and in response to the content capture user input, capturing a new content item corresponding to the scene.

公开(公告)号：US20250097659A1

公开(公告)日：2025-03-20

申请号：US18967473

申请日：2024-12-03

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang

IPC: H04S7/00 ,  G02B27/01

Abstract: Devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device with spatial audio. The eyewear device has a processor, a memory, an image sensor, and a speaker system. The eyewear device captures image information for an environment surrounding the device and identifies an object location within the same environment. The eyewear device then associates a virtual object with the identified object location. The eyewear device monitors the position of the device with respect to the virtual object and presents audio signals to alert the user that the identified object is in the environment.

公开(公告)号：US12229901B2

公开(公告)日：2025-02-18

申请号：US17960627

申请日：2022-10-05

Applicant: Snap Inc.

Inventor： Ilteris Kaan Canberk ,  Bernhard Jung ,  Shin Hwun Kang ,  Daria Skrypnyk ,  Tianyi Sun ,  Lien Le Hong Tran

IPC: G06T19/00

Abstract: Systems and methods are provided for performing operations on an augmented reality (AR) device using an external screen streaming system. The system establishes, by one or more processors of an AR device, a communication with an external client device. The system causes overlay of, by the AR device, a first AR object on a real-world environment being viewed using the AR device. The system receives, by the AR device, a first image from the external client device. The system, in response to receiving the first image from the external client device, overlays the first image on the first AR object by the AR device.

公开(公告)号：US20240119679A1

公开(公告)日：2024-04-11

申请号：US17960627

申请日：2022-10-05

Applicant: Snap Inc.

Inventor： Ilteris Kaan Canberk ,  Bernhard Jung ,  Shin Hwun Kang ,  Daria Skrypnyk ,  Tianyi Sun ,  Lien Le Hong Tran

IPC: G06T19/00

CPC classification number: G06T19/006 ,  G06T2200/24 ,  G06T2219/024

Abstract: Systems and methods are provided for performing operations on an augmented reality (AR) device using an external screen streaming system. The system establishes, by one or more processors of an AR device, a communication with an external client device. The system causes overlay of, by the AR device, a first AR object on a real-world environment being viewed using the AR device. The system receives, by the AR device, a first image from the external client device. The system, in response to receiving the first image from the external client device, overlays the first image on the first AR object by the AR device.

公开(公告)号：US11803234B2

公开(公告)日：2023-10-31

申请号：US17988491

申请日：2022-11-16

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang ,  Doug Mead

IPC: G06F3/01 ,  H04B1/3827 ,  H04W4/029 ,  G06T7/73 ,  G06F18/22

CPC classification number: G06F3/012 ,  G06F18/22 ,  G06T7/74 ,  H04B1/385 ,  H04W4/029 ,  H04B2001/3866

Abstract: Systems, devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device. A portable eyewear device includes a processor, a memory, and a display projected onto at least one lens assembly. The memory has programming stored therein that, when executed by the processor, captures information depicting an environment surrounding the device and identifies a match between objects in that information and predetermined objects in previously obtained information for the same environment. When the position of the eyewear device reaches a preselected location with respect to the matched objects, a physical output is provided to produce the immersive experience. The physical output changes as the position of the eyewear device moves to maintain the immersive experience.

公开(公告)号：US20230179641A1

公开(公告)日：2023-06-08

申请号：US17544496

申请日：2021-12-07

Applicant: Snap Inc.

Inventor： Kristian Bauer ,  Tiago Rafael Duarte ,  Terek Judi ,  Shin Hwun Kang ,  Karen Stolzenberg

IPC: H04L65/1069 ,  G06F3/14 ,  G02B27/01

CPC classification number: H04L65/1069 ,  G02B27/0172 ,  G06F3/1454 ,  G02B2027/0138 ,  G02B2027/0178

Abstract: A head-worn device system includes one or more cameras, one or more display devices and one or more processors. The system also includes a memory storing instructions that, when executed by the one or more processors, configure the system to perform operations to initiate or join a joint visual computing session. The method may comprise receiving user input to initiate a joint session of a visual computing experience, monitoring for short-range data transmissions including data indicating the existence of a current session of the visual computing experience, and based on determining that a current session is in process, providing a user input option to join the current session of the visual computing experience.

公开(公告)号：US20230161407A1

公开(公告)日：2023-05-25

申请号：US18098384

申请日：2023-01-18

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang ,  Dmytro Kucher

IPC: G06F3/01 ,  G02B27/00 ,  G02C11/00 ,  G06F3/14

CPC classification number: G06F3/013 ,  G02B27/0093 ,  G02C11/10 ,  G06F3/1454

Abstract: Eyewear providing an interactive augmented reality experience between two users of eyewear devices to perform a shared group object manipulation task. During the shared group task, each user of the eyewear controls movement of a respective virtual object in a virtual scene based on a portion of the virtual scene the user is gazing at. Each user can also generate a verbal command to generate a virtual object that interacts with one or more of the other virtual objects.