公开(公告)号：US12204693B2

公开(公告)日：2025-01-21

申请号：US17851465

申请日：2022-06-28

Applicant: Snap Inc.

Inventor： Alex Feinman ,  Ashwani Arya

IPC: G06F3/01 ,  G01S13/08

Abstract: A method for a low-power hand-tracking system is described. In one aspect, a method includes polling a proximity sensor of a wearable device to detect a proximity event, the wearable device includes a low-power processor and a high-power processor, in response to detecting the proximity event, operating a low-power hand-tracking application on the low-power processor based on proximity data from the proximity sensor, and ending an operation of the low-power hand-tracking application in response to at least one of: detecting and recognizing a gesture based on the proximity data, detecting without recognizing the gesture based on the proximity data, or detecting a lack of activity from the proximity sensor within a timeout period based on the proximity data.

公开(公告)号：US12211158B2

公开(公告)日：2025-01-28

申请号：US18360945

申请日：2023-07-28

Applicant: Snap Inc.

Inventor： Ashwani Arya ,  Alex Feinman ,  Daniel Harris ,  Tejas Bahulkar ,  Dunxu Hu

IPC: G06T19/00 ,  G02B27/01 ,  G06F1/3234 ,  G06F3/01

Abstract: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.

公开(公告)号：US20240013493A1

公开(公告)日：2024-01-11

申请号：US18360945

申请日：2023-07-28

Applicant: Snap Inc.

Inventor： Ashwani Arya ,  Alex Feinman ,  Daniel Harris ,  Tejas Bahulkar ,  Dunxu Hu

IPC: G06T19/00 ,  G02B27/01 ,  G06F1/3234 ,  G06F3/01

CPC classification number: G06T19/006 ,  G02B27/017 ,  G06F1/325 ,  G06F3/017 ,  G02B2027/0138

Abstract: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.

公开(公告)号：US20230262207A1

公开(公告)日：2023-08-17

申请号：US18103829

申请日：2023-01-31

Applicant: Snap Inc.

Inventor： Alex Feinman ,  Julian Grahsl ,  Jason Heger ,  Gerald Nilles

IPC: H04N13/344 ,  H04N13/279 ,  G06F13/42

CPC classification number: H04N13/344 ,  H04N13/279 ,  G06F13/4282 ,  G06F2213/0038

Abstract: Eyewear device including two system on a chip (SoC) that share processing workload. The SoCs communicate with each other using a low-power bridge, e.g., a mobile industry processor interface (MIPI) bridge including a display serial interface (DSI) to camera serial interface (CSI) bridge. The MIPI bridge converts DSI images from one SoC to CSI images, and also communicates metadata. Another SoC receives and processes the CSI images. The other SoC has a buffer that receives both the CSI images and the metadata, and separates the CSI images from the metadata. The other SoC has computer vision (CV) algorithms that process the metadata, and a low-speed interface that sends metadata back to the one SoC to adjust and render a next image. The MIPI bridge may comprise a field programmable gate array (FPGA).

公开(公告)号：US11699271B2

公开(公告)日：2023-07-11

申请号：US17746020

申请日：2022-05-17

Applicant: Snap Inc.

Inventor： Ashwani Arya ,  Alex Feinman

IPC: G06T19/00 ,  H04W4/029 ,  G06F16/9537 ,  G06F3/01 ,  G06F3/0354 ,  G06F3/0482 ,  G06F3/16 ,  H04W4/02 ,  H04W8/00 ,  G06F1/16 ,  G10L15/26

CPC classification number: G06T19/006 ,  G06F3/012 ,  G06F3/03547 ,  G06F3/0482 ,  G06F3/167 ,  G06F16/9537 ,  H04W4/023 ,  H04W4/029 ,  H04W8/005 ,  G06F1/163 ,  G06T2200/24 ,  G10L15/26

Abstract: Example systems, devices, media, and methods are described for presenting a virtual experience using the display of an eyewear device in augmented reality. A content delivery application implements and controls the detecting of beacons broadcast from beacon transmitters deployed at fixed locations and determining the current eyewear location based on the detected beacons. The method includes retrieving content and presenting a virtual experience based on the retrieved content, the beacon data, and a user profile. The virtual experience includes playing audio messages, presenting text on the display, playing video segments on the display, and combinations thereof. In addition to wireless detection of beacons, the method includes scanning and decoding a beacon activation code positioned near the beacon transmitter to access a beacon.