LOW-POWER HAND-TRACKING SYSTEM FOR WEARABLE DEVICE

    公开(公告)号:US20230418385A1

    公开(公告)日:2023-12-28

    申请号:US17851465

    申请日:2022-06-28

    申请人: Snap Inc.

    IPC分类号: G06F3/01 G01S13/08

    CPC分类号: G06F3/017 G06F3/011 G01S13/08

    摘要: A method for a low-power hand-tracking system is described. In one aspect, a method includes polling a proximity sensor of a wearable device to detect a proximity event, the wearable device includes a low-power processor and a high-power processor, in response to detecting the proximity event, operating a low-power hand-tracking application on the low-power processor based on proximity data from the proximity sensor, and ending an operation of the low-power hand-tracking application in response to at least one of: detecting and recognizing a gesture based on the proximity data, detecting without recognizing the gesture based on the proximity data, or detecting a lack of activity from the proximity sensor within a timeout period based on the proximity data.

    BEACONS FOR LOCALIZATION AND CONTENT DELIVERY TO WEARABLE DEVICES

    公开(公告)号:US20220375174A1

    公开(公告)日:2022-11-24

    申请号:US17746020

    申请日:2022-05-17

    申请人: Snap Inc.

    摘要: Example systems, devices, media, and methods are described for presenting a virtual experience using the display of an eyewear device in augmented reality. A content delivery application implements and controls the detecting of beacons broadcast from beacon transmitters deployed at fixed locations and determining the current eyewear location based on the detected beacons. The method includes retrieving content and presenting a virtual experience based on the retrieved content, the beacon data, and a user profile. The virtual experience includes playing audio messages, presenting text on the display, playing video segments on the display, and combinations thereof. In addition to wireless detection of beacons, the method includes scanning and decoding a beacon activation code positioned near the beacon transmitter to access a beacon.

    Low-power architecture for augmented reality device

    公开(公告)号:US11756274B1

    公开(公告)日:2023-09-12

    申请号:US17859588

    申请日:2022-07-07

    申请人: Snap Inc.

    摘要: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.

    LOW-POWER ARCHITECTURE FOR AUGMENTED REALITY DEVICE

    公开(公告)号:US20240013493A1

    公开(公告)日:2024-01-11

    申请号:US18360945

    申请日:2023-07-28

    申请人: Snap Inc.

    摘要: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.

    DUAL SYSTEM ON A CHIP EYEWEAR HAVING A MIPI BRIDGE

    公开(公告)号:US20230262207A1

    公开(公告)日:2023-08-17

    申请号:US18103829

    申请日:2023-01-31

    申请人: Snap Inc.

    摘要: Eyewear device including two system on a chip (SoC) that share processing workload. The SoCs communicate with each other using a low-power bridge, e.g., a mobile industry processor interface (MIPI) bridge including a display serial interface (DSI) to camera serial interface (CSI) bridge. The MIPI bridge converts DSI images from one SoC to CSI images, and also communicates metadata. Another SoC receives and processes the CSI images. The other SoC has a buffer that receives both the CSI images and the metadata, and separates the CSI images from the metadata. The other SoC has computer vision (CV) algorithms that process the metadata, and a low-speed interface that sends metadata back to the one SoC to adjust and render a next image. The MIPI bridge may comprise a field programmable gate array (FPGA).