公开(公告)号：US12211158B2

公开(公告)日：2025-01-28

申请号：US18360945

申请日：2023-07-28

Applicant: Snap Inc.

Inventor： Ashwani Arya ,  Alex Feinman ,  Daniel Harris ,  Tejas Bahulkar ,  Dunxu Hu

IPC: G06T19/00 ,  G02B27/01 ,  G06F1/3234 ,  G06F3/01

Abstract: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.

公开(公告)号：US20250022206A1

公开(公告)日：2025-01-16

申请号：US18898084

申请日：2024-09-26

Applicant: Snap Inc.

Inventor： Tejas Bahulkar ,  Edward Lee Kim-Koon ,  Ashwani Arya

IPC: G06T15/00 ,  G06F18/214 ,  G06T19/00 ,  H04W52/02

Abstract: Methods and systems are disclosed for performing operations for estimating power usage of an AR experience. The operations include: accessing resource utilization data associated with execution of an augmented reality (AR) experience; applying a machine learning technique to the resource utilization data to estimate power consumption of the AR experience, the machine learning technique being trained to establish a relationship between a plurality of training resource utilization data associated with training AR experiences and corresponding ground-truth power consumption of the training AR experiences; and adjusting one or more operations of the AR experience to reduce power consumption based on the estimated power consumption of the AR experience.

公开(公告)号：US20240345895A1

公开(公告)日：2024-10-17

申请号：US18133644

申请日：2023-04-12

Applicant: Snap Inc.

Inventor： Tejas Bahulkar ,  Dunxu Hu ,  Yizhou Ma ,  Jonah Hephzibah Okike ,  John James Robertson ,  Richard Zhuang

IPC: G06F9/50 ,  G06F1/16 ,  G06F3/01

CPC classification number: G06F9/5077 ,  G06F1/163 ,  G06F3/013

Abstract: Systems, methods, and computer readable media for power and temperature attribution on mobile devices. Example methods include granting a request for a resource, estimating an energy usage used by the resource for the application, where the estimating is based on a resource utilization and a resource usage duration, and in response to the power usage transgressing a power usage budget for the application, throttling the power usage of the application. The application may provide a module to be called for the application to reduce its power usage or temperature generation. The mobile device provides the application with the temperature generation and power usage of the application on a per resource used basis. The mobile device determines the power usage and the temperature generation of the resources of the mobile device. In some examples, the mobile device is an augmented reality (AR), virtual reality (VR), or mixed reality (MR) head-wearable device.

公开(公告)号：US12100066B2

公开(公告)日：2024-09-24

申请号：US17736142

申请日：2022-05-04

Applicant: Snap Inc.

Inventor： Tejas Bahulkar

IPC: G06T11/00 ,  G06F3/04842 ,  G06F3/0488 ,  G06F3/16 ,  G06V20/20 ,  G06V20/68

CPC classification number: G06T11/00 ,  G06V20/20 ,  G06V20/68 ,  G06F3/04842 ,  G06F3/0488 ,  G06F3/167

Abstract: Example systems, devices, media, and methods are described for curating and presenting a contextual overlay that includes graphical elements and virtual elements in an augmented reality experience. A contextual overlay application implements and controls the capturing of frames of video data within a field of view of the camera. The image processing system detects, in the captured frames of video data, one or more food items in the physical environment. Detecting food items may involve computer vision and machine-trained classification models. The method includes retrieving data associated with the detected food item, curating a contextual overlay based on the retrieved data and a configurable profile, and presenting the contextual overlay on the display.

公开(公告)号：US20240187814A1

公开(公告)日：2024-06-06

申请号：US18422549

申请日：2024-01-25

Applicant: Snap Inc.

Inventor： Ashwani Arya ,  Tejas Bahulkar ,  Dunxu Hu ,  Daniel C. Wiggins

IPC: H04S7/00 ,  G02B27/01 ,  H04R3/04 ,  H04R5/033 ,  H04R5/04 ,  H04S1/00

CPC classification number: H04S7/304 ,  G02B27/0172 ,  H04R3/04 ,  H04R5/033 ,  H04R5/04 ,  H04S1/007 ,  H04S7/307 ,  G02B2027/0134 ,  G02B2027/0138 ,  H04S2420/01

Abstract: Example systems, devices, media, and methods are described for efficiently processing an audio track of a virtual object with a head-related transfer function (HRTF). Audio tracks are processed by determining a current position (direction and optionally distance) of the virtual object with respect to the head of a user, identifying a current audio zone from predefined audio zones responsive to the determined current position where each of the audio zones has a corresponding left predefined filter and a corresponding right predefined filter, applying the left and the right predefined filters corresponding to the current audio zone to the audio track to produce a left audio signal and a right audio signal, and presenting the left audio signal with a first speaker and the right audio signal with a second speaker.

公开(公告)号：US11902534B2

公开(公告)日：2024-02-13

申请号：US17939685

申请日：2022-09-07

Applicant: Snap Inc.

Inventor： Ashwani Arya ,  Tejas Bahulkar ,  Jonah Hephzibah Okike

IPC: H04N19/156 ,  G06F1/16 ,  H04N19/40 ,  H04N5/63 ,  H04N7/01 ,  G02B27/01

CPC classification number: H04N19/156 ,  G06F1/163 ,  H04N5/63 ,  H04N7/0117 ,  H04N7/0127 ,  H04N19/40 ,  G02B2027/0178

Abstract: Dynamic transcode throttling methods and devices for processing resource management and thermal mitigation in electronic devices such as eyewear devices. An electronic device monitors its temperature and, responsive to the temperature, configures a transcoding service to operate at different rates. A frame delay module is configured to add a delay between read frames prior to the transcoding service. This enables the electronic device to consume less power when temperatures are too high in order to provide thermal mitigation and can be performed without powering down the electronic device.

公开(公告)号：US20240013493A1

公开(公告)日：2024-01-11

申请号：US18360945

申请日：2023-07-28

Applicant: Snap Inc.

Inventor： Ashwani Arya ,  Alex Feinman ,  Daniel Harris ,  Tejas Bahulkar ,  Dunxu Hu

IPC: G06T19/00 ,  G02B27/01 ,  G06F1/3234 ,  G06F3/01

CPC classification number: G06T19/006 ,  G02B27/017 ,  G06F1/325 ,  G06F3/017 ,  G02B2027/0138

Abstract: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.