-
公开(公告)号：US11889291B2
公开(公告)日：2024-01-30
申请号：US17950261
申请日：2022-09-22
Applicant: Snap Inc.
Inventor： Ashwani Arya , Tejas Bahulkar , Dunxu Hu , Daniel C. Wiggins
CPC classification number: H04S7/304 , G02B27/0172 , H04R3/04 , H04R5/033 , H04R5/04 , H04S1/007 , H04S7/307 , G02B2027/0134 , G02B2027/0138 , H04S2420/01
Abstract: Example systems, devices, media, and methods are described for efficiently processing an audio track of a virtual object with a head-related transfer function (HRTF). Audio tracks are processed by determining a current position (direction and optionally distance) of the virtual object with respect to the head of a user, identifying a current audio zone from predefined audio zones responsive to the determined current position where each of the audio zones has a corresponding left predefined filter and a corresponding right predefined filter, applying the left and the right predefined filters corresponding to the current audio zone to the audio track to produce a left audio signal and a right audio signal, and presenting the left audio signal with a first speaker and the right audio signal with a second speaker.
-
公开(公告)号：US20240298138A1
公开(公告)日：2024-09-05
申请号：US18663400
申请日：2024-05-14
Applicant: Snap Inc.
Inventor： Ashwani Arya , Tejas Bahulkar , Daniel Harris , Daniel C. Wiggins
IPC: H04S7/00 , G10L19/008 , H04R5/033 , H04S3/00
CPC classification number: H04S7/304 , G10L19/008 , H04R5/033 , H04S3/008 , H04S2400/01 , H04S2420/01
Abstract: An electronic eyewear device includes a display and a speaker system adapted to present augment reality objects and associated sounds in a scene being viewed by the user. A processor receives one or more audio tracks respectively associated with one or more augmented reality objects, encodes the audio tracks into an aggregated audio track including the audio tracks, a header for each audio track that uniquely identifies each respective audio track, and an aggregate header that identifies the number of tracks in the aggregated audio track. The processor transfers the aggregated audio track to an audio processor that uses the header for each audio track and the aggregate header to separate the audio tracks from the aggregated audio track. The audio processor processes the audio tracks independently in parallel and provides the audio tracks to the speaker system for presentation with the augmented reality objects.
-
公开(公告)号：US20220358689A1
公开(公告)日：2022-11-10
申请号：US17736142
申请日：2022-05-04
Applicant: Snap Inc.
Inventor： Tejas Bahulkar
Abstract: Example systems, devices, media, and methods are described for curating and presenting a contextual overlay that includes graphical elements and virtual elements in an augmented reality experience. A contextual overlay application implements and controls the capturing of frames of video data within a field of view of the camera. The image processing system detects, in the captured frames of video data, one or more food items in the physical environment. Detecting food items may involve computer vision and machine-trained classification models. The method includes retrieving data associated with the detected food item, curating a contextual overlay based on the retrieved data and a configurable profile, and presenting the contextual overlay on the display.
-
公开(公告)号：US20240420382A1
公开(公告)日：2024-12-19
申请号：US18819587
申请日：2024-08-29
Applicant: Snap Inc.
Inventor： Tejas Bahulkar
IPC: G06T11/00 , G06F3/04842 , G06F3/0488 , G06F3/16 , G06V20/20 , G06V20/68
Abstract: Example systems, devices, media, and methods are described for curating and presenting a contextual overlay that includes graphical elements and virtual elements in an augmented reality experience. A contextual overlay application implements and controls the capturing of frames of video data within a field of view of the camera. The image processing system detects, in the captured frames of video data, one or more food items in the physical environment. Detecting food items may involve computer vision and machine-trained classification models. The method includes retrieving data associated with the detected food item, curating a contextual overlay based on the retrieved data and a configurable profile, and presenting the contextual overlay on the display.
-
公开(公告)号：US12136160B2
公开(公告)日：2024-11-05
申请号：US17661001
申请日：2022-04-27
Applicant: Snap Inc.
Inventor： Tejas Bahulkar , Edward Lee Kim-Koon , Ashwani Arya
IPC: G06T15/00 , G06F18/214 , G06T19/00 , H04W52/02
Abstract: Methods and systems are disclosed for performing operations for estimating power usage of an AR experience. The operations include: accessing resource utilization data associated with execution of an augmented reality (AR) experience; applying a machine learning technique to the resource utilization data to estimate power consumption of the AR experience, the machine learning technique being trained to establish a relationship between a plurality of training resource utilization data associated with training AR experiences and corresponding ground-truth power consumption of the training AR experiences; and adjusting one or more operations of the AR experience to reduce power consumption based on the estimated power consumption of the AR experience.
-
Patent Agency Ranking
公开(公告)号：US20220377491A1
公开(公告)日：2022-11-24
申请号：US17743045
申请日：2022-05-12
Applicant: Snap Inc.
Inventor： Ashwani Arya , Tejas Bahulkar , Daniel Harris , Daniel C. Wiggins
IPC: H04S7/00 , G10L19/008 , H04R5/033 , H04S3/00
Abstract: An electronic eyewear device includes a display and a speaker system adapted to present augment reality objects and associated sounds in a scene being viewed by the user. A processor receives one or more audio tracks respectively associated with one or more augmented reality objects, encodes the audio tracks into an aggregated audio track including the audio tracks, a header for each audio track that uniquely identifies each respective audio track, and an aggregate header that identifies the number of tracks in the aggregated audio track. The processor transfers the aggregated audio track to an audio processor that uses the header for each audio track and the aggregate header to separate the audio tracks from the aggregated audio track. The audio processor processes the audio tracks independently in parallel and provides the audio tracks to the speaker system for presentation with the augmented reality objects.
-
公开(公告)号：US20220192622A1
公开(公告)日：2022-06-23
申请号：US17456096
申请日：2021-11-22
Applicant: Snap Inc.
Inventor： Ashwani Arya , Tejas Bahulkar
Abstract: Disclosed is a of monitoring the breathing of a user, comprising receiving a plurality of audio signals from a plurality of microphones and beamforming the plurality of audio signals into a beamformed audio signal. Observed breath-related parameters are derived from the beamformed audio signal and an output of or derived from the observed breath-related parameters is provided to a user of a client device. Breath metrics may be determined by comparing the observed breath-related parameters with reference breath-related parameters, and a breathing score may be derived from the breath metrics. The breathing score may be based on a combination of how closely an observed respiration of the user matches a prompted or desired respiration rate and an observed amount of time that the user's observed respiration rate is within a threshold value of the prompted or desired respiration rate.
-
公开(公告)号：US12010505B2
公开(公告)日：2024-06-11
申请号：US17743045
申请日：2022-05-12
Applicant: Snap Inc.
Inventor： Ashwani Arya , Tejas Bahulkar , Daniel Harris , Daniel C. Wiggins
IPC: H04S7/00 , G10L19/008 , H04R5/033 , H04S3/00
CPC classification number: H04S7/304 , G10L19/008 , H04R5/033 , H04S3/008 , H04S2400/01 , H04S2420/01
Abstract: An electronic eyewear device includes a display and a speaker system adapted to present augment reality objects and associated sounds in a scene being viewed by the user. A processor receives one or more audio tracks respectively associated with one or more augmented reality objects, encodes the audio tracks into an aggregated audio track including the audio tracks, a header for each audio track that uniquely identifies each respective audio track, and an aggregate header that identifies the number of tracks in the aggregated audio track. The processor transfers the aggregated audio track to an audio processor that uses the header for each audio track and the aggregate header to separate the audio tracks from the aggregated audio track. The audio processor processes the audio tracks independently in parallel and provides the audio tracks to the speaker system for presentation with the augmented reality objects.
-
公开(公告)号：US20230351666A1
公开(公告)日：2023-11-02
申请号：US17661001
申请日：2022-04-27
Applicant: Snap Inc.
Inventor： Tejas Bahulkar , Edward Lee Kim-Koon , Ashwani Arya
CPC classification number: G06T15/005 , G06T19/006 , H04W52/0267 , G06K9/6256
Abstract: Methods and systems are disclosed for performing operations for estimating power usage of an AR experience. The operations include: accessing resource utilization data associated with execution of an augmented reality (AR) experience; applying a machine learning technique to the resource utilization data to estimate power consumption of the AR experience, the machine learning technique being trained to establish a relationship between a plurality of training resource utilization data associated with training AR experiences and corresponding ground-truth power consumption of the training AR experiences; and adjusting one or more operations of the AR experience to reduce power consumption based on the estimated power consumption of the AR experience.
-
公开(公告)号：US11756274B1
公开(公告)日：2023-09-12
申请号：US17859588
申请日：2022-07-07
Applicant: Snap Inc.
Inventor： Ashwani Arya , Alex Feinman , Daniel Harris , Tejas Bahulkar , Dunxu Hu
IPC: G06F3/01 , G06T19/00 , G06F1/3234 , G02B27/01
CPC classification number: G06T19/006 , G02B27/017 , G06F1/325 , G06F3/017 , G02B2027/0138
Abstract: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.
-
-
-
-
-
-
-
-
-
Search Results
17
records
(took 0.02 seconds)
