-
公开(公告)号:US20240298138A1
公开(公告)日:2024-09-05
申请号:US18663400
申请日:2024-05-14
申请人: Snap Inc.
发明人: Ashwani Arya , Tejas Bahulkar , Daniel Harris , Daniel C. Wiggins
IPC分类号: H04S7/00 , G10L19/008 , H04R5/033 , H04S3/00
CPC分类号: H04S7/304 , G10L19/008 , H04R5/033 , H04S3/008 , H04S2400/01 , H04S2420/01
摘要: An electronic eyewear device includes a display and a speaker system adapted to present augment reality objects and associated sounds in a scene being viewed by the user. A processor receives one or more audio tracks respectively associated with one or more augmented reality objects, encodes the audio tracks into an aggregated audio track including the audio tracks, a header for each audio track that uniquely identifies each respective audio track, and an aggregate header that identifies the number of tracks in the aggregated audio track. The processor transfers the aggregated audio track to an audio processor that uses the header for each audio track and the aggregate header to separate the audio tracks from the aggregated audio track. The audio processor processes the audio tracks independently in parallel and provides the audio tracks to the speaker system for presentation with the augmented reality objects.
-
公开(公告)号:US20240187814A1
公开(公告)日:2024-06-06
申请号:US18422549
申请日:2024-01-25
申请人: Snap Inc.
发明人: Ashwani Arya , Tejas Bahulkar , Dunxu Hu , Daniel C. Wiggins
CPC分类号: H04S7/304 , G02B27/0172 , H04R3/04 , H04R5/033 , H04R5/04 , H04S1/007 , H04S7/307 , G02B2027/0134 , G02B2027/0138 , H04S2420/01
摘要: Example systems, devices, media, and methods are described for efficiently processing an audio track of a virtual object with a head-related transfer function (HRTF). Audio tracks are processed by determining a current position (direction and optionally distance) of the virtual object with respect to the head of a user, identifying a current audio zone from predefined audio zones responsive to the determined current position where each of the audio zones has a corresponding left predefined filter and a corresponding right predefined filter, applying the left and the right predefined filters corresponding to the current audio zone to the audio track to produce a left audio signal and a right audio signal, and presenting the left audio signal with a first speaker and the right audio signal with a second speaker.
-
公开(公告)号:US11902534B2
公开(公告)日:2024-02-13
申请号:US17939685
申请日:2022-09-07
申请人: Snap Inc.
CPC分类号: H04N19/156 , G06F1/163 , H04N5/63 , H04N7/0117 , H04N7/0127 , H04N19/40 , G02B2027/0178
摘要: Dynamic transcode throttling methods and devices for processing resource management and thermal mitigation in electronic devices such as eyewear devices. An electronic device monitors its temperature and, responsive to the temperature, configures a transcoding service to operate at different rates. A frame delay module is configured to add a delay between read frames prior to the transcoding service. This enables the electronic device to consume less power when temperatures are too high in order to provide thermal mitigation and can be performed without powering down the electronic device.
-
公开(公告)号:US20240013493A1
公开(公告)日:2024-01-11
申请号:US18360945
申请日:2023-07-28
申请人: Snap Inc.
发明人: Ashwani Arya , Alex Feinman , Daniel Harris , Tejas Bahulkar , Dunxu Hu
IPC分类号: G06T19/00 , G02B27/01 , G06F1/3234 , G06F3/01
CPC分类号: G06T19/006 , G02B27/017 , G06F1/325 , G06F3/017 , G02B2027/0138
摘要: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.
-
公开(公告)号:US11699271B2
公开(公告)日:2023-07-11
申请号:US17746020
申请日:2022-05-17
申请人: Snap Inc.
发明人: Ashwani Arya , Alex Feinman
IPC分类号: G06T19/00 , H04W4/029 , G06F16/9537 , G06F3/01 , G06F3/0354 , G06F3/0482 , G06F3/16 , H04W4/02 , H04W8/00 , G06F1/16 , G10L15/26
CPC分类号: G06T19/006 , G06F3/012 , G06F3/03547 , G06F3/0482 , G06F3/167 , G06F16/9537 , H04W4/023 , H04W4/029 , H04W8/005 , G06F1/163 , G06T2200/24 , G10L15/26
摘要: Example systems, devices, media, and methods are described for presenting a virtual experience using the display of an eyewear device in augmented reality. A content delivery application implements and controls the detecting of beacons broadcast from beacon transmitters deployed at fixed locations and determining the current eyewear location based on the detected beacons. The method includes retrieving content and presenting a virtual experience based on the retrieved content, the beacon data, and a user profile. The virtual experience includes playing audio messages, presenting text on the display, playing video segments on the display, and combinations thereof. In addition to wireless detection of beacons, the method includes scanning and decoding a beacon activation code positioned near the beacon transmitter to access a beacon.
-
公开(公告)号:US20230418385A1
公开(公告)日:2023-12-28
申请号:US17851465
申请日:2022-06-28
申请人: Snap Inc.
发明人: Alex Feinman , Ashwani Arya
摘要: A method for a low-power hand-tracking system is described. In one aspect, a method includes polling a proximity sensor of a wearable device to detect a proximity event, the wearable device includes a low-power processor and a high-power processor, in response to detecting the proximity event, operating a low-power hand-tracking application on the low-power processor based on proximity data from the proximity sensor, and ending an operation of the low-power hand-tracking application in response to at least one of: detecting and recognizing a gesture based on the proximity data, detecting without recognizing the gesture based on the proximity data, or detecting a lack of activity from the proximity sensor within a timeout period based on the proximity data.
-
公开(公告)号:US20230316682A1
公开(公告)日:2023-10-05
申请号:US18206292
申请日:2023-06-06
申请人: Snap Inc.
发明人: Ashwani Arya , Alex Feinman
IPC分类号: G06T19/00 , H04W4/029 , G06F16/9537 , G06F3/01 , G06F3/0354 , G06F3/0482 , G06F3/16 , H04W4/02 , H04W8/00
CPC分类号: G06T19/006 , H04W4/029 , G06F16/9537 , G06F3/012 , G06F3/03547 , G06F3/0482 , G06F3/167 , H04W4/023 , H04W8/005 , G06F1/163
摘要: Example systems, devices, media, and methods are described for presenting a virtual experience using the display of an eyewear device in augmented reality. A content delivery application implements and controls the detecting of beacons broadcast from beacon transmitters deployed at fixed locations and determining the current eyewear location based on the detected beacons. The method includes retrieving content and presenting a virtual experience based on the retrieved content, the beacon data, and a user profile. The virtual experience includes playing audio messages, presenting text on the display, playing video segments on the display, and combinations thereof. In addition to wireless detection of beacons, the method includes scanning and decoding a beacon activation code positioned near the beacon transmitter to access a beacon.
-
公开(公告)号:US20220377491A1
公开(公告)日:2022-11-24
申请号:US17743045
申请日:2022-05-12
申请人: Snap Inc.
发明人: Ashwani Arya , Tejas Bahulkar , Daniel Harris , Daniel C. Wiggins
IPC分类号: H04S7/00 , G10L19/008 , H04R5/033 , H04S3/00
摘要: An electronic eyewear device includes a display and a speaker system adapted to present augment reality objects and associated sounds in a scene being viewed by the user. A processor receives one or more audio tracks respectively associated with one or more augmented reality objects, encodes the audio tracks into an aggregated audio track including the audio tracks, a header for each audio track that uniquely identifies each respective audio track, and an aggregate header that identifies the number of tracks in the aggregated audio track. The processor transfers the aggregated audio track to an audio processor that uses the header for each audio track and the aggregate header to separate the audio tracks from the aggregated audio track. The audio processor processes the audio tracks independently in parallel and provides the audio tracks to the speaker system for presentation with the augmented reality objects.
-
公开(公告)号:US20220375174A1
公开(公告)日:2022-11-24
申请号:US17746020
申请日:2022-05-17
申请人: Snap Inc.
发明人: Ashwani Arya , Alex Feinman
IPC分类号: G06T19/00 , G06F3/01 , G06F3/0354 , G06F3/0482 , G06F3/16 , H04W8/00 , H04W4/02 , H04W4/029 , G06F16/9537
摘要: Example systems, devices, media, and methods are described for presenting a virtual experience using the display of an eyewear device in augmented reality. A content delivery application implements and controls the detecting of beacons broadcast from beacon transmitters deployed at fixed locations and determining the current eyewear location based on the detected beacons. The method includes retrieving content and presenting a virtual experience based on the retrieved content, the beacon data, and a user profile. The virtual experience includes playing audio messages, presenting text on the display, playing video segments on the display, and combinations thereof. In addition to wireless detection of beacons, the method includes scanning and decoding a beacon activation code positioned near the beacon transmitter to access a beacon.
-
公开(公告)号:US20220192622A1
公开(公告)日:2022-06-23
申请号:US17456096
申请日:2021-11-22
申请人: Snap Inc.
发明人: Ashwani Arya , Tejas Bahulkar
摘要: Disclosed is a of monitoring the breathing of a user, comprising receiving a plurality of audio signals from a plurality of microphones and beamforming the plurality of audio signals into a beamformed audio signal. Observed breath-related parameters are derived from the beamformed audio signal and an output of or derived from the observed breath-related parameters is provided to a user of a client device. Breath metrics may be determined by comparing the observed breath-related parameters with reference breath-related parameters, and a breathing score may be derived from the breath metrics. The breathing score may be based on a combination of how closely an observed respiration of the user matches a prompted or desired respiration rate and an observed amount of time that the user's observed respiration rate is within a threshold value of the prompted or desired respiration rate.
-
-
-
-
-
-
-
-
-