-
公开(公告)号:US20240298138A1
公开(公告)日:2024-09-05
申请号:US18663400
申请日:2024-05-14
Applicant: Snap Inc.
Inventor: Ashwani Arya , Tejas Bahulkar , Daniel Harris , Daniel C. Wiggins
IPC: H04S7/00 , G10L19/008 , H04R5/033 , H04S3/00
CPC classification number: H04S7/304 , G10L19/008 , H04R5/033 , H04S3/008 , H04S2400/01 , H04S2420/01
Abstract: An electronic eyewear device includes a display and a speaker system adapted to present augment reality objects and associated sounds in a scene being viewed by the user. A processor receives one or more audio tracks respectively associated with one or more augmented reality objects, encodes the audio tracks into an aggregated audio track including the audio tracks, a header for each audio track that uniquely identifies each respective audio track, and an aggregate header that identifies the number of tracks in the aggregated audio track. The processor transfers the aggregated audio track to an audio processor that uses the header for each audio track and the aggregate header to separate the audio tracks from the aggregated audio track. The audio processor processes the audio tracks independently in parallel and provides the audio tracks to the speaker system for presentation with the augmented reality objects.
-
公开(公告)号:US12010505B2
公开(公告)日:2024-06-11
申请号:US17743045
申请日:2022-05-12
Applicant: Snap Inc.
Inventor: Ashwani Arya , Tejas Bahulkar , Daniel Harris , Daniel C. Wiggins
IPC: H04S7/00 , G10L19/008 , H04R5/033 , H04S3/00
CPC classification number: H04S7/304 , G10L19/008 , H04R5/033 , H04S3/008 , H04S2400/01 , H04S2420/01
Abstract: An electronic eyewear device includes a display and a speaker system adapted to present augment reality objects and associated sounds in a scene being viewed by the user. A processor receives one or more audio tracks respectively associated with one or more augmented reality objects, encodes the audio tracks into an aggregated audio track including the audio tracks, a header for each audio track that uniquely identifies each respective audio track, and an aggregate header that identifies the number of tracks in the aggregated audio track. The processor transfers the aggregated audio track to an audio processor that uses the header for each audio track and the aggregate header to separate the audio tracks from the aggregated audio track. The audio processor processes the audio tracks independently in parallel and provides the audio tracks to the speaker system for presentation with the augmented reality objects.
-
公开(公告)号:US11756274B1
公开(公告)日:2023-09-12
申请号:US17859588
申请日:2022-07-07
Applicant: Snap Inc.
Inventor: Ashwani Arya , Alex Feinman , Daniel Harris , Tejas Bahulkar , Dunxu Hu
IPC: G06F3/01 , G06T19/00 , G06F1/3234 , G02B27/01
CPC classification number: G06T19/006 , G02B27/017 , G06F1/325 , G06F3/017 , G02B2027/0138
Abstract: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.
-
公开(公告)号:US20230341948A1
公开(公告)日:2023-10-26
申请号:US18307260
申请日:2023-04-26
Applicant: Snap Inc.
Inventor: Daniel Colascione , Daniel Harris , Andrei Rybin , Anoosh Kruba Chandar Mahalingam , Pierre-Yves Santerre , Jennica Pounds
CPC classification number: G06F3/017 , G06T19/006 , G02B27/0172 , G02B2027/0178
Abstract: An AR system includes multiple input-modalities. A hand-tracking pipeline supports Direct Manipulation of Virtual Object (DMVO) and gesture input methodologies. In addition, a voice processing pipeline provides for speech inputs. Direct memory buffer access to preliminary hand-tracking data, such as skeletal models, allows for low latency communication of the data for use by DMVO-based user interfaces. A system framework component routes higher level hand-tracking data, such as gesture identification and symbols generated based on hand positions, via a Snips protocol to gesture-based user interfaces.
-
公开(公告)号:US20220377491A1
公开(公告)日:2022-11-24
申请号:US17743045
申请日:2022-05-12
Applicant: Snap Inc.
Inventor: Ashwani Arya , Tejas Bahulkar , Daniel Harris , Daniel C. Wiggins
IPC: H04S7/00 , G10L19/008 , H04R5/033 , H04S3/00
Abstract: An electronic eyewear device includes a display and a speaker system adapted to present augment reality objects and associated sounds in a scene being viewed by the user. A processor receives one or more audio tracks respectively associated with one or more augmented reality objects, encodes the audio tracks into an aggregated audio track including the audio tracks, a header for each audio track that uniquely identifies each respective audio track, and an aggregate header that identifies the number of tracks in the aggregated audio track. The processor transfers the aggregated audio track to an audio processor that uses the header for each audio track and the aggregate header to separate the audio tracks from the aggregated audio track. The audio processor processes the audio tracks independently in parallel and provides the audio tracks to the speaker system for presentation with the augmented reality objects.
-
公开(公告)号:US20240192780A1
公开(公告)日:2024-06-13
申请号:US18078547
申请日:2022-12-09
Applicant: Snap Inc.
Inventor: Liviu Marius Coconu , Daniel Colascione , Farid Zare Seisan , Daniel Harris , Jennica Pounds
CPC classification number: G06F3/017 , G06F3/011 , G06T11/00 , G06V10/764 , G06V10/955 , G06V20/20 , G06V40/28
Abstract: A multi-System on Chip (SoC) hand-tracking platform is provided. The multi-SoC hand-tracking platform includes a computer vision SoC and one or more application SoCs. The computer vision SoC hosts a hand-tracking input pipeline. The one or more application SoCs host one or more applications that are consumers of input event data generated by the hand-tracking input pipeline. The applications communicate with some components of the hand-tracking input pipeline using a shared-memory buffer and with some of the components of the hand-tracking input pipeline using Inter-Process Communication (IPC) method calls.
-
公开(公告)号:US12211158B2
公开(公告)日:2025-01-28
申请号:US18360945
申请日:2023-07-28
Applicant: Snap Inc.
Inventor: Ashwani Arya , Alex Feinman , Daniel Harris , Tejas Bahulkar , Dunxu Hu
IPC: G06T19/00 , G02B27/01 , G06F1/3234 , G06F3/01
Abstract: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.
-
公开(公告)号:US20240013493A1
公开(公告)日:2024-01-11
申请号:US18360945
申请日:2023-07-28
Applicant: Snap Inc.
Inventor: Ashwani Arya , Alex Feinman , Daniel Harris , Tejas Bahulkar , Dunxu Hu
IPC: G06T19/00 , G02B27/01 , G06F1/3234 , G06F3/01
CPC classification number: G06T19/006 , G02B27/017 , G06F1/325 , G06F3/017 , G02B2027/0138
Abstract: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.
-
-
-
-
-
-
-