-
公开(公告)号:US10863300B2
公开(公告)日:2020-12-08
申请号:US16445171
申请日:2019-06-18
Applicant: Magic Leap, Inc.
Inventor: Jean-Marc Jot , Samuel Charles Dicker , Brian Lloyd Schmidt , Remi Samuel Audfray
Abstract: Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. For each sound source of a plurality of sound sources in the virtual environment, a respective first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the respective sound source in the virtual environment, and the respective first intermediate audio signal is associated with a first bus. For each of the sound sources of the plurality of sound sources in the virtual environment, a respective second intermediate audio signal is determined. The respective second intermediate audio signal corresponds to a reflection of the input audio signal in a surface of the virtual environment. The respective second intermediate audio signal is determined based on a location of the respective sound source, and further based on an acoustic property of the virtual environment. The respective second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first bus and the second bus.
-
22.
公开(公告)号:US20200183171A1
公开(公告)日:2020-06-11
申请号:US16790576
申请日:2020-02-13
Applicant: Magic Leap, Inc.
Inventor: Nastasja U. Robaina , Nicole Elizabeth Samec , Christopher M. Harrises , Rony Abovitz , Mark Baerenrodt , Brian Lloyd Schmidt
Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display augmented reality image content to the user. The display system can include one or more user sensors configured to sense the user and can include one or more environmental sensors configured to sense surroundings of the user. The display system can also include processing electronics in communication with the display, the one or more user sensors, and the one or more environmental sensors. The processing electronics can be configured to sense a situation involving user focus, determine user intent for the situation, and alter user perception of a real or virtual object within the vision field of the user based at least in part on the user intent and/or sensed situation involving user focus. The processing electronics can be configured to at least one of enhance or de-emphasize the user perception of the real or virtual object within the vision field of the user.
-
23.
公开(公告)号:US12253680B2
公开(公告)日:2025-03-18
申请号:US18475688
申请日:2023-09-27
Applicant: Magic Leap, Inc.
Inventor: Nastasja U. Robaina , Nicole Elizabeth Samec , Christopher M. Harrises , Rony Abovitz , Mark Baerenrodt , Brian Lloyd Schmidt
IPC: G02B27/01 , A61B17/00 , A61B34/00 , A61B34/20 , A61B90/00 , A61B90/50 , G06F3/01 , G06F3/03 , G06T19/00
Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display augmented reality image content to the user. The display system can include one or more user sensors configured to sense the user and can include one or more environmental sensors configured to sense surroundings of the user. The display system can also include processing electronics in communication with the display, the one or more user sensors, and the one or more environmental sensors. The processing electronics can be configured to sense a situation involving user focus, determine user intent for the situation, and alter user perception of a real or virtual object within the vision field of the user based at least in part on the user intent and/or sensed situation involving user focus. The processing electronics can be configured to at least one of enhance or de-emphasize the user perception of the real or virtual object within the vision field of the user.
-
公开(公告)号:US12133043B2
公开(公告)日:2024-10-29
申请号:US18327709
申请日:2023-06-01
Applicant: Magic Leap, Inc.
Inventor: Brian Lloyd Schmidt , David Thomas Roach , Michael Z. Land , Richard D. Herr
IPC: H04R1/10 , H04M1/05 , H04M1/60 , H04R1/02 , H04R3/14 , H04R5/033 , H04R5/04 , H04S1/00 , H04S7/00 , G02C11/00 , G02C11/06 , H04R1/26 , H04R1/28 , H04R1/34
CPC classification number: H04R1/1066 , H04M1/05 , H04M1/6058 , H04R1/028 , H04R1/1008 , H04R1/1041 , H04R1/105 , H04R1/1075 , H04R1/1083 , H04R3/14 , H04R5/0335 , H04R5/04 , H04S1/007 , H04S7/304 , G02C11/06 , G02C11/10 , H04R1/1016 , H04R1/26 , H04R1/2842 , H04R1/2857 , H04R1/345 , H04R2499/15 , H04S2400/11 , H04S2400/15 , H04S2420/01
Abstract: A head-worn sound reproduction device is provided in the form of left and right earphones, which can either be clipped to each ear or mounted on other headgear. The earphones deliver high fidelity audio to a user's eardrums from near-ear range, in a lightweight form factor that is fully “non-blocking” (allows coupling in and natural hearing of ambient sound). Each earphone has a woofer component that produces bass frequencies, and a tweeter component that produces treble frequencies. The woofer outputs the bass frequencies from a position close to the ear canal, while the tweeter outputs treble frequencies from a position that is either close to the ear canal or further away. In certain embodiments, the tweeter is significantly further from the ear canal than the woofer, leading to a more expansive perceived “sound stage”, but still with a “pure” listening experience.
-
公开(公告)号:US11843931B2
公开(公告)日:2023-12-12
申请号:US18053717
申请日:2022-11-08
Applicant: Magic Leap, Inc.
Inventor: Brian Lloyd Schmidt , Samuel Charles Dicker
IPC: H04S7/00 , G10L19/008 , G10L25/21 , H04S3/00
CPC classification number: H04S7/303 , G10L19/008 , G10L25/21 , H04S3/008 , H04S2400/01 , H04S2420/01
Abstract: An audio system and method of spatially rendering audio signals that uses modified virtual speaker panning is disclosed. The audio system may include a fixed number F of virtual speakers, and the modified virtual speaker panning may dynamically select and use a subset P of the fixed virtual speakers. The subset P of virtual speakers may be selected using a low energy speaker detection and culling method, a source geometry-based culling method, or both. One or more processing blocks in the decoder/virtualizer may be bypassed based on the energy level of the associated audio signal or the location of the sound source relative to the user/listener, respectively. In some embodiments, a virtual speaker that is designated as an active virtual speaker at a first time, may also be designated as an active virtual speaker at a second time to ensure the processing completes.
-
公开(公告)号:US11722812B2
公开(公告)日:2023-08-08
申请号:US17517579
申请日:2021-11-02
Applicant: Magic Leap, Inc.
Inventor: Brian Lloyd Schmidt , David Thomas Roach , Michael Z. Land , Richard D. Herr
IPC: H04R1/10 , H04R5/033 , H04M1/05 , H04M1/60 , H04S7/00 , H04R1/02 , H04R3/14 , H04R5/04 , H04S1/00 , G02C11/00 , G02C11/06 , H04R1/34 , H04R1/28 , H04R1/26
CPC classification number: H04R1/1066 , H04M1/05 , H04M1/6058 , H04R1/028 , H04R1/105 , H04R1/1008 , H04R1/1041 , H04R1/1075 , H04R1/1083 , H04R3/14 , H04R5/0335 , H04R5/04 , H04S1/007 , H04S7/304 , G02C11/06 , G02C11/10 , H04R1/1016 , H04R1/26 , H04R1/2842 , H04R1/2857 , H04R1/345 , H04R2499/15 , H04S2400/11 , H04S2400/15 , H04S2420/01
Abstract: A head-worn sound reproduction device is provided in the form of left and right earphones, which can either be clipped to each ear or mounted on other headgear. The earphones deliver high fidelity audio to a user's eardrums from near-ear range, in a lightweight form factor that is fully “non-blocking” (allows coupling in and natural hearing of ambient sound). Each earphone has a woofer component that produces bass frequencies, and a tweeter component that produces treble frequencies. The woofer outputs the bass frequencies from a position close to the ear canal, while the tweeter outputs treble frequencies from a position that is either close to the ear canal or further away. In certain embodiments, the tweeter is significantly further from the ear canal than the woofer, leading to a more expansive perceived “sound stage”, but still with a “pure” listening experience.
-
公开(公告)号:US20230139901A1
公开(公告)日:2023-05-04
申请号:US18053717
申请日:2022-11-08
Applicant: Magic Leap, Inc.
Inventor: Brian Lloyd Schmidt , Samuel Charles Dicker
IPC: H04S7/00 , G10L19/008 , G10L25/21 , H04S3/00
Abstract: An audio system and method of spatially rendering audio signals that uses modified virtual speaker panning is disclosed. The audio system may include a fixed number F of virtual speakers, and the modified virtual speaker panning may dynamically select and use a subset P of the fixed virtual speakers. The subset P of virtual speakers may be selected using a low energy speaker detection and culling method, a source geometry-based culling method, or both. One or more processing blocks in the decoder/virtualizer may be bypassed based on the energy level of the associated audio signal or the location of the sound source relative to the user/listener, respectively. In some embodiments, a virtual speaker that is designated as an active virtual speaker at a first time, may also be designated as an active virtual speaker at a second time to ensure the processing completes.
-
公开(公告)号:US11528576B2
公开(公告)日:2022-12-13
申请号:US16703767
申请日:2019-12-04
Applicant: Magic Leap, Inc.
Inventor: George A. Sanger , Brian Lloyd Schmidt , Anastasia A. Tajik , Terry Micheal O'Gara , David Matthew Shumway , Alan Steven Howarth
Abstract: Systems, devices, and methods for capturing audio which can be used in applications such as virtual reality, augmented reality, and mixed reality systems. Some systems can include a plurality of distributed monitoring devices. Each monitoring device can include a microphone and a location tracking unit. The monitoring devices can capture audio signals in an environment, as well as location tracking signals which respectively indicate the locations of the monitoring devices over time during capture of the audio signals. The system can also include a processor to receive the audio signals and the location tracking signals. The processor can determine one or more acoustic properties of the environment based on the audio signals and the location tracking signals.
-
29.
公开(公告)号:US20220107502A1
公开(公告)日:2022-04-07
申请号:US17644776
申请日:2021-12-16
Applicant: Magic Leap, Inc.
Inventor: Nastasja U. Robaina , Nicole Elizabeth Samec , Christopher M. Harrises , Rony Abovitz , Mark Baerenrodt , Brian Lloyd Schmidt
Abstract: A display system can include a head-mounted display configured to project light to an eye of a user to display augmented reality image content to the user. The display system can include one or more user sensors configured to sense the user and can include one or more environmental sensors configured to sense surroundings of the user. The display system can also include processing electronics in communication with the display, the one or more user sensors, and the one or more environmental sensors. The processing electronics can be configured to sense a situation involving user focus, determine user intent for the situation, and alter user perception of a real or virtual object within the vision field of the user based at least in part on the user intent and/or sensed situation involving user focus. The processing electronics can be configured to at least one of enhance or de-emphasize the user perception of the real or virtual object within the vision field of the user.
-
公开(公告)号:US10531220B2
公开(公告)日:2020-01-07
申请号:US15813020
申请日:2017-11-14
Applicant: Magic Leap, Inc.
Inventor: George A. Sanger , Brian Lloyd Schmidt , Anastasia A. Tajik , Terry Micheal O'Gara , David Matthew Shumway , Alan Steven Howarth
Abstract: Systems and methods for capturing audio which can be used in applications such as virtual reality, augmented reality, and mixed reality systems. Some systems may include a plurality of distributed monitoring devices in an environment, each having a microphone and a location tracking unit. The system can capture audio signals while also capturing location tracking signals which indicate the locations of the monitoring devices over time during capture of the audio signals. The system can generate a representation of at least a portion of a sound wave field in the environment based on the audio signals and the location tracking signals. The system may also determine one or more acoustic properties of the environment based on the audio signals and the location tracking signals.
-
-
-
-
-
-
-
-
-