-
公开(公告)号:US11770671B2
公开(公告)日:2023-09-26
申请号:US18069702
申请日:2022-12-21
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel Audfray , Jean-Marc Jot , Samuel Charles Dicker
CPC classification number: H04S7/304 , G02B27/017 , G10K15/10 , H04R3/04 , H04R3/12 , H04R5/033 , H04R5/04 , H04S3/008 , H04S7/305 , G02B2027/0178 , H04R2499/15 , H04S2400/01 , H04S2400/13 , H04S2400/15 , H04S2420/11
Abstract: Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. A first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the sound source in the virtual environment, and the first intermediate audio signal is associated with a first bus. A second intermediate audio signal is determined. The second intermediate audio signal corresponds to a reverberation of the input audio signal in the virtual environment. The second intermediate audio signal is determined based on a location of the sound source, and further based on an acoustic property of the virtual environment. The second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first and second buses.
-
公开(公告)号:US20230245642A1
公开(公告)日:2023-08-03
申请号:US18296901
申请日:2023-04-06
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Jean-Marc Jot , Samuel Charles Dicker
IPC: G10K15/08
CPC classification number: G10K15/08
Abstract: Systems and methods for providing accurate and independent control of reverberation properties are disclosed. In some embodiments, a system may include a reverberation processing system, a direct processing system, and a combiner. The reverberation processing system can include a reverb initial power (RIP) control system and a reverberator. The RIP control system can include a reverb initial gain (RIG) and a RIP corrector. The RIG can be configured to apply a RIG value to the input signal, and the RIP corrector can be configured to apply a RIP correction factor to the signal from the RIG. The reverberator can be configured to apply reverberation effects to the signal from the RIP control system. In some embodiments, one or more values and/or correction factors can be calculated and applied such that the signal output from a component in the reverberation processing system is normalized to a predetermined value (e.g., unity (1.0)).
-
公开(公告)号:US20220132264A1
公开(公告)日:2022-04-28
申请号:US17516407
申请日:2021-11-01
Applicant: Magic Leap, Inc.
Inventor: Samuel Charles Dicker , Harsh Mayur Barbhaiya
Abstract: Examples of the disclosure describe systems and methods for presenting an audio signal to a user of a wearable head device. According to an example method, a first input audio signal is received, the first input audio signal corresponding to a source location in a virtual environment presented to the user via the wearable head device. The first input audio signal is processed to generate a left output audio signal and a right output audio signal. The left output audio signal is presented to the left ear of the user via a left speaker associated with the wearable head device. The right output audio signal is presented to the right ear of the user via a right speaker associated with the wearable head device. Processing the first input audio signal comprises applying a delay process to the first input audio signal to generate a left audio signal and a right audio signal; adjusting a gain of the left audio signal; adjusting a gain of the right audio signal; applying a first head-related transfer function (HRTF) to the left audio signal to generate the left output audio signal; and applying a second HRTF to the right audio signal to generate the right output audio signal. Applying the delay process to the first input audio signal comprises applying an interaural time delay (ITD) to the first input audio signal, the ITD determined based on the source location.
-
公开(公告)号:US10810992B2
公开(公告)日:2020-10-20
申请号:US16442359
申请日:2019-06-14
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel Audfray , Jean-Marc Jot , Samuel Charles Dicker
Abstract: Systems and methods for providing accurate and independent control of reverberation properties are disclosed. In some embodiments, a system may include a reverberation processing system, a direct processing system, and a combiner. The reverberation processing system can include a reverb initial power (RIP) control system and a reverberator. The RIP control system can include a reverb initial gain (RIG) and a RIP corrector. The RIG can be configured to apply a RIG value to the input signal, and the RIP corrector can be configured to apply a RIP correction factor to the signal from the RIG. The reverberator can be configured to apply reverberation effects to the signal from the RIP control system. In some embodiments, one or more values and/or correction factors can be calculated and applied such that the signal output from a component in the reverberation processing system is normalized to a predetermined value (e.g., unity (1.0)).
-
公开(公告)号:US10779082B2
公开(公告)日:2020-09-15
申请号:US16427315
申请日:2019-05-30
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel Audfray , Jean-Marc Jot , Samuel Charles Dicker
Abstract: A method of processing an audio signal is disclosed. According to embodiments of the method, magnitude response information of a prototype filter is determined. The magnitude response information includes a plurality of gain values, at least one of which includes a first gain corresponding to a first frequency. The magnitude response information of the prototype filter is stored. The magnitude response information of the prototype filter at the first frequency is retrieved. Gains are computed for a plurality of control frequencies based on the retrieved magnitude response information of the prototype filter at the first frequency, and the computed gains are applied to the audio signal.
-
公开(公告)号:US20190379992A1
公开(公告)日:2019-12-12
申请号:US16438358
申请日:2019-06-11
Applicant: Magic Leap, Inc.
Inventor: Brian Lloyd SCHMIDT , Samuel Charles Dicker
IPC: H04S7/00 , G10L19/008 , H04S3/00 , G10L25/21
Abstract: An audio system and method of spatially rendering audio signals that uses modified virtual speaker panning is disclosed. The audio system may include a fixed number F of virtual speakers, and the modified virtual speaker panning may dynamically select and use a subset P of the fixed virtual speakers. The subset P of virtual speakers may be selected using a low energy speaker detection and culling method, a source geometry-based culling method, or both. One or more processing blocks in the decoder/virtualizer may be bypassed based on the energy level of the associated audio signal or the location of the sound source relative to the user/listener, respectively. In some embodiments, a virtual speaker that is designated as an active virtual speaker at a first time, may also be designated as an active virtual speaker at a second time to ensure the processing completes.
-
公开(公告)号:US12120499B2
公开(公告)日:2024-10-15
申请号:US18486938
申请日:2023-10-13
Applicant: Magic Leap, Inc.
Inventor: Brian Lloyd Schmidt , Samuel Charles Dicker
IPC: H04S7/00 , G10L19/008 , G10L25/21 , H04S3/00
CPC classification number: H04S7/303 , G10L19/008 , G10L25/21 , H04S3/008 , H04S2400/01 , H04S2420/01
Abstract: An audio system and method of spatially rendering audio signals that uses modified virtual speaker panning is disclosed. The audio system may include a fixed number F of virtual speakers, and the modified virtual speaker panning may dynamically select and use a subset P of the fixed virtual speakers. The subset P of virtual speakers may be selected using a low energy speaker detection and culling method, a source geometry-based culling method, or both. One or more processing blocks in the decoder/virtualizer may be bypassed based on the energy level of the associated audio signal or the location of the sound source relative to the user/listener, respectively. In some embodiments, a virtual speaker that is designated as an active virtual speaker at a first time, may also be designated as an active virtual speaker at a second time to ensure the processing completes.
-
公开(公告)号:US11863965B2
公开(公告)日:2024-01-02
申请号:US18161618
申请日:2023-01-30
Applicant: Magic Leap, Inc.
Inventor: Samuel Charles Dicker , Harsh Mayur Barbhaiya
CPC classification number: H04S7/304 , H04R3/04 , H04R5/033 , H04R5/04 , H04S3/008 , H04S7/307 , H04S2400/01 , H04S2400/11 , H04S2400/13 , H04S2420/01
Abstract: Examples of the disclosure describe systems and methods for presenting an audio signal to a user of a wearable head device. In an example, a received first input audio signal is processed to generate a left output audio signal and a right output audio signal presented to ears of the user. Processing the first input audio signal comprises applying a delay process to the first input audio signal to generate a left audio signal and a right audio signal; adjusting gains of the left audio signal and the right audio signal; applying head-related transfer functions (HRTFs) to the left and right audio signals to generate the left and right output audio signals. Applying the delay process to the first input audio signal comprises applying an interaural time delay (ITD) to the first input audio signal, the ITD determined based on the source location.
-
公开(公告)号:US20230413007A1
公开(公告)日:2023-12-21
申请号:US18461289
申请日:2023-09-05
Applicant: Magic Leap, Inc.
Inventor: Jean-Marc Jot , Samuel Charles Dicker , Brian Lloyd Schmidt , Remi Samuel Audfray
CPC classification number: H04S7/304 , H04R5/033 , H04R5/04 , H04S3/008 , G10K15/10 , H04R3/04 , G02B27/017 , H04R3/12 , H04S7/305 , H04S2400/13 , H04S2400/01 , H04S2400/15 , H04R2499/15 , G02B2027/0178 , H04S2420/11
Abstract: Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. For each sound source of a plurality of sound sources in the virtual environment, a respective first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the respective sound source in the virtual environment, and the respective first intermediate audio signal is associated with a first bus. For each of the sound sources of the plurality of sound sources in the virtual environment, a respective second intermediate audio signal is determined. The respective second intermediate audio signal corresponds to a reflection of the input audio signal in a surface of the virtual environment. The respective second intermediate audio signal is determined based on a location of the respective sound source, and further based on an acoustic property of the virtual environment. The respective second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first bus and the second bus.
-
公开(公告)号:US11778411B2
公开(公告)日:2023-10-03
申请号:US18061367
申请日:2022-12-02
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel Audfray , Jean-Marc Jot , Samuel Charles Dicker , Mark Brandon Hertensteiner , Justin Dan Mathew , Anastasia Andreyevna Tajik , Nicholas John LaMartina
CPC classification number: H04S7/304 , H04R5/033 , H04R5/04 , H04S3/008 , H04S2400/01 , H04S2400/11 , H04S2420/01
Abstract: Examples of the disclosure describe systems and methods for presenting an audio signal to a user of a wearable head device. According to an example method, a source location corresponding to the audio signal is identified. For each of the respective left and right ear of the user, a virtual speaker position, of a virtual speaker array, is determined, the virtual speaker position collinear with the source location and with a position of the respective ear. For each of the respective left and right ear of the user, a head-related transfer function (HRTF) corresponding to the virtual speaker position and to the respective ear is determined; and the output audio signal is presented to the respective ear of the user via one or more speakers associated with the wearable head device. Processing the audio signal includes applying the HRTF to the audio signal.
-
-
-
-
-
-
-
-
-