-
公开(公告)号:US20240357311A1
公开(公告)日:2024-10-24
申请号:US18761089
申请日:2024-07-01
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Jean-Marc JOT , Samuel Charles DICKER , Mark Brandon HERTENSTEINER , Justin Dan MATHEW , Anastasia Andreyevna TAJIK , Nicholas John LAMARTINA
CPC classification number: H04S7/304 , H04R5/033 , H04R5/04 , H04S3/008 , H04S2400/01 , H04S2400/11 , H04S2420/01
Abstract: Examples of the disclosure describe systems and methods for presenting an audio signal to a user of a wearable head device. According to an example method, a source location corresponding to the audio signal is identified. For each of the respective left and right ear of the user, a virtual speaker position, of a virtual speaker array, is determined, the virtual speaker position collinear with the source location and with a position of the respective ear. For each of the respective left and right ear of the user, a head-related transfer function (HRTF) corresponding to the virtual speaker position and to the respective ear is determined; and the output audio signal is presented to the respective ear of the user via one or more speakers associated with the wearable head device. Processing the audio signal includes applying the HRTF to the audio signal.
-
公开(公告)号:US20240153518A1
公开(公告)日:2024-05-09
申请号:US18282115
申请日:2022-03-18
Applicant: MAGIC LEAP, INC.
Inventor: Benjamin Thomas VONDERSAAR , Remi Samuel AUDFRAY
IPC: G10L21/0208 , G10L21/028 , G10L25/51 , G10L25/72 , H04R1/08 , H04R1/10
CPC classification number: G10L21/0208 , G10L21/028 , G10L25/51 , G10L25/72 , H04R1/08 , H04R1/1075 , G10L2021/02087 , H04R2499/15
Abstract: A headwear device comprises a frame structure configured for being worn on the head of a user, a vibration voice pickup (VVPU) sensor affixed to the frame structure for capturing vibration originating from a voiced sound of a user and generating a vibration signal, at least one microphone affixed to the frame structure for capturing voiced sound from the user and ambient noise, and at least one processor configured for performing an analysis of the vibration signal, and determining that the user has generated the voice sound based on the analysis of the vibration signal.
-
公开(公告)号:US20230396923A1
公开(公告)日:2023-12-07
申请号:US18307713
申请日:2023-04-26
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Jean-Marc JOT , Samuel Charles DICKER
CPC classification number: H04R3/04 , H04R29/001 , H04R2430/01
Abstract: A method of processing an audio signal is disclosed. According to embodiments of the method, magnitude response information of a prototype filter is determined. The magnitude response information includes a plurality of gain values, at least one of which includes a first gain corresponding to a first frequency. The magnitude response information of the prototype filter is stored. The magnitude response information of the prototype filter at the first frequency is retrieved. Gains are computed for a plurality of control frequencies based on the retrieved magnitude response information of the prototype filter at the first frequency, and the computed gains are applied to the audio signal.
-
公开(公告)号:US20230239651A1
公开(公告)日:2023-07-27
申请号:US18180746
申请日:2023-03-08
Applicant: Magic Leap, Inc
Inventor: Remi Samuel AUDFRAY , Mark Brandon HERTENSTEINER , Samuel Charles DICKER , Blaine Ivin WOOD , Michael Z. LAND , Jean-Marc JOT
CPC classification number: H04S7/306 , H04R5/04 , H04R2430/20
Abstract: Disclosed herein are systems and methods for storing, organizing, and maintaining acoustic data for mixed reality systems. A system may include one or more sensors of a head-wearable device, a speaker of the head-wearable device, and one or more processors. A method performed by the one or more processors may include receiving a request to present an audio signal. An environment may be identified via the one or more sensors of the head-wearable device. One or more audio model components associated with the environment may be retrieved. A first audio model may be generated based on the audio model components. A second audio model may be generated based on the first audio model. A modified audio signal may be determined based on the second audio model and based on the request to present an audio signal. The modified audio signal may be presented via the speaker of the head-wearable device.
-
公开(公告)号:US20250048054A1
公开(公告)日:2025-02-06
申请号:US18924155
申请日:2024-10-23
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Jean-Marc JOT , Samuel Charles DICKER
Abstract: Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. A first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the sound source in the virtual environment, and the first intermediate audio signal is associated with a first bus. A second intermediate audio signal is determined. The second intermediate audio signal corresponds to a reverberation of the input audio signal in the virtual environment. The second intermediate audio signal is determined based on a location of the sound source, and further based on an acoustic property of the virtual environment. The second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first and second buses.
-
公开(公告)号:US20240420718A1
公开(公告)日:2024-12-19
申请号:US18700175
申请日:2022-10-13
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Mark Brandon HERTENSTEINER
IPC: G10L21/003 , G06F3/16
Abstract: This disclosure is related to systems and methods for rendering audio for a mixed reality environment. Methods according to embodiments of this disclosure include receiving an input audio signal, via a wearable device in communication with a mixed reality environment, the input audio signal corresponding to a sound source originating from a real environment. In some embodiments, the system can determine one or more acoustic properties associated with the mixed reality environment. In some embodiments, the system can determine a signal modification parameter based on the one or more acoustic properties associated with the mixed reality environment. In some embodiments, the system can apply the signal modification parameter to the input audio signal to determine a second audio signal. The system can present the second audio signal to the user.
-
公开(公告)号:US20230412999A1
公开(公告)日:2023-12-21
申请号:US18455585
申请日:2023-08-24
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Jean-Marc JOT , Samuel Charles DICKER
Abstract: Systems and methods for rendering audio signals are disclosed. In some embodiments, a method may receive an input signal including a first portion and the second portion. A first processing stage comprising a first filter is applied to the first portion to generate a first filtered signal. A second processing stage comprising a second filter is applied to the first portion to generate a second filtered signal. A third processing stage comprising a third filter is applied to the second portion to generate a third filtered signal. A fourth processing stage comprising a fourth filter is applied to the second portion to generate a fourth filtered signal. A first output signal is determined based on a sum of the first filtered signal and the third filtered signal. A second output signal is determined based on a sum of the second filtered signal and the fourth filtered signal. The first output signal is presented to a first ear of a user of a virtual environment, and the second output signal is presented to the second ear of the user. The first portion of the input signal corresponds to a first location in the virtual environment, and the second portion of the input signal corresponds to a second location in the virtual environment.
-
公开(公告)号:US20220038840A1
公开(公告)日:2022-02-03
申请号:US17401090
申请日:2021-08-12
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Jean-Marc JOT , Samuel Charles DICKER , Mark Brandon HERTENSTEINER , Justin Dan MATHEW , Anastasia Andreyevna TAJIK , Nicholas John LaMARTINA
Abstract: Examples of the disclosure describe systems and methods for presenting an audio signal to a user of a wearable head device. According to an example method, a source location corresponding to the audio signal is identified. An acoustic axis corresponding to the audio signal is determined. For each of a respective left and right ear of the user, an angle between the acoustic axis and the respective ear is determined. For each of the respective left and right ear of the user, a virtual speaker position, of a virtual speaker array, is determined, the virtual speaker position collinear with the source location and with a position of the respective ear. The virtual speaker array includes a plurality of virtual speaker positions, each virtual speaker position of the plurality located on the surface of a sphere concentric with the user's head, the sphere having a first radius. For each of the respective left and right ear of the user, a head-related transfer function (HRTF) corresponding to the virtual speaker position and to the respective ear is determined; a source radiation filter is determined based on the determined angle; the audio signal is processed to generate an output audio signal for the respective ear; and the output audio signal is presented to the respective ear of the user via one or more speakers associated with the wearable head device. Processing the audio signal includes applying the HRTF and the source radiation filter to the audio signal.
-
公开(公告)号:US20210176588A1
公开(公告)日:2021-06-10
申请号:US17112969
申请日:2020-12-04
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Mark Brandon HERTENSTEINER , Samuel Charles DICKER , Blaine Ivin WOOD , Michael Z. LAND , Jean-Marc JOT
Abstract: Disclosed herein are systems and methods for storing, organizing, and maintaining acoustic data for mixed reality systems. A system may include one or more sensors of a head-wearable device, a speaker of the head-wearable device, and one or more processors configured to execute a method. A method for execution by the one or more processors may include receiving a request to present an audio signal. An environment may be identified via the one or more sensors of the head-wearable device. One or more audio model components associated with the environment may be retrieved. A first audio model may be generated based on the audio model components. A second audio model may be generated based on the first audio model. A modified audio signal may be determined based on the second audio model and based on the request to present an audio signal. The modified audio signal may be presented via the speaker of the head-wearable device.
-
公开(公告)号:US20200322749A1
公开(公告)日:2020-10-08
申请号:US16905855
申请日:2020-06-18
Applicant: Magic Leap, Inc.
Inventor: Remi Samuel AUDFRAY , Jean-Marc JOT , Samuel Charles DICKER
Abstract: Systems and methods of presenting an output audio signal to a listener located at a first location in a virtual environment are disclosed. According to embodiments of a method, an input audio signal is received. For each sound source of a plurality of sound sources in the virtual environment, a respective first intermediate audio signal corresponding to the input audio signal is determined, based on a location of the respective sound source in the virtual environment, and the respective first intermediate audio signal is associated with a first bus. For each of the sound sources of the plurality of sound sources in the virtual environment, a respective second intermediate audio signal is determined. The respective second intermediate audio signal corresponds to a reverberation of the input audio signal in the virtual environment. The respective second intermediate audio signal is determined based on a location of the respective sound source, and further based on an acoustic property of the virtual environment. The respective second intermediate audio signal is associated with a second bus. The output audio signal is presented to the listener via the first bus and the second bus.
-
-
-
-
-
-
-
-
-