公开(公告)号：WO2021045892A1

公开(公告)日：2021-03-11

申请号：PCT/US2020/046575

申请日：2020-08-15

Applicant: FACEBOOK TECHNOLOGIES, LLC

Inventor： ITHAPU, Vamsi Krishna ,  CHO, Sang-Ik Terry

IPC: H04R3/04 ,  H04R1/10 ,  H04S7/00 ,  G06K9/00 ,  G06K9/62 ,  G06K9/32 ,  G06K9/46

Abstract: A method for generating an individualized audio output response for a headset using a machine learning model. One or more images of a portion of a user's head including at least the user's ear are received. One or more features describing the user's ear are identified based on the one or more images. The features are input to a model, and the model is configured to determine an audio output response for the user based on the identified one or more features. The audio output response describes one or more acoustic parameters perceived by the user. An individualized audio output response is generated for the user based on the audio output response, the individualized audio output response configured to adjust one or more acoustic parameters of audio content provided to the user by the headset.

公开(公告)号：WO2021045869A1

公开(公告)日：2021-03-11

申请号：PCT/US2020/045534

申请日：2020-08-08

Applicant: FACEBOOK TECHNOLOGIES, LLC

Inventor： ITHAPU, Vamsi Krishna ,  BRIMIJOIN, William Owen ,  HASSAGER, Henrik Gert

IPC: H04S7/00

Abstract: An audio system generates customized head-related transfer functions (HRTFs) for a user. The audio system receives an initial set of estimated HRTFs. The initial set of HRTFs may have been estimated using a trained machine learning and computer vision system and pictures of the user's ears. The audio system generates a set of test locations using the initial set of HRTFs. The audio system presents test sounds at each of the initial set of test locations using the initial set of HRTFs. The audio system monitors user responses to the test sounds. The audio system uses the monitored responses to generate a new set of estimated HRTFs and a new set of test locations. The process repeats until a threshold accuracy is achieved or until a set period of time expires. The audio system presents audio content to the user using the customized HRTFs.

公开(公告)号：WO2021202057A1

公开(公告)日：2021-10-07

申请号：PCT/US2021/021289

申请日：2021-03-08

Applicant: FACEBOOK TECHNOLOGIES, LLC

Inventor： ITHAPU, Vamsi Krishna ,  MILLER, Antonio John ,  KHALEGHIMEYBODI, Morteza

IPC: H04R25/00 ,  H04R29/00 ,  H04R1/10 ,  H04R1/1091 ,  H04R2460/13 ,  H04R2499/15 ,  H04R25/30 ,  H04R29/001 ,  H04S2420/01 ,  H04S7/30

Abstract: Embodiments relate to calibrating head-related transfer functions (HRTFs) for a user of an audio system (e.g., as a component of a headset) using cartilage conducted sounds. A test sound is presented to a user using a transducer (e.g., cartilage conduction) and an audio signal is responsively received via a microphone at an entrance to the user's ear canal. The test sound and audio signal combination may be provided to an audio server where a model is used to determine one or more HRTFs for the user. Information describing the one or more HRTFs is provided to the audio system to be used for providing audio to the user. The audio server may also use a model to determine geometric information describing a pinna of the user based on the combination. In one embodiment, the geometric information is used to determine the one or more HRTFs for the user.

公开(公告)号：WO2021045891A1

公开(公告)日：2021-03-11

申请号：PCT/US2020/046573

申请日：2020-08-15

Applicant: FACEBOOK TECHNOLOGIES, LLC

Inventor： FAUNDEZ HOFFMANN, Pablo Francisco ,  ITHAPU, Vamsi Krishna ,  CHO, Sang-Ik Terry ,  MIRBAGHERI, Majid

IPC: H04R3/04 ,  H04R1/10 ,  H04S7/00 ,  G06K9/00 ,  G06K9/62 ,  G06K9/32

Abstract: A method for generating an individualized audio output response for a headset based on a representation of a user's ear. One or more images of a portion of a user's head including at least the user's ear are received. A representation of the user's ear is generated based in part on the one or more images. A simulation of sound propagation from an audio source to the user's ear is performed based on the representation. An individualized audio output response is generated for the user based on the simulation, the individualized audio output response configured to adjust one or more acoustic parameters of audio content provided to the user by the headset.

公开(公告)号：WO2021021643A1

公开(公告)日：2021-02-04

申请号：PCT/US2020/043529

申请日：2020-07-24

Applicant: FACEBOOK TECHNOLOGIES, LLC

Inventor： TOURBABIN, Vladimir ,  DONLEY, Jacob Ryan ,  ITHAPU, Vamsi Krishna

IPC: G07C9/37 ,  H04L29/06 ,  H04R1/10 ,  H04S7/00

Abstract: A wearable device includes an audio system. In one embodiment, the audio system includes a sensor array that includes a plurality of acoustic sensors. When a user wears the wearable device, the audio system determines an acoustic transfer function for the user based upon detected sounds within a local area surrounding the sensor array. Because the acoustic transfer function is based upon the size, shape, and density of the user's body (e.g., the user's head), different acoustic transfer functions will be determined for different users. The determined acoustic transfer functions are compared with stored acoustic transfer functions of known users in order to authenticate the user of the wearable device.