公开(公告)号：US20130332156A1

公开(公告)日：2013-12-12

申请号：US13775100

申请日：2013-02-22

Applicant: APPLE INC.

Inventor： Onur Ergin Tackin ,  Sinan Karahan ,  Lalin S. Theverapperuma ,  Tiange Shao ,  Haining Zhang ,  Arun G. Mathias

IPC: H04R29/00 ,  G10L21/0216

CPC classification number: H04R29/004 ,  G10L21/0216 ,  G10L25/78 ,  H03G3/3005 ,  H03G3/3089 ,  H04M1/6008 ,  H04M1/6041 ,  H04M2250/12 ,  H04R3/005 ,  H04R3/02 ,  H04R2499/11

Abstract: The disclosed system and method for a mobile device combines information derived from onboard sensors with conventional signal processing information derived from a speech or audio signal to assist in noise and echo cancellation. In some implementations, an Angle and Distance Processing (ADP) module is employed on a mobile device and configured to provide runtime angle and distance information to an adaptive beamformer for canceling noise signals, provides a means for building a table of filter coefficients for adaptive filters used in echo cancellation, provides faster and more accurate Automatic Gain Control (AGC), provides delay information for a classifier in a Voice Activity Detector (VAD), provides a means for automatic switching between a speakerphone and handset mode of the mobile device, or primary microphone and reference microphones and assists in separating echo path changes from double talk.

Abstract translation: 所公开的用于移动设备的系统和方法将从车载传感器获得的信息与从语音或音频信号导出的常规信号处理信息相结合，以帮助噪声和回波消除。 在一些实现中，在移动设备上采用角度和距离处理（ADP）模块，并且被配置为向自适应波束形成器提供运行时间角度和距离信息以消除噪声信号，提供用于建立自适应滤波器的滤波器系数表的装置 用于回声消除，提供更快更准确的自动增益控制（AGC），为语音活动检测器（VAD）中的分类器提供延迟信息，提供了在移动设备的免提电话和手机模式之间自动切换的手段，或 主麦克风和参考麦克风，有助于将回声路径变化与双方通话分离。

公开(公告)号：US10482899B2

公开(公告)日：2019-11-19

申请号：US15225707

申请日：2016-08-01

Applicant: Apple Inc.

Inventor： Sean A. Ramprashad ,  Esge B. Andersen ,  Joshua D. Atkins ,  Sorin V. Dusan ,  Vasu Iyengar ,  Tarun Pruthi ,  Lalin S. Theverapperuma

IPC: G10L21/028 ,  G10L25/21 ,  G10L21/0216

Abstract: An audio system has a housing in which are integrated a number of microphones. A programmed processor accesses the microphone signals and produces a number of acoustic pick up beams based groups of microphones, an estimation of voice activity and an estimation of noise characteristics on each beam. Two or more beams including a voice beam that is used to pick up a desired voice and a noise beam that is used to provide information to estimate ambient noise are adaptively selected from among the plurality of beams, based on thresholds for voice separation and thresholds for noise-matching. Other embodiments are also described and claimed.

公开(公告)号：US09516159B2

公开(公告)日：2016-12-06

申请号：US14880824

申请日：2015-10-12

Applicant: Apple Inc.

Inventor： Lalin S. Theverapperuma ,  Vasu Iyengar ,  Sean A. Ramprashad

IPC: H04B1/38 ,  H04M3/00 ,  G10L21/0208 ,  G10L21/02 ,  H04M1/60 ,  H04L5/14 ,  H04M9/08 ,  G10L21/0264 ,  G10L21/0216

CPC classification number: H04M3/002 ,  G10L21/0205 ,  G10L21/0208 ,  G10L21/0264 ,  G10L2021/02082 ,  G10L2021/02161 ,  G10L2021/02165 ,  H04L5/14 ,  H04M1/60 ,  H04M1/6041 ,  H04M9/082

Abstract: System of improving sound quality includes loudspeaker, microphone, accelerometer, acoustic-echo-cancellers (AEC), and double-talk detector (DTD). Loudspeaker outputs loudspeaker signal including downlink audio signal from far-end speaker. Microphone generates microphone uplink signal and receives at least one of: near-end speaker, ambient noise, and loudspeaker signals. Accelerometer generates accelerometer-uplink signal and receives at least one of: near-end speaker, ambient noise, and loudspeaker signals. First AEC receives downlink audio, microphone-uplink and double talk control signals, and generates AEC-microphone linear echo estimate and corrected AEC-microphone uplink signal. Second AEC receives downlink audio, accelerometer uplink and double talk control signals, and generates AEC-accelerometer linear echo estimate and corrected AEC-accelerometer uplink signal. DTD receives downlink audio signal, uplink signals, corrected uplink signals, linear echo estimates, and generates double-talk control signal. Uplink audio signal including at least one of corrected microphone-uplink signal and corrected accelerometer-uplink signal is generated. Other embodiments are described.

Abstract translation: 提高音质的系统包括扬声器，麦克风，加速度计，声回波消除器（AEC）和双通话检测器（DTD）。 扬声器输出包括来自远端扬声器的下行音频信号的扬声器信号。 麦克风产生麦克风上行链路信号，并接收以下至少一个：近端扬声器，环境噪声和扬声器信号。 加速度计产生加速度计 - 上行链路信号并接收以下至少一种：近端扬声器，环境噪声和扬声器信号。 第一AEC接收下行音频，麦克风上行和双通话控制信号，并生成AEC麦克风线性回波估计和校正的AEC麦克风上行信号。 第二个AEC接收下行音频，加速度计上行链路和双通道控制信号，并生成AEC加速度计线性回波估计和校正的AEC加速度计上行信号。 DTD接收下行链路音频信号，上行链路信号，校正的上行链路信号，线性回波估计，并产生双向对话控制信号。 产生包括校正的麦克风 - 上行链路信号和校正的加速度计 - 上行链路信号中的至少一个的上行链路音频信号。 描述其他实施例。

公开(公告)号：US20160127535A1

公开(公告)日：2016-05-05

申请号：US14880824

申请日：2015-10-12

Applicant: Apple Inc.

Inventor： Lalin S. Theverapperuma ,  Vasu Iyengar ,  Sean A. Ramprashad

IPC: H04M3/00 ,  H04L5/14 ,  G10L21/0264 ,  H04M1/60 ,  G10L21/0208 ,  G10L21/02

CPC classification number: H04M3/002 ,  G10L21/0205 ,  G10L21/0208 ,  G10L21/0264 ,  G10L2021/02082 ,  G10L2021/02161 ,  G10L2021/02165 ,  H04L5/14 ,  H04M1/60 ,  H04M1/6041 ,  H04M9/082

Abstract: System of improving sound quality includes loudspeaker, microphone, accelerometer, acoustic-echo-cancellers (AEC), and double-talk detector (DTD). Loudspeaker outputs loudspeaker signal including downlink audio signal from far-end speaker. Microphone generates microphone uplink signal and receives at least one of: near-end speaker, ambient noise, and loudspeaker signals. Accelerometer generates accelerometer-uplink signal and receives at least one of: near-end speaker, ambient noise, and loudspeaker signals. First AEC receives downlink audio, microphone-uplink and double talk control signals, and generates AEC-microphone linear echo estimate and corrected AEC-microphone uplink signal. Second AEC receives downlink audio, accelerometer uplink and double talk control signals, and generates AEC-accelerometer linear echo estimate and corrected AEC-accelerometer uplink signal. DTD receives downlink audio signal, uplink signals, corrected uplink signals, linear echo estimates, and generates double-talk control signal. Uplink audio signal including at least one of corrected microphone-uplink signal and corrected accelerometer-uplink signal is generated. Other embodiments are described.

Abstract translation: 提高音质的系统包括扬声器，麦克风，加速度计，声回波消除器（AEC）和双通话检测器（DTD）。 扬声器输出包括来自远端扬声器的下行音频信号的扬声器信号。 麦克风产生麦克风上行链路信号，并接收以下至少一个：近端扬声器，环境噪声和扬声器信号。 加速度计产生加速度计 - 上行链路信号并接收以下至少一种：近端扬声器，环境噪声和扬声器信号。 第一AEC接收下行音频，麦克风上行和双通话控制信号，并生成AEC麦克风线性回波估计和校正的AEC麦克风上行信号。 第二个AEC接收下行音频，加速度计上行链路和双通道控制信号，并生成AEC加速度计线性回波估计和校正的AEC加速度计上行信号。 DTD接收下行链路音频信号，上行链路信号，校正的上行链路信号，线性回波估计，并产生双向对话控制信号。 产生包括校正的麦克风 - 上行链路信号和校正的加速度计 - 上行链路信号中的至少一个的上行链路音频信号。 描述其他实施例。

公开(公告)号：US10090001B2

公开(公告)日：2018-10-02

申请号：US15225595

申请日：2016-08-01

Applicant: Apple Inc.

Inventor： Lalin S. Theverapperuma ,  Vasu Iyengar ,  Sarmad Aziz Malik ,  Raghavendra Prabhu

IPC: G10L25/30 ,  G10L21/0232 ,  G10L25/72 ,  G10L25/84 ,  G10L21/028

Abstract: Method of speech enhancement using Neural Network-based combined signal starts with training neural network offline which includes: (i) exciting at least one accelerometer and at least one microphone using training accelerometer signal and training acoustic signal, respectively. The training accelerometer signal and the training acoustic signal are correlated during clean speech segments. Training neural network offline further includes(ii) selecting speech included in the training accelerometer signal and in the training acoustic signal, and (iii) spatially localizing the speech by setting a weight parameter in the neural network based on the selected speech included in the training accelerometer signal and in the training acoustic signal. The neural network that is trained offline is then used to generate a speech reference signal based on an accelerometer signal from the at least one accelerometer and an acoustic signal received from the at least one microphone. Other embodiments are described.

公开(公告)号：US20180033449A1

公开(公告)日：2018-02-01

申请号：US15225595

申请日：2016-08-01

Applicant: Apple Inc.

Inventor： Lalin S. Theverapperuma ,  Vasu Iyengar ,  Sarmad Aziz Malik ,  Raghavendra Prabhu

IPC: G10L25/30 ,  G10L25/72 ,  G10L21/0232 ,  G10L25/84 ,  G10L21/028

CPC classification number: G10L25/30 ,  G10L21/0232 ,  G10L21/028 ,  G10L25/72 ,  G10L25/84

Abstract: Method of speech enhancement using Neural Network-based combined signal starts with training neural network offline which includes: (i) exciting at least one accelerometer and at least one microphone using training accelerometer signal and training acoustic signal, respectively. The training accelerometer signal and the training acoustic signal are correlated during clean speech segments. Training neural network offline further includes (ii) selecting speech included in the training accelerometer signal and in the training acoustic signal, and (iii) spatially localizing the speech by setting a weight parameter in the neural network based on the selected speech included in the training accelerometer signal and in the training acoustic signal. The neural network that is trained offline is then used to generate a speech reference signal based on an accelerometer signal from the at least one accelerometer and an acoustic signal received from the at least one microphone. Other embodiments are described.

公开(公告)号：US20180033447A1

公开(公告)日：2018-02-01

申请号：US15225707

申请日：2016-08-01

Applicant: Apple Inc.

Inventor： Sean A. Ramprashad ,  Esge B. Andersen ,  Joshua D. Atkins ,  Sorin V. Dusan ,  Vasu Iyengar ,  Tarun Pruthi ,  Lalin S. Theverapperuma

IPC: G10L21/028 ,  G10L25/21 ,  G10L21/0232

Abstract: An audio system has a housing in which are integrated a number of microphones. A programmed processor accesses the microphone signals and produces a number of acoustic pick up beams based groups of microphones, an estimation of voice activity and an estimation of noise characteristics on each beam. Two or more beams including a voice beam that is used to pick up a desired voice and a noise beam that is used to provide information to estimate ambient noise are adaptively selected from among the plurality of beams, based on thresholds for voice separation and thresholds for noise-matching. Other embodiments are also described and claimed.

公开(公告)号：US09565285B2

公开(公告)日：2017-02-07

申请号：US14185752

申请日：2014-02-20

Applicant: Apple Inc.

Inventor： Lalin S. Theverapperuma ,  Baptiste P. Paquier

IPC: H04B7/00 ,  H04M1/60 ,  H04W76/02 ,  H04W4/00

CPC classification number: H04M1/6066 ,  H04W4/80

Abstract: A headset that communicates with a mobile device through a local radio frequency (RF) communication link to conduct a telephone call is described. The headset includes a local RF communication modem that receives downlink packets from the mobile device through the local RF communication link. The downlink packets were received by the mobile device through a wireless communication link. The headset includes an audio decoder that decodes the downlink packets into a downlink audio signal to be played back at the headset. The headset also includes an audio encoder that encodes an uplink audio signal produced by the headset into uplink packets. The local RF communication modem sends the uplink packets to the mobile device through the local RF communication link. Other embodiments are also described and claimed.

Abstract translation: 描述了通过本地射频（RF）通信链路与移动设备通信以进行电话呼叫的耳机。 耳机包括本地RF通信调制解调器，其通过本地RF通信链路从移动设备接收下行链路分组。 下行链路分组由移动设备通过无线通信链路接收。 耳机包括音频解码器，其将下行链路分组解码成在耳机处要播放的下行链路音频信号。 耳机还包括音频编码器，其将由耳机产生的上行链路音频信号编码为上行链路分组。 本地RF通信调制解调器通过本地RF通信链路将上行链路分组发送到移动设备。 还描述和要求保护其他实施例。

公开(公告)号：US20150237185A1

公开(公告)日：2015-08-20

申请号：US14185752

申请日：2014-02-20

Applicant: Apple Inc.

Inventor： Lalin S. Theverapperuma ,  Baptiste P. Paquier

IPC: H04M1/60 ,  H04W4/00 ,  H04W76/02

CPC classification number: H04M1/6066 ,  H04W4/80

Abstract: A headset that communicates with a mobile device through a local radio frequency (RF) communication link to conduct a telephone call is described. The headset includes a local RF communication modem that receives downlink packets from the mobile device through the local RF communication link. The downlink packets were received by the mobile device through a wireless communication link. The headset includes an audio decoder that decodes the downlink packets into a downlink audio signal to be played back at the headset. The headset also includes an audio encoder that encodes an uplink audio signal produced by the headset into uplink packets. The local RF communication modem sends the uplink packets to the mobile device through the local RF communication link. Other embodiments are also described and claimed.

Abstract translation: 描述了通过本地射频（RF）通信链路与移动设备通信以进行电话呼叫的耳机。 耳机包括本地RF通信调制解调器，其通过本地RF通信链路从移动设备接收下行链路分组。 下行链路分组由移动设备通过无线通信链路接收。 耳机包括音频解码器，其将下行链路分组解码成在耳机处要播放的下行链路音频信号。 耳机还包括音频编码器，其将由耳机产生的上行链路音频信号编码为上行链路分组。 本地RF通信调制解调器通过本地RF通信链路将上行链路分组发送到移动设备。 还描述和要求保护其他实施例。