公开(公告)号：US11694711B2

公开(公告)日：2023-07-04

申请号：US17723317

申请日：2022-04-18

Applicant: Dolby Laboratories Licensing Corporation

Inventor： Xuejing Sun ,  Glenn N. Dickins

IPC: G10L21/0208 ,  G10L25/78 ,  G10L21/0364 ,  G10L21/0316 ,  G10K11/16 ,  H03G3/32 ,  G10L21/0224 ,  G10L21/034 ,  H03G3/30

CPC classification number: G10L21/0364 ,  G10K11/16 ,  G10L21/0224 ,  G10L21/034 ,  G10L21/0316 ,  G10L25/78 ,  H03G3/301 ,  H03G3/32

Abstract: A method, an apparatus, and logic to post-process raw gains determined by input processing to generate post-processed gains, comprising using one or both of delta gain smoothing and decision-directed gain smoothing. The delta gain smoothing comprises applying a smoothing filter to the raw gain with a smoothing factor that depends on the gain delta: the absolute value of the difference between the raw gain for the current frame and the post-processed gain for a previous frame. The decision-directed gain smoothing comprises converting the raw gain to a signal-to-noise ratio, applying a smoothing filter with a smoothing factor to the signal-to-noise ratio to calculate a smoothed signal-to-noise ratio, and converting the smoothed signal-to-noise ratio to determine the second smoothed gain, with smoothing factor possibly dependent on the gain delta.

公开(公告)号：US10334384B2

公开(公告)日：2019-06-25

申请号：US15547441

申请日：2016-02-03

Applicant: DOLBY LABORATORIES LICENSING CORPORATION

Inventor： Xuejing Sun ,  Richard J. Cartwright ,  Michael P. Hollier ,  Michael Eckert

IPC: H04R5/02 ,  H04S7/00 ,  H04M3/56 ,  G10L21/043 ,  H04R27/00 ,  H04L12/18 ,  H04M3/42

Abstract: A method for processing audio data, the method comprising: receiving audio data corresponding to a plurality of instances of audio, including at least one of: (a) audio data from multiple endpoints, recorded separately or (b) audio data from a single endpoint corresponding to multiple talkers and including spatial information for each of the multiple talkers; rendering the audio data in a virtual acoustic space such that each of the instances of audio has a respective different virtual position in the virtual acoustic space; and scheduling the instances of audio to be played back with a playback overlap between at least two of the instances of audio, wherein the scheduling is performed, at least in part, according to a set of perceptually-motivated rules.

公开(公告)号：US10332540B2

公开(公告)日：2019-06-25

申请号：US15753070

申请日：2016-09-15

Applicant: DOLBY LABORATORIES LICENSING CORPORATION

Inventor： Dong Shi ,  Xuejing Sun

IPC: H03H17/02 ,  G10L25/18 ,  G10L25/48 ,  H03H21/00

Abstract: Example embodiments disclosed herein relate to filter coefficient updating in time domain filtering. A method of processing an audio signal is disclosed. The method includes obtaining a predetermined number of target gains for a first portion of the audio signal by analyzing the first portion of the audio signal. Each of the target gains is corresponding to a linear subband of the audio signal. The method also includes determining a filter coefficients for time domain filtering the first portion of the audio signal so as to approximate a frequency response given by the target gains. The filter coefficients are determined by iteratively selecting at least one target gain from the target gains and updating the filter coefficient based on the selected at least one target gain. Corresponding system and computer program product for processing an audio signal are also disclosed.

公开(公告)号：US10200804B2

公开(公告)日：2019-02-05

申请号：US15553536

申请日：2016-02-24

Applicant: Dolby Laboratories Licensing Corporation

Inventor： Lianwu Chen ,  Xuejing Sun ,  Lie Lu

IPC: H04S3/00 ,  G10L19/20 ,  G06K9/00 ,  H04S3/02

Abstract: Embodiments of the present invention relate to video content assisted audio object extraction. A method of audio object extraction from channel-based audio content is disclosed. The method comprises extracting at least one video object from video content associated with the channel-based audio content, and determining information about the at least one video object. The method further comprises extracting from the channel-based audio content an audio object to be rendered as an upmixed audio signal based on the determined information. Corresponding system and computer program product are also disclosed.

公开(公告)号：US09916837B2

公开(公告)日：2018-03-13

申请号：US14384644

申请日：2013-03-21

Applicant: DOLBY LABORATORIES LICENSING CORPORATION

Inventor： Huiqun Deng ,  Xuejing Sun

IPC: G10L19/16 ,  H04L29/06 ,  G10L19/02 ,  G10L19/005

CPC classification number: G10L19/167 ,  G10L19/005 ,  G10L19/02 ,  H04L65/602 ,  H04L65/607

Abstract: Methods and corresponding apparatuses for transmitting and receiving audio signals are described. A transformation is performed on the audio signals in units of frame in order to obtain transformed audio data of each frame, said transformed audio data consisting of multiple signal components in the frequency domain. These signal components of each frame are distributed into multiple adjacent packets in order to generate packets in which signal components distributed from multiple frames are interleaved. Subsequently, the generated packets are transmitted. Accordingly, in case that packet loss occurs during transmission, the audio signals can be recovered based on the received signal components without consuming additional bandwidth. Therefore, robustness against packet loss can be achieved with little overhead.

公开(公告)号：US09668080B2

公开(公告)日：2017-05-30

申请号：US14899505

申请日：2014-06-17

Applicant: Dolby Laboratories Licensing Corporation

Inventor： Xuejing Sun ,  Bin Cheng ,  Sen Xu ,  Zhiwei Shuang ,  Jun Wang

IPC: H04R5/02 ,  H04S7/00 ,  H04R29/00 ,  H04S3/02

CPC classification number: H04S7/301 ,  H04R29/002 ,  H04R29/005 ,  H04R2430/20 ,  H04S3/02 ,  H04S7/308 ,  H04S2400/03 ,  H04S2400/15 ,  H04S2420/01 ,  H04S2420/11

Abstract: Embodiments of the present invention relate to adaptive audio content generation. Specifically, a method for generating adaptive audio content is provided. The method comprises extracting at least one audio object from channel-based source audio content, and generating the adaptive audio content at least partially based on the at least one audio object. Corresponding system and computer program product are also disclosed.

公开(公告)号：US09626970B2

公开(公告)日：2017-04-18

申请号：US14971401

申请日：2015-12-16

Applicant: Dolby Laboratories Licensing Corporation

Inventor： Shen Huang ,  Xuejing Sun

IPC: G10L17/00 ,  G10L15/30 ,  G10L25/24 ,  G10L25/78

CPC classification number: G10L17/005 ,  G10L15/30 ,  G10L17/00 ,  G10L17/04 ,  G10L25/03 ,  G10L25/24 ,  G10L25/78 ,  H04M3/568 ,  H04M2201/41 ,  H04M2203/6045

Abstract: Embodiments of the present invention relate to speaker identification using spatial information. A method of speaker identification for audio content being of a format based on multiple channels is disclosed. The method comprises extracting, from a first audio clip in the format, a plurality of spatial acoustic features across the multiple channels and location information, the first audio clip containing voices from a speaker, and constructing a first model for the speaker based on the spatial acoustic features and the location information, the first model indicating a characteristic of the voices from the speaker. The method further comprises identifying whether the audio content contains voices from the speaker based on the first model. Corresponding system and computer program product are also disclosed.

公开(公告)号：US20170103761A1

公开(公告)日：2017-04-13

申请号：US15287953

申请日：2016-10-07

Applicant: Dolby Laboratories Licensing Corporation

Inventor： Xuejing Sun ,  Kai Li ,  Mark S. Vinton ,  Shen Huang

IPC: G10L19/005 ,  G10L19/02 ,  G10L19/028

CPC classification number: G10L19/005 ,  G10L19/0204 ,  G10L19/028

Abstract: A method of encoding audio information for forward error correction reconstruction of a transmitted audio stream over a lossy packet switched network, the method including the steps of: (a) dividing the audio stream into audio frames; (b) determining a series of corresponding audio frequency bands for the audio frames; (c) determining a series of power envelopes for the frequency bands; (d) encoding the envelopes as a low bit rate version of the audio frame in a redundant transmission frame.

公开(公告)号：US09525845B2

公开(公告)日：2016-12-20

申请号：US14426134

申请日：2013-09-27

Applicant: DOLBY LABORATORIES LICENSING CORPORATION ,  DOLBY INTERNATIONAL AB

Inventor： Dong Shi ,  Xuejing Sun ,  Kai Li ,  Shen Huang ,  Harald Mundt ,  Heiko Purnhagen ,  Glenn Dickins

IPC: H04N7/14 ,  H04N7/15

CPC classification number: H04N7/147 ,  H04M3/569 ,  H04M9/082 ,  H04M2201/12 ,  H04M2201/14 ,  H04M2201/38 ,  H04M2203/258 ,  H04M2203/352 ,  H04N7/15

Abstract: Embodiments of client device and method for audio or video conferencing are described. An embodiment includes an offset detecting unit, a configuring unit, an estimator and an output unit. The offset detecting unit detects an offset of speech input to the client device. The configuring unit determines a voice latency from the client device to every far end. The estimator estimates a time when a user at the far end perceives the offset based on the voice latency. The output unit outputs a perceivable signal indicating that a user at the far end perceives the offset based on the time estimated for the far end. The perceivable signal is helpful to avoid collision between parties.

Abstract translation: 描述用于音频或视频会议的客户端设备和方法的实施例。 实施例包括偏移检测单元，配置单元，估计器和输出单元。 偏移检测单元检测输入到客户端设备的语音偏移。 配置单元确定从客户端设备到每个远端的语音延迟。 估计器估计在远端的用户基于语音延迟感知到偏移的时间。 输出单元输出可感知的信号，指示远端的用户基于为远端估计的时间感知偏移。 可感知的信号有助于避免各方之间的冲突。

公开(公告)号：US09282419B2

公开(公告)日：2016-03-08

申请号：US14365072

申请日：2012-12-12

Applicant: Dolby Laboratories Licensing Corporation

Inventor： Xuejing Sun ,  Glenn Dickins ,  Huiqun Deng ,  Zhiwei Shuang ,  Bin Cheng

IPC: H04S5/00 ,  G10L21/0364 ,  G10L19/26 ,  H04S7/00

CPC classification number: H04S5/00 ,  G10L19/26 ,  G10L21/0364 ,  H04S7/302

Abstract: An audio processing method and an audio processing apparatus are described. A mono-channel audio signal is transformed into a plurality of first subband signals. Proportions of a desired component and a noise component are estimated in each of the subband signals. Second subband signals corresponding respectively to a plurality of channels are generated from each of the first subband signals. Each of the second subband signals comprises a first component and a second component obtained by assigning a spatial hearing property and a perceptual hearing property different from the spatial hearing property to the desired component and the noise component in the corresponding first subband signal respectively, based on a multi-dimensional auditory presentation method. The second subband signals are transformed into signals for rendering with the multi-dimensional auditory presentation method. By assigning different hearing properties to desired sound and noise, the intelligibility of the audio signal can be improved.

Abstract translation: 描述了音频处理方法和音频处理装置。 单声道音频信号被变换成多个第一子带信号。 在每个子带信号中估计所需分量和噪声分量的比例。 从第一子带信号中的每一个产生分别对应于多个信道的第二子带信号。 每个第二子带信号包括第一分量和第二分量，该第一分量和第二分量通过分别将空间听觉特性和不同于空间听觉特性的感知听觉特性分配给相应的第一子带信号中的期望分量和噪声分量，基于 多维听觉呈现方法。 第二子带信号被转换成用于用多维听觉呈现方法渲染的信号。 通过将不同的听觉属性分配给期望的声音和噪声，可以提高音频信号的可懂度。