公开(公告)号：US11930347B2

公开(公告)日：2024-03-12

申请号：US17427665

申请日：2020-02-12

Applicant: Dolby Laboratories Licensing Corporation

Inventor： Lianwu Chen ,  Lie Lu

IPC: H04S7/00

CPC classification number: H04S7/30 ,  H04S2400/13

Abstract: A method of processing audio content including a plurality of audio elements comprises: clustering the plurality of audio elements into a plurality of clusters of audio elements; and for a cluster among the plurality of clusters: for each audio element in the cluster, determining a measure of energy that the audio element contributes to the cluster; for at least one audio element in the cluster, determining a compensation gain based at least in part on the measures of energy for the audio elements in the cluster; and applying the compensation gain to the at least one audio element in the cluster.

公开(公告)号：US10362426B2

公开(公告)日：2019-07-23

申请号：US15538892

申请日：2016-02-09

Applicant: DOLBY LABORATORIES LICENSING CORPORATION

Inventor： Jun Wang ,  Lie Lu ,  Lianwu Chen ,  Mingqing Hu

IPC: H04S5/00 ,  H04R1/32 ,  H04S7/00

Abstract: Example embodiments disclosed herein relates to upmixing of audio signals. A method of upmixing an audio signal is described. The method includes decomposing the audio signal into a diffuse signal and a direct signal, generating an audio bed at least in part based on the diffuse signal, the audio bed including a height channel, extracting an audio object from the direct signal, estimating metadata of the audio object, the metadata including height information of the audio object; and rendering the audio bed and the audio object as an upmixed audio signal, wherein the audio bed is rendered to a predefined position and the audio object is rendered according to the metadata. Corresponding system and computer program product are described as well.

公开(公告)号：US10277997B2

公开(公告)日：2019-04-30

申请号：US15749750

申请日：2016-08-04

Applicant: Dolby Laboratories Licensing Corporation

Inventor： Lianwu Chen ,  Lie Lu ,  Dirk Jeroen Breebaart

IPC: G10L19/008 ,  H04S3/00 ,  H04R3/12

Abstract: Example embodiments disclosed herein relate to audio signal processing. The audio signal has multiple audio objects. A method of processing an audio signal is disclosed. The method includes obtaining an object position for each of the audio objects; and determining cluster positions for grouping the audio objects into clusters based on the object positions, a plurality of object-to-cluster gains, and a set of metrics. The metrics indicate a quality of the cluster positions and a quality of the object-to-cluster gains, each of the cluster positions is a centroid of a respective one of the clusters, and one of the object-to-cluster gains defines a ratio of the respective audio object in one of the clusters. The method also includes determining the object-to-cluster gains based on the object positions, the cluster positions and the set of metrics; and generating a cluster signal based on the determined cluster positions and object-to-cluster gains. Corresponding system and computer program product are also disclosed.

公开(公告)号：US10275685B2

公开(公告)日：2019-04-30

申请号：US15538306

申请日：2015-12-18

Applicant: DOLBY LABORATORIES LICENSING CORPORATION

Inventor： Mingqing Hu ,  Lie Lu ,  Lianwu Chen

IPC: G06F17/00 ,  G06K9/62 ,  H04S5/00 ,  G06F17/15 ,  H03H21/00

Abstract: A method is disclosed for audio object extraction from an audio content which includes identifying a first set of projection spaces including a first subset for a first channel and a second subset for a second channel of the plurality of channels. The method may further include determining a first set of correlations between the first and second channels, each of the first set of correlations corresponding to one of the first subset of projection spaces and one of the second subset of projection spaces. Still further, the method may include extracting an audio object from an audio signal of the first channel at least in part based on a first correlation among the first set of correlations and the projection space from the first subset corresponding to the first correlation, the first correlation being greater than a first predefined threshold. Corresponding system and computer program products are also disclosed.

公开(公告)号：US20180227691A1

公开(公告)日：2018-08-09

申请号：US15749750

申请日：2016-08-04

Applicant: Dolby Laboratories Licensing Corporation

Inventor： Lianwu Chen ,  Lie Lu ,  Dirk Jeroen Breebaart

IPC: H04S3/00 ,  G10L19/008 ,  H04R3/12

CPC classification number: H04S3/008 ,  G10L19/008 ,  H04R3/12 ,  H04S2400/11

Abstract: Example embodiments disclosed herein relate to audio signal processing. The audio signal has multiple audio objects. A method of processing an audio signal is disclosed. The method includes obtaining an object position for each of the audio objects; and determining cluster positions for grouping the audio objects into clusters based on the object positions, a plurality of object-to-cluster gains, and a set of metrics. The metrics indicate a quality of the cluster positions and a quality of the object-to-cluster gains, each of the cluster positions is a centroid of a respective one of the clusters, and one of the object-to-cluster gains defines a ratio of the respective audio object in one of the clusters. The method also includes determining the object-to-cluster gains based on the object positions, the cluster positions and the set of metrics; and generating a cluster signal based on the determined cluster positions and object-to-cluster gains. Corresponding system and computer program product are also disclosed.

公开(公告)号：US09820077B2

公开(公告)日：2017-11-14

申请号：US15328631

申请日：2015-07-23

Applicant: Dolby Laboratories Licensing Corporation

Inventor： Lianwu Chen ,  Lie Lu

IPC: H04S7/00 ,  H04S3/00 ,  G10L21/038

CPC classification number: H04S7/302 ,  G10L19/008 ,  G10L21/0308 ,  G10L21/038 ,  H04S3/008 ,  H04S2400/01 ,  H04S2400/11 ,  H04S2400/13 ,  H04S2420/07

Abstract: Embodiments of the example embodiment relate to audio object extraction. A method for audio object extraction from audio content is disclosed. The method comprises determining a sub-band object probability for a sub-band of the audio signal in a frame of the audio content, the sub-band object probability indicating a probability of the sub-band of the audio signal containing an audio object. The method further comprises splitting the sub-band of the audio signal into an audio object portion and a residual audio portion based on the determined sub-band object probability. Corresponding system and computer program product are also disclosed.

公开(公告)号：US09805725B2

公开(公告)日：2017-10-31

申请号：US14654460

申请日：2013-11-25

Applicant: Dolby Laboratories Licensing Corporation

Inventor： Brett G. Crockett ,  Alan J. Seefeldt ,  Nicolas R. Tsingos ,  Rhonda Wilson ,  Dirk Jeroen Breebaart ,  Lie Lu ,  Lianwu Chen

IPC: H04R5/00 ,  G10L19/008 ,  G10L25/18 ,  G10L19/02 ,  H04S7/00 ,  G10L19/20

CPC classification number: G10L19/008 ,  G10L19/02 ,  G10L19/20 ,  G10L25/18 ,  H04S7/30 ,  H04S2400/13 ,  H04S2420/03

Abstract: Embodiments are directed a method of rendering object-based audio comprising determining an initial spatial position of objects having object audio data and associated metadata, determining a perceptual importance of the objects, and grouping the audio objects into a number of clusters based on the determined perceptual importance of the objects, such that a spatial error caused by moving an object from an initial spatial position to a second spatial position in a cluster is minimized for objects with a relatively high perceptual importance. The perceptual importance is based at least in part by a partial loudness of an object and content semantics of the object.