公开(公告)号：WO2018052557A1

公开(公告)日：2018-03-22

申请号：PCT/US2017/045289

申请日：2017-08-03

Applicant: QUALCOMM INCORPORATED

Inventor： PETERS, Nils Gunther ,  KIM, Moo Young ,  SEN, Dipanjan

IPC: H04L29/06 ,  H04L29/08 ,  G10L19/20 ,  H04N21/262

Abstract: Methods and apparatuses are disclosed for streaming audio between a source device and a destination device. An example method may include determining an available bandwidth between the source device and the destination device. The example method may also include determining a bit rate for streaming audio from the source device to the destination device, wherein the bit rate is based on the available bandwidth. The example method may further include determining a preferred audio characteristic for streaming audio from the source device to the destination device, wherein the preferred audio characteristic is based on a user preference. The example method may also include determining encoded audio to be transmitted from the source device to the destination device based on the preferred audio characteristic and the bit rate.

Abstract translation: 公开了用于在源设备和目的地设备之间流式传输音频的方法和设备。 示例方法可以包括确定源设备和目的地设备之间的可用带宽。 示例方法还可以包括确定用于将音频从源设备流式传输到目的地设备的比特率，其中比特率基于可用带宽。 该示例方法可以进一步包括确定用于从源设备向目的地设备流式传输音频的优选音频特性，其中优选音频特性基于用户偏好。 示例方法还可以包括基于优选音频特性和比特率来确定要从源设备传输到目的地设备的编码音频。

公开(公告)号：WO2017035376A2

公开(公告)日：2017-03-02

申请号：PCT/US2016/048740

申请日：2016-08-25

Applicant: QUALCOMM INCORPORATED

Inventor： STOCKHAMMER, Thomas ,  SEN, Dipanjan

IPC: H04N21/442 ,  H04N21/462 ,  H04N21/6373 ,  H04N21/81 ,  H04N21/845

CPC classification number: H04L65/607 ,  H04L67/02 ,  H04L67/42 ,  H04N21/44209 ,  H04N21/4621 ,  H04N21/6373 ,  H04N21/8106 ,  H04N21/845

Abstract: In one example, a device for retrieving audio data includes one or more processors configured to receive availability data representative of a plurality of available adaptation sets, the available adaptation sets including a scene-based audio adaptation set and one or more object-based audio adaptation sets, receive selection data identifying which of the scene-based audio adaptation set and the one or more object-based audio adaptation sets are to be retrieved, and provide instruction data to a streaming client to cause the streaming client to retrieve data for each of the adaptation sets identified by the selection data, and a memory configured to store the retrieved data for the audio adaptation sets.

Abstract translation: 在一个示例中，用于检索音频数据的设备包括被配置为接收表示多个可用适配集的可用性数据的一个或多个处理器，所述可用适配集包括基于场景的音频适配集和一个或多个基于对象的音频适配 接收选择数据，识别要检索基于场景的音频适配集和一个或多个基于对象的音频适配集中的哪个，并向流客户端提供指令数据，以使得流客户端检索数据 由选择数据识别的适配集，以及被配置为存储用于音频适配集的检索数据的存储器。

公开(公告)号：WO2016057935A1

公开(公告)日：2016-04-14

申请号：PCT/US2015/054964

申请日：2015-10-09

Applicant: QUALCOMM INCORPORATED

Inventor： PETERS, Nils Günther ,  MORRELL, Martin James ,  SEN, Dipanjan

IPC: H04S7/00

CPC classification number: G10L19/008 ,  G10L19/032 ,  H04S3/008 ,  H04S7/301 ,  H04S7/302 ,  H04S2420/11

Abstract: This disclosure describes techniques for coding of higher-order ambisonics audio data comprising at least one higher-order ambisonic (HOA) coefficient corresponding to a spherical harmonic basis function having an order greater than one. This disclosure describes techniques for adjusting HOA soundfields to potentially improve spatial alignment of the acoustic elements to the visual component in a mixed audio/video reproduction scenario. In one example, a device for rendering an HOA audio signal includes one or more processors configured to render the HOA audio signal over one or more speakers based on one or more field of view (FOV) parameters of a reference screen and one or more FOV parameters of a viewing window.

Abstract translation: 本公开描述了用于编码包括与具有大于1的阶数的球面谐波基函数相对应的至少一个高阶环比（HOA）系数的高阶有源音频数据的技术。 本公开描述了用于调整HOA声场以在混合音频/视频再现场景中潜在地改善声学元件与视觉分量的空间对准的技术。 在一个示例中，用于呈现HOA音频信号的设备包括一个或多个处理器，其被配置为基于参考屏幕的一个或多个视场（FOV）参数和一个或多个FOV来呈现一个或多个扬声器上的HOA音频信号 查看窗口的参数。

公开(公告)号：WO2015038519A1

公开(公告)日：2015-03-19

申请号：PCT/US2014/054711

申请日：2014-09-09

Applicant: QUALCOMM INCORPORATED

Inventor： SEN, Dipanjan ,  PETERS, Nils Günther ,  MORRELL, Martin James

IPC: G10L19/008

CPC classification number: G10L19/008

Abstract: In general, techniques are described for coding of spherical harmonic coefficients representative of a three dimensional soundfield. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may be configured to store a plurality of spherical harmonic coefficients. The one or more processors may be configured to perform an energy analysis with respect to the plurality of spherical harmonic coefficients to determine a reduced version of the plurality of spherical harmonic coefficients.

Abstract translation: 通常，描述了代表三维声场的球谐函数的编码技术。 包括存储器和一个或多个处理器的设备可以被配置为执行这些技术。 存储器可以被配置为存储多个球谐函数。 一个或多个处理器可以被配置为执行关于多个球谐函数的能量分析以确定多个球谐函数的简化版本。

公开(公告)号：WO2014194004A1

公开(公告)日：2014-12-04

申请号：PCT/US2014/039863

申请日：2014-05-28

Applicant: QUALCOMM INCORPORATED

Inventor： MORRELL, Martin James ,  PETERS, Nils Günther ,  SEN, Dipanjan

IPC: H04S5/00 ,  H04S3/00 ,  H04S1/00

CPC classification number: H04S7/305 ,  G10K15/12 ,  G10L19/008 ,  H04S1/002 ,  H04S1/005 ,  H04S3/004 ,  H04S5/00 ,  H04S7/306 ,  H04S7/307 ,  H04S2400/01 ,  H04S2420/01 ,  H04S2420/07 ,  H04S2420/11

Abstract: A device comprises one or more processors configured to apply a binaural room impulse response filter to spherical harmonic coefficients representative of a sound field in three dimensions so as to render the sound field.

Abstract translation: 一种装置包括一个或多个处理器，其被配置为对三声道的声场施加双耳室脉冲响应滤波器，以便产生声场。

公开(公告)号：WO2014193993A1

公开(公告)日：2014-12-04

申请号：PCT/US2014/039848

申请日：2014-05-28

Applicant: QUALCOMM INCORPORATED

Inventor： XIANG, Pei ,  SEN, Dipanjan ,  PETERS, Nils, Günther ,  MORRELL, Martin, James

IPC: H04S5/00 ,  G10L19/008 ,  H04S1/00 ,  H04S7/00 ,  H04R5/04

CPC classification number: H04S7/305 ,  G10K15/12 ,  G10L19/008 ,  H04S1/002 ,  H04S1/005 ,  H04S3/004 ,  H04S5/00 ,  H04S7/306 ,  H04S7/307 ,  H04S2400/01 ,  H04S2420/01 ,  H04S2420/07 ,  H04S2420/11

Abstract: A device comprising one or more processors is configured to determine a plurality of segments for each of a plurality of binaural room impulse response filters, wherein each of the plurality of binaural room impulse response filters comprises a residual room response segment and at least one direction-dependent segment for which a filter response depends on a location within a sound field; transform each of at least one direction-dependent segment of the plurality of binaural room impulse response filters to a domain corresponding to a domain of a plurality of hierarchical elements to generate a plurality of transformed binaural room impulse response filters, wherein the plurality of hierarchical elements describe a sound field; and perform a fast convolution of the plurality of transformed binaural room impulse response filters and the plurality of hierarchical elements to render the sound field.

Abstract translation: 包括一个或多个处理器的设备被配置为为多个双耳室脉冲响应滤波器中的每一个确定多个段，其中所述多个双耳室脉冲响应滤波器中的每一个包括剩余房间响应段和至少一个方向 - 滤波器响应取决于声场内的位置; 将所述多个双耳室脉冲响应滤波器中的至少一个方向依赖片段中的每一个变换为与多个分层元件的域对应的域，以生成多个经转换的双耳房间脉冲响应滤波器，其中所述多个分级元件 描述一个声场; 并且执行多个经变换的双耳室脉冲响应滤波器和多个分层元件的快速卷积以呈现声场。

公开(公告)号：WO2014134472A2

公开(公告)日：2014-09-04

申请号：PCT/US2014/019468

申请日：2014-02-28

Applicant: QUALCOMM INCORPORATED

Inventor： SEN, Dipanjan ,  MORRELL, Martin James ,  PETERS, Nils Günther

IPC: G10L19/16

CPC classification number: G10L19/008 ,  G10L19/018 ,  G10L19/167 ,  G10L19/20 ,  H04S2420/11

Abstract: In general, techniques are described for transforming spherical harmonic coefficients. A device comprising one or more processors may perform the techniques. The processors may be configured to parse the bitstream to determine transformation information describing how the sound field was transformed to reduce a number of the plurality of hierarchical elements that provide information relevant in describing the sound field. The processors may further be configured to, when reproducing the sound field based on those of the plurality of hierarchical elements that provide information relevant in describing the sound field, transform the sound field based on the transformation information to reverse the transformation performed to reduce the number of the plurality of hierarchical elements.

Abstract translation: 一般来说，描述了用于转换球谐函数的技术。 包括一个或多个处理器的设备可以执行这些技术。 处理器可以被配置为解析比特流以确定描述声场如何被​​变换的变换信息，以减少提供与描述声场有关的信息的多个分层元素的数量。 处理器还可以被配置为当基于提供与描述声场相关的信息的多个分层元素中的那些再现声场时，基于变换信息来转换声场，以反转执行的变换以减少数字 的多个分层元素。

公开(公告)号：WO2014014891A1

公开(公告)日：2014-01-23

申请号：PCT/US2013/050648

申请日：2013-07-16

Applicant: QUALCOMM INCORPORATED

Inventor： SEN, Dipanjan

IPC: H04S7/00 ,  H04S3/00

CPC classification number: H04S3/006 ,  H04S3/002 ,  H04S7/30 ,  H04S2400/03 ,  H04S2420/11

Abstract: In general, techniques are described for compensating for loudspeaker positions using hierarchical three-dimensional (3D) audio coding. An apparatus comprising one or more processors may perform the techniques. The processors may be configured to perform a first transform that is based on a spherical wave model on a first set of audio channel information for a first geometry of speakers to generate a first hierarchical set of elements that describes a sound field. The processors may further be configured to perform a second transform in a frequency domain on the first hierarchical set of elements to generate a second set of audio channel information for a second geometry of speakers.

Abstract translation: 通常，描述了使用分层三维（3D）音频编码来补偿扬声器位置的技术。 包括一个或多个处理器的装置可以执行这些技术。 处理器可以被配置为执行基于用于扬声器的第一几何形状的第一组音频信道信息上的球面波模型的第一变换，以生成描述声场的元素的第一分层集合。 处理器还可以被配置为在第一分层元件组上的频域中执行第二变换，以生成用于扬声器的第二几何形状的第二组音频通道信息。

公开(公告)号：WO2020072185A1

公开(公告)日：2020-04-09

申请号：PCT/US2019/050824

申请日：2019-09-12

Applicant: QUALCOMM INCORPORATED

Inventor： KIM, Moo Young ,  PETERS, Nils Günther ,  SALEHIN, S M Akramus ,  SWAMINATHAN, Siddhartha Goutham ,  SEN, Dipanjan

IPC: G06F3/01 ,  H04S7/00

Abstract: A device and method for backward compatibility for virtual reality (VR), mixed reality (MR), augmented reality (AR), computer vision, and graphics systems. The device and method enable rendering audio data with more degrees of freedom on devices that support fewer degrees of freedom. The device includes memory configured to store audio data representative of a soundfield captured at a plurality of capture locations, metadata that enables the audio data to be rendered to support N degrees of freedom, and adaptation metadata that enables the audio data to be rendered to support M degrees of freedom. The device also includes one or more processors coupled to the memory, and configured to adapt, based on the adaptation metadata, the audio data to provide the M degrees of freedom, and generate speaker feeds based on the adapted audio data.

公开(公告)号：WO2020005970A1

公开(公告)日：2020-01-02

申请号：PCT/US2019/039025

申请日：2019-06-25

Applicant: QUALCOMM INCORPORATED

Inventor： KIM, Moo Young ,  OLIVIERI, Ferdinando ,  SEN, Dipanjan

IPC: G10L19/008

Abstract: In general, techniques are described by which to render different portions of audio data using different renderers. A device comprising a memory and one or more processors may be configured to perform the techniques. The memory may store audio renderers. The processor(s) may obtain a first audio renderer of the plurality of audio renderers, and apply the first audio renderer with respect to a first portion of the audio data to obtain one or more first speaker feeds. The processor(s) may next obtain a second audio renderer of the plurality of audio renderers, and apply the second audio renderer with respect to a second portion of the audio data to obtain one or more second speaker feeds. The processor(s) may output, to one or more speakers, the one or more first speaker feeds and the one or more second speaker feeds.