Methods, apparatus and systems for three degrees of freedom (3DoF+) extension of MPEG-H 3D audio

    公开(公告)号:US11882426B2

    公开(公告)日:2024-01-23

    申请号:US17743442

    申请日:2022-05-12

    IPC分类号: H04S7/00

    CPC分类号: H04S7/303 H04S2400/11

    摘要: Described is a method of processing position information indicative of an object position of an audio object, wherein the object position is usable for rendering of the audio object, that comprises: obtaining listener orientation information indicative of an orientation of a listener's head; obtaining listener displacement information indicative of a displacement of the listener's head; determining the object position from the position information; modifying the object position based on the listener displacement information by applying a translation to the object position; and further modifying the modified object position based on the listener orientation information. Further described is a corresponding apparatus for processing position information indicative of an object position of an audio object, wherein the object position is usable for rendering of the audio object.

    Methods, apparatus and systems for a pre-rendered signal for audio rendering

    公开(公告)号:US11540079B2

    公开(公告)日:2022-12-27

    申请号:US17046295

    申请日:2019-04-08

    IPC分类号: H04S7/00 G10L19/008 H04S3/00

    摘要: The present disclosure relates to a method of decoding audio scene content from a bitstream by a decoder that includes an audio renderer with one or more rendering tools. The method comprises receiving the bitstream, decoding a description of an audio scene from the bitstream, determining one or more effective audio elements from the description of the audio scene, determining effective audio element information indicative of effective audio element positions of the one or more effective audio elements from the description of the audio scene, decoding a rendering mode indication from the bitstream, wherein the rendering mode indication is indicative of whether the one or more effective audio elements represent a sound field obtained from pre-rendered audio elements and should be rendered using a predetermined rendering mode, and in response to the rendering mode indication indicating that the one or more effective audio elements represent the sound field obtained from pre-rendered audio elements and should be rendered using the predetermined rendering mode, rendering the one or more effective audio elements using the predetermined rendering mode, wherein rendering the one or more effective audio elements using the predetermined rendering mode takes into account the effective audio element information, and wherein the predetermined rendering mode defines a predetermined configuration of the rendering tools for controlling an impact of an acoustic environment of the audio scene on the rendering output. The disclosure further relates to a method of generating audio scene content and a method of encoding audio scene content into a bitstream.

    Methods, apparatus and systems for three degrees of freedom (3DoF+) extension of MPEG-H 3D audio

    公开(公告)号:US11375332B2

    公开(公告)日:2022-06-28

    申请号:US17045983

    申请日:2019-04-09

    IPC分类号: H04S7/00

    摘要: Described is a method of processing position information indicative of an object position of an audio object, wherein the object position is usable for rendering of the audio object, that comprises: obtaining listener orientation information indicative of an orientation of a listener's head; obtaining listener displacement information indicative of a displacement of the listener's head; determining the object position from the position information; modifying the object position based on the listener displacement information by applying a translation to the object position; and further modifying the modified object position based on the listener orientation information. Further described is a corresponding apparatus for processing position information indicative of an object position of an audio object, wherein the object position is usable for rendering of the audio object.

    Method and system for handling local transitions between listening positions in a virtual reality environment

    公开(公告)号:US11109178B2

    公开(公告)日:2021-08-31

    申请号:US16954301

    申请日:2018-12-18

    IPC分类号: H04S7/00 H04S3/00

    摘要: A method (910) for rendering an audio signal in a virtual reality rendering environment (180) is described. The method (910) comprises rendering (911) an origin audio signal of an audio source (311, 312, 313) from an origin source position on an origin sphere (114) around an origin listening position (301) of a listener (181). Furthermore, the method (900) comprises determining (912) that the listener (181) moves from the origin listening position (301) to a destination listening position (302). In addition, the method (900) comprises determining (913) a destination source position of the audio source (311, 312, 313) on a destination sphere (114) around the destination listening position (302) based on the origin source position, and determining (914) a destination audio signal of the audio source (311, 312, 313) based on the origin audio signal. Furthermore, the method (900) comprises rendering (915) the destination audio signal of the audio source (311, 312, 313) from the destination source position on the destination sphere (114) around the destination listening position (302).

    METHODS AND DEVICES FOR GENERATION AND PROCESSING OF MODIFIED AUDIO BITSTREAMS

    公开(公告)号:US20220277755A1

    公开(公告)日:2022-09-01

    申请号:US17635183

    申请日:2020-08-13

    IPC分类号: G10L19/083 G10L19/16

    摘要: Described herein is a method for generating a modified bitstream on a source device, wherein the method includes the steps of: a) receiving, by a receiver, a bitstream including coded media data; b) generating, by an embedder, payload of additional media data and embedding the payload in the bitstream for obtaining, as an output from the embedder, a modified bitstream including the coded media data and the payload of the additional media data; and c) outputting the modified bitstream to a sink device. Described is further a method for processing said modified bitstream on a sink device. Described are moreover a respective source device and sink device as well as a system of a source device and a sink device and respective computer program products.

    Method and system for handling global transitions between listening positions in a virtual reality environment

    公开(公告)号:US11405741B2

    公开(公告)日:2022-08-02

    申请号:US16768671

    申请日:2018-12-18

    摘要: A method (900) for rendering audio in a virtual reality rendering environment (180) is described. The method (900) comprises rendering (901) an origin audio signal of an origin audio source (113) of an origin audio scene (111) from an origin source position on a sphere (114) around a listening position (201) of a listener (181). Furthermore, the method (900) comprises determining (902) that the listener (181) moves from the listening position (201) within the origin audio scene (111) to a listening position (202) within a different destination audio scene (112). In addition, the method (900) comprises applying (903) a fade-out gain to the origin audio signal to determine a modified origin audio signal, and rendering (903) the modified origin audio signal of the origin audio source (113) from the origin source position on the sphere (114) around the listening position (201, 202).

    METHOD AND SYSTEM FOR HANDLING GLOBAL TRANSITIONS BETWEEN LISTENING POSITIONS IN A VIRTUAL REALITY ENVIRONMENT

    公开(公告)号:US20230022740A1

    公开(公告)日:2023-01-26

    申请号:US17815612

    申请日:2022-07-28

    IPC分类号: H04S7/00 G06T19/00

    摘要: A method (900) for rendering audio in a virtual reality rendering environment (180) is described. The method (900) comprises rendering (901) an origin audio signal of an origin audio source (113) of an origin audio scene (111) from an origin source position on a sphere (114) around a listening position (201) of a listener (181). Furthermore, the method (900) comprises determining (902) that the listener (181) moves from the listening position (201) within the origin audio scene (111) to a listening position (202) within a different destination audio scene (112). In addition, the method (900) comprises applying (903) a fade-out gain to the origin audio signal to determine a modified origin audio signal, and rendering (903) the modified origin audio signal of the origin audio source (113) from the origin source position on the sphere (114) around the listening position (201, 202).

    METHOD AND SYSTEM FOR CONTROLLING DIRECTIVITY OF AN AUDIO SOURCE IN A VIRTUAL REALITY ENVIRONMENT

    公开(公告)号:US20240155304A1

    公开(公告)日:2024-05-09

    申请号:US18550603

    申请日:2022-05-10

    IPC分类号: H04S7/00

    摘要: A method (700) for rendering an audio signal of an audio source (211, 212, 213) in a virtual reality rendering environment (180) is described. The method (700) comprises determining (701) whether or not a directivity pattern (232) of the audio source (211, 212, 213) is to be taken into account for a listening situation of a listener (181) within the virtual reality rendering environment (180). Furthermore, the method (700) comprises rendering (702) an audio signal of the audio source (211, 212, 213) without taking into account the directivity pattern (232) of the audio source (211, 212, 213), if it is determined that the directivity pattern (232) of the audio source (211, 212, 213) is not to be taken into account for the listening situation of the listener (181). On the other hand, the method 700) comprises rendering (703) the audio signal of the audio source (211, 212, 213) in dependence of the directivity pattern (232) of the audio source (211, 212, 213), if it is determined that the directivity pattern (232) is to be taken into account for the listening situation of the listener (181).

    METHOD AND SYSTEM FOR HANDLING GLOBAL TRANSITIONS BETWEEN LISTENING POSITIONS IN A VIRTUAL REALITY ENVIRONMENT

    公开(公告)号:US20240031760A1

    公开(公告)日:2024-01-25

    申请号:US18357635

    申请日:2023-07-24

    IPC分类号: H04S7/00 G06T19/00

    摘要: A method (900) for rendering audio in a virtual reality rendering environment (180) is described. The method (900) comprises rendering (901) an origin audio signal of an origin audio source (113) of an origin audio scene (111) from an origin source position on a sphere (114) around a listening position (201) of a listener (181). Furthermore, the method (900) comprises determining (902) that the listener (181) moves from the listening position (201) within the origin audio scene (111) to a listening position (202) within a different destination audio scene (112). In addition, the method (900) comprises applying (903) a fade-out gain to the origin audio signal to determine a modified origin audio signal, and rendering (903) the modified origin audio signal of the origin audio source (113) from the origin source position on the sphere (114) around the listening position (201, 202).