Spatial Audio Rendering with Listener Motion Compensation using Metadata

    公开(公告)号:US20240406660A1

    公开(公告)日:2024-12-05

    申请号:US18671597

    申请日:2024-05-22

    Applicant: Apple Inc.

    Abstract: The various aspects of the disclosure here enable a content creation side to control how discrete audio objects that make up a sound program are rendered by a decoding side to achieve high spatial resolution, while giving the content creator the flexibility to decide how complex the spatial audio rendering should be in the decoding side. Metadata associated with the sound program will instruct a spatial audio renderer on how complex its listener motion compensation should be. Other aspects are also described and claimed.

    Masking Zone in Metadata for Spatial Audio Rendering

    公开(公告)号:US20240406656A1

    公开(公告)日:2024-12-05

    申请号:US18671861

    申请日:2024-05-22

    Applicant: Apple Inc.

    Abstract: The various aspects of the disclosure here enable a content creation side to control how a sound program is spatial audio rendered by a decoding side, so that an audio scene component in a metadata-specified three dimensional acoustic masking zone is not heard while another audio scene component in an un-masked zone of the sound program is heard by a listener of the playback. Other aspects are also described and claimed.

    Method and System For Efficiently Encoding Scene Positions

    公开(公告)号:US20240114310A1

    公开(公告)日:2024-04-04

    申请号:US18471796

    申请日:2023-09-21

    Applicant: Apple Inc.

    CPC classification number: H04S7/303

    Abstract: A method that includes receiving a bitstream that comprises: an encoded version of an audio signal that is associated with a sound source that is within a first 3D scene, a scene tree structure that includes an origin of the first scene relative to an origin of a second scene, and a position of the sound source within the first scene relative to the origin of the first scene, wherein the position references the origin of the first scene using an identifier, wherein the scene tree structure defines an initial configuration of the sound source with respect to the first and second scenes; determining a position of a listener; producing a set of spatially rendered audio signals by spatially rendering the audio signal according to the position of the sound source with respect to the position of the listener; and using the spatially rendered audio signals to drive speakers.

    Layered coding of audio with discrete objects

    公开(公告)号:US11430451B2

    公开(公告)日:2022-08-30

    申请号:US16584706

    申请日:2019-09-26

    Applicant: Apple Inc.

    Abstract: A first layer of data having a first set of Ambisonic audio components can be decoded where the first set of Ambisonic audio components is generated based on ambience and one or more object-based audio signals. A second layer of data is decoded having at least one of the one or more object-based audio signals. One of the object-based audio signals is subtracted from the first set of Ambisonic audio components. The resulting Ambisonic audio components are rendered to generate a first set of audio channels. The one or more object-based audio signals are spatially rendered to generate a second set of audio channels. Other aspects are described and claimed.

    LAYERED CODING OF AUDIO WITH DISCRETE OBJECTS

    公开(公告)号:US20220262373A1

    公开(公告)日:2022-08-18

    申请号:US17739901

    申请日:2022-05-09

    Applicant: Apple Inc.

    Abstract: A first layer of data having a first set of Ambisonic audio components can be decoded where the first set of Ambisonic audio components is generated based on ambience and one or more object-based audio signals. A second layer of data is decoded having at least one of the one or more object-based audio signals. One of the object-based audio signals is subtracted from the first set of Ambisonic audio components. The resulting Ambisonic audio components are rendered to generate a first set of audio channels. The one or more object-based audio signals are spatially rendered to generate a second set of audio channels. Other aspects are described and claimed.

    Transcoding Audio Frames and Converting Metadata Frames based on a Target Encoder

    公开(公告)号:US20250087225A1

    公开(公告)日:2025-03-13

    申请号:US18466663

    申请日:2023-09-13

    Applicant: Apple Inc.

    Abstract: A target encoder may receive, from a source decoder, a source bitstream including an audio frame and a metadata frame associated with the audio frame. The target encoder may transcode the audio frame to a new audio frame in a target format associated with the target encoder. The target encoder may convert the metadata frame into a new metadata frame associated with the new audio frame. The target encoder may then generate a target bitstream including the new audio frame and the new metadata frame. Other aspects are also described and claimed.

    Metadata for Spatial Audio Rendering

    公开(公告)号:US20240406669A1

    公开(公告)日:2024-12-05

    申请号:US18665488

    申请日:2024-05-15

    Applicant: Apple Inc.

    Abstract: The various aspects of the disclosure here enable a content creation side to control how discrete audio objects that make up a sound program are rendered by a decoding side to achieve greater realism, while enabling the decoder side to also control the rendering process to consider the positions and orientations of the objects as virtual sound sources relative to the listener. The same sound program can thus be optimally rendered by a variety of decoder side formats, such as binaural on headphone, cross-talked cancelled binaural on a stereo pair of speakers embedded in a device, or multichannel on an immersive loudspeaker layout, e.g., planar such as 5.1 and 7.1 surround sound layouts, 3D such as 7.1.4 or 22.2, etc. Other aspects are also described and claimed.

Patent Agency Ranking