Streaming volumetric and non-volumetric video

    公开(公告)号:US11528538B2

    公开(公告)日:2022-12-13

    申请号:US17414602

    申请日:2019-12-17

    摘要: A processor system and computer-implemented method are provided for generating a composite video stream which may include a non-volumetric video and a volumetric video, at least part of which is to be displayed in front of the non-volumetric video. The volumetric video may be included in the composite video stream in the form of a non-volumetric representation of the volumetric video, for example inserted into a spatial subregion of the non-volumetric video which may be occluded by the volumetric video during display. The encoding, transmission and decoding may thus not have to be modified to support volumetric video. Signaling data may be provided which may be indicative of the composite video stream containing the non-volumetric representation of the volumetric video. A processor system and computer-implemented method may be provided for rendering the composite video stream using the signaling data.

    Coding spherical video data
    3.
    发明授权

    公开(公告)号:US11184641B2

    公开(公告)日:2021-11-23

    申请号:US16611419

    申请日:2018-05-08

    摘要: A method is described of forming a bitstream by an encoder apparatus comprising: a processor of the encoder apparatus receiving a projected video frame including one or more pixel regions, the one or more pixel regions representing pixels of spherical video data projected onto one or more 2D projection surfaces of a projection model, the projection model being adapted to project spherical video data onto a rectangular 2D surface of a video frame; the processor generating a plurality of different candidate video frames on the basis of the received projected video frame, each candidate video frame being formed by applying at least one operation to one or more groups of pixels in one or more pixel regions of the projected video frame, wherein said at least operation includes a shift, mirror and/or rotation operation; and, wherein said operation is different for each of said plurality of different candidate video frames; the processor applying a rate distortion analysis to each of the candidate video frames to determine a rate distortion cost for each of the candidate video frames; and, the processor selecting a candidate video frame from said plurality of candidate video frames on the basis of the rate distortion cost; and, generating an output bitstream on the basis of the selected candidate video frame.

    Spatial scalable video coding
    4.
    发明授权

    公开(公告)号:US10764602B2

    公开(公告)日:2020-09-01

    申请号:US16071012

    申请日:2017-01-24

    摘要: A method of forming a video signal by a decoder device is described wherein the method comprises receiving a bitstream and decoder information, the decoder information signaling the decoder device the presence of one or more resolution components in the bitstream for forming a video signal, a resolution component representing a spatially subsampled version, preferably a polyphase subsampled version, of a first video signal having a first resolution, the one or more resolution components being part of a resolution component group, the group comprising a plurality of resolution components on the basis of which the first video signal is reconstructable; and, the decoder device parsing the bitstream and decoding the one or more resolution components into video frames on the basis of the decoder information.

    Managing concurrent streaming of media streams

    公开(公告)号:US11265359B2

    公开(公告)日:2022-03-01

    申请号:US15517092

    申请日:2015-10-13

    摘要: A system and method are provided for managing a concurrent streaming of a first media stream (031) and a second media stream (032). The media streams (031, 032) represent different recordings of an event. The concurrent streaming of the media streams (031, 032) is enabled by a resource having a resource limitation (080). To address this resource limitation, when it is determined that the resource limitation is exceeded by the concurrent streaming of the first media stream (031) streaming to a first streaming client (041) and the second media stream (032) streaming to a second streaming client (042), the first media stream (031) is selected for substituting the second media stream (032) in the streaming to the second streaming client (042). As a result of the substitution, the first and the second streaming client (041, 042) stream the same media stream rather than different media streams. This may have as advantage that the allocation of the resource is reduced, since the streaming of a same media stream to different streaming clients (041, 042) typically represents a lower resource allocation than the streaming of different media streams to different streaming clients.

    Processing Spherical Video Data
    9.
    发明申请

    公开(公告)号:US20200053393A1

    公开(公告)日:2020-02-13

    申请号:US16486008

    申请日:2018-02-27

    摘要: A method for processing spherical video data is described including a data processor providing spherical video data in the form of projected video frames to an input of an encoder process, a projected video frame including one or more pixel regions, the one or more pixel regions representing pixels of spherical video data projected onto one or more 2D projection surfaces of a projection model, preferably an equirectangular or a 3D polyhedron projection model, for projecting spherical video data onto a rectangular 2D surface of a video frame; wherein the providing of spherical video data may comprise: generating a set of modified projected video frames on the basis of a projected video frame, the generating including applying different shift and/or rotation operations to pixels, preferably one or more pixel regions, of the selected projected video frame; applying an image analysis algorithm to the modified projected video frames, the image analysis algorithm determining an image analysis parameter for a least part of the modified projected video frames, the image analysis parameter being indicative for the encoding efficiency and/or image quality; and, selecting a modified projected video frame from the set of modified projected video frames, the selected modified projected video frame being associated with an image analysis parameter indicative of the best encoding efficiency and/or image quality.

    Video Coding
    10.
    发明申请
    Video Coding 审中-公开

    公开(公告)号:US20190166376A1

    公开(公告)日:2019-05-30

    申请号:US16316486

    申请日:2017-07-05

    摘要: A method is described for forming output video frames by a decoder device wherein the method comprises: receiving a bitstream, the bitstream comprising bitstream parts representing encoded media data of video tiles and tile positioning information associated with the encoded video tiles; extracting tile positioning information from the bitstream, the tile positioning information comprising tile identifiers for identifying encoded video tiles, a tile identifier being associated with one or more boundary identifiers, an boundary identifier identifying an boundary of a video tile identified by a tile identifier; determining a tile map on the basis of the boundary identifiers in the tile positioning information, the tile map representing a spatial layout of video tiles in an output video frame; and, forming an output video frame, including identifying parts of the bitstream representing encoded media data of video tiles identified in the tile map, decoding the identified encoded media data and copying the decoded media data in the output video frame buffer according to the spatial layout of the tile map.