Streaming volumetric and non-volumetric video

    公开(公告)号:US11528538B2

    公开(公告)日:2022-12-13

    申请号:US17414602

    申请日:2019-12-17

    摘要: A processor system and computer-implemented method are provided for generating a composite video stream which may include a non-volumetric video and a volumetric video, at least part of which is to be displayed in front of the non-volumetric video. The volumetric video may be included in the composite video stream in the form of a non-volumetric representation of the volumetric video, for example inserted into a spatial subregion of the non-volumetric video which may be occluded by the volumetric video during display. The encoding, transmission and decoding may thus not have to be modified to support volumetric video. Signaling data may be provided which may be indicative of the composite video stream containing the non-volumetric representation of the volumetric video. A processor system and computer-implemented method may be provided for rendering the composite video stream using the signaling data.

    Coding spherical video data
    2.
    发明授权

    公开(公告)号:US11184641B2

    公开(公告)日:2021-11-23

    申请号:US16611419

    申请日:2018-05-08

    摘要: A method is described of forming a bitstream by an encoder apparatus comprising: a processor of the encoder apparatus receiving a projected video frame including one or more pixel regions, the one or more pixel regions representing pixels of spherical video data projected onto one or more 2D projection surfaces of a projection model, the projection model being adapted to project spherical video data onto a rectangular 2D surface of a video frame; the processor generating a plurality of different candidate video frames on the basis of the received projected video frame, each candidate video frame being formed by applying at least one operation to one or more groups of pixels in one or more pixel regions of the projected video frame, wherein said at least operation includes a shift, mirror and/or rotation operation; and, wherein said operation is different for each of said plurality of different candidate video frames; the processor applying a rate distortion analysis to each of the candidate video frames to determine a rate distortion cost for each of the candidate video frames; and, the processor selecting a candidate video frame from said plurality of candidate video frames on the basis of the rate distortion cost; and, generating an output bitstream on the basis of the selected candidate video frame.

    Spatial scalable video coding
    3.
    发明授权

    公开(公告)号:US10764602B2

    公开(公告)日:2020-09-01

    申请号:US16071012

    申请日:2017-01-24

    摘要: A method of forming a video signal by a decoder device is described wherein the method comprises receiving a bitstream and decoder information, the decoder information signaling the decoder device the presence of one or more resolution components in the bitstream for forming a video signal, a resolution component representing a spatially subsampled version, preferably a polyphase subsampled version, of a first video signal having a first resolution, the one or more resolution components being part of a resolution component group, the group comprising a plurality of resolution components on the basis of which the first video signal is reconstructable; and, the decoder device parsing the bitstream and decoding the one or more resolution components into video frames on the basis of the decoder information.

    Streaming Volumetric and Non-Volumetric Video

    公开(公告)号:US20220141548A1

    公开(公告)日:2022-05-05

    申请号:US17414602

    申请日:2019-12-17

    摘要: A processor system and computer-implemented method are provided for generating a composite video stream which may include a non-volumetric video and a volumetric video, at least part of which is to be displayed in front of the non-volumetric video. The volumetric video may be included in the composite video stream in the form of a non-volumetric representation of the volumetric video, for example inserted into a spatial subregion of the non-volumetric video which may be occluded by the volumetric video during display. The encoding, transmission and decoding may thus not have to be modified to support volumetric video. Signaling data may be provided which may be indicative of the composite video stream containing the non-volumetric representation of the volumetric video. A processor system and computer-implemented method may be provided for rendering the composite video stream using the signaling data.

    Processing spherical video data
    5.
    发明授权

    公开(公告)号:US10958942B2

    公开(公告)日:2021-03-23

    申请号:US16486008

    申请日:2018-02-27

    摘要: A method for processing spherical video data is described including a data processor providing spherical video data in the form of projected video frames to an input of an encoder process, a projected video frame including one or more pixel regions, the one or more pixel regions representing pixels of spherical video data projected onto one or more 2D projection surfaces of a projection model, preferably an equirectangular or a 3D polyhedron projection model, for projecting spherical video data onto a rectangular 2D surface of a video frame; wherein the providing of spherical video data may comprise: generating a set of modified projected video frames on the basis of a projected video frame, the generating including applying different shift and/or rotation operations to pixels, preferably one or more pixel regions, of the selected projected video frame; applying an image analysis algorithm to the modified projected video frames, the image analysis algorithm determining an image analysis parameter for a least part of the modified projected video frames, the image analysis parameter being indicative for the encoding efficiency and/or image quality; and, selecting a modified projected video frame from the set of modified projected video frames, the selected modified projected video frame being associated with an image analysis parameter indicative of the best encoding efficiency and/or image quality.

    Network-Initiated Content Streaming Control
    7.
    发明申请
    Network-Initiated Content Streaming Control 有权
    网络启动的内容流控制

    公开(公告)号:US20140379871A1

    公开(公告)日:2014-12-25

    申请号:US14368763

    申请日:2012-12-27

    IPC分类号: H04L29/06 H04L29/08

    摘要: Methods and systems are described for enabling network-initiated control of streaming of segmented content from a content delivery node to at least one client, said client being configured to access at least part of said segmented content on the basis of a manifest file, wherein a method may comprise: receiving a first manifest file identifying one or more segments and location information for locating one or more content delivery nodes configured to transmit said one or more segments to said at least one client; in response to said reception of said first manifest file, providing channel set-up information; and, establishing at least one streaming control channel between said at least one client and a control channel server function associated with said content delivery node on the basis of said control channel set-up information, said at least one client being configured for receiving at least one manifest file update message via said streaming control channel.

    摘要翻译: 描述了方法和系统,用于使网络发起的控制从内容递送节点到至少一个客户端的分段内容的流传输,所述客户端被配置为基于清单文件访问所述分段内容的至少一部分,其中 方法可以包括:接收标识一个或多个段的第一清单文件和位置信息,用于定位被配置为将所述一个或多个段传送到所述至少一个客户端的一个或多个内容传送节点; 响应于所述第一清单文件的接收,提供频道建立信息; 以及基于所述控制信道建立信息,在所述至少一个客户端与与所述内容传送节点相关联的控制信道服务器功能之间建立至少一个流控制信道,所述至少一个客户端被配置为至少接收 一个清单文件更新消息通过所述流控制信道。

    CONTROLLED STREAMING OF SEGMENTED CONTENT
    8.
    发明申请
    CONTROLLED STREAMING OF SEGMENTED CONTENT 审中-公开
    控制内容的控制流

    公开(公告)号:US20140359081A1

    公开(公告)日:2014-12-04

    申请号:US14369994

    申请日:2012-12-27

    IPC分类号: H04L29/06 H04L29/08

    摘要: Methods and systems for enabling client-controlled streaming of segmented content are described. In one example, the client-controlled streaming is on the basis of a manifest file, the manifest file including one or more segment identifiers and one or more associated segment locators, In one example, a method involves: requesting the delivery of at least one segment on the basis of a first segment identifier selected from the manifest file; on the basis of the first requested segment, selecting a second at least one segment identifier from the manifest file, the second segment identifier being associated with an expected future segment request; and pre-resolving a first segment locator associated with the selected second segment identifier for obtaining network information associated with the first segment locator.

    摘要翻译: 描述了用于启用客户端控制的分段内容流的方法和系统。 在一个示例中,客户端控制的流传输是基于清单文件,清单文件包括一个或多个段标识符和一个或多个相关联的段定位符。一个示例中,一种方法涉及:请求传递至少一个 基于从清单文件中选择的第一段标识符; 基于所述第一请求段,从所述清单文件中选择第二至少一个段标识符,所述第二段标识符与预期的未来段请求相关联; 以及预先解析与所选择的第二段标识符相关联的第一段定位器,以获得与所述第一段定位符相关联的网络信息。

    Video coding based on global motion compensated motion vector predictors

    公开(公告)号:US11356695B2

    公开(公告)日:2022-06-07

    申请号:US17276260

    申请日:2019-09-13

    摘要: A method of determining a bitstream is described, the method including: determining a motion vector (MV) of a current block of a current video frame of a sequence of video frames comprising video data captured by a camera, the MV defining an offset of the current block relative to a prediction block, wherein part of the offset is caused by global motion in the video data if the camera is moving relative to a scene; determining motion vector predictor MW candidates for predicting the MV, the MW candidates being determined based on MVs of already encoded blocks; determining a motion compensation vector MCV for MW candidates, determining global motion compensated MW candidates based on a difference between a MW candidate and an associated MCV; selecting a compensated MW; and, determining a motion vector difference MVD based on the compensated MW and the MW; and, using entropy coding to code, the MVD, an indication of the selected compensated MW; and, conversion information for converting a MVP into a compensated MW, into a bitstream.

    Coding Spherical Video Data
    10.
    发明申请

    公开(公告)号:US20200177916A1

    公开(公告)日:2020-06-04

    申请号:US16611419

    申请日:2018-05-08

    摘要: A method is described of forming a bitstream by an encoder apparatus comprising: a processor of the encoder apparatus receiving a projected video frame including one or more pixel regions, the one or more pixel regions representing pixels of spherical video data projected onto one or more 2D projection surfaces of a projection model, the projection model being adapted to project spherical video data onto a rectangular 2D surface of a video frame; the processor generating a plurality of different candidate video frames on the basis of the received projected video frame, each candidate video frame being formed by applying at least one operation to one or more groups of pixels in one or more pixel regions of the projected video frame, wherein said at least operation includes a shift, mirror and/or rotation operation; and, wherein said operation is different for each of said plurality of different candidate video frames; the processor applying a rate distortion analysis to each of the candidate video frames to determine a rate distortion cost for each of the candidate video frames; and, the processor selecting a candidate video frame from said plurality of candidate video frames on the basis of the rate distortion cost; and, generating an output bitstream on the basis of the selected candidate video frame.