Adaptive panoramic video streaming using composite pictures

    公开(公告)号:US11483475B2

    公开(公告)日:2022-10-25

    申请号:US16935476

    申请日:2020-07-22

    Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.

    DECODING OF INTRA-PREDICTED IMAGES
    6.
    发明申请
    DECODING OF INTRA-PREDICTED IMAGES 审中-公开
    内部预测图像的解码

    公开(公告)号:US20160353128A1

    公开(公告)日:2016-12-01

    申请号:US14727805

    申请日:2015-06-01

    Abstract: In a computer with a graphics processing unit as a coprocessor of a central processing unit, the graphics processing unit is programmed to perform waves of parallel operations to decode intra-prediction blocks of an image encoded in a certain video coding format. To decode the intra-prediction blocks of an image using the graphics processing unit, the intra-predicted blocks and their reference blocks are identified. The computer identifies whether pixel data from the reference blocks for these intra-predicted blocks are available. Blocks for which pixel data from reference blocks are available are processed in waves of parallel operations on the graphics processing unit as the pixel data becomes available. The process repeats until all intra-predicted blocks are processed. The identification of blocks to process in each wave can be determined by the graphics processing unit or the central processing unit.

    Abstract translation: 在具有作为中央处理单元的协处理器的图形处理单元的计算机中,图形处理单元被编程为执行并行操作波,以解码以某种视频编码格式编码的图像的帧内预测块。 为了使用图形处理单元解码图像的帧内预测块,识别出帧内预测块及其参考块。 计算机识别来自这些帧内预测块的参考块的像素数据是否可用。 当像素数据变得可用时,来自参考块的像素数据可用的块在图形处理单元上的并行操作波中被处理。 该过程重复直到所有内部预测块被处理。 每个波中要处理的块的识别可由图形处理单元或中央处理单元确定。

    Adaptive panoramic video streaming using overlapping partitioned sections

    公开(公告)号:US10666863B2

    公开(公告)日:2020-05-26

    申请号:US15990557

    申请日:2018-05-25

    Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with overlapping sections. For example, a stream configuration tool splits an input picture of panoramic video into overlapping sections. A playback tool reconstructs one or more of the sections. Because of overlap between adjacent sections, for gradual changes in a view window, the playback tool can, in effect, preemptively fetch a new section as the view window moves out of a current section into the new section. By the time the view window reaches a non-overlapping part of the adjacent, new section, the playback tool has retrieved encoded data for the new section and can reconstruct the new section. This hides network latency and stream switching latency from the viewer, and disruption of playback is avoided.

    ADAPTIVE PANORAMIC VIDEO STREAMING USING OVERLAPPING PARTITIONED SECTIONS

    公开(公告)号:US20190364205A1

    公开(公告)日:2019-11-28

    申请号:US15990557

    申请日:2018-05-25

    Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with overlapping sections. For example, a stream configuration tool splits an input picture of panoramic video into overlapping sections. A playback tool reconstructs one or more of the sections. Because of overlap between adjacent sections, for gradual changes in a view window, the playback tool can, in effect, preemptively fetch a new section as the view window moves out of a current section into the new section. By the time the view window reaches a non-overlapping part of the adjacent, new section, the playback tool has retrieved encoded data for the new section and can reconstruct the new section. This hides network latency and stream switching latency from the viewer, and disruption of playback is avoided.

    ADAPTIVE PANORAMIC VIDEO STREAMING USING COMPOSITE PICTURES

    公开(公告)号:US20190364204A1

    公开(公告)日:2019-11-28

    申请号:US15990548

    申请日:2018-05-25

    Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.

Patent Agency Ranking