-
公开(公告)号:US10368074B2
公开(公告)日:2019-07-30
申请号:US15074902
申请日:2016-03-18
IPC分类号: H04N19/146 , H04N19/132 , H04N19/172 , H04N19/137 , H04N19/58 , H04N19/176 , H04N19/142
摘要: Innovations in opportunistic frame dropping for variable-frame-rate encoding of digital video are presented. In general, a computing system selectively drops a frame when the cost of encoding the frame (e.g., in terms of use of computational resources and/or power) is expected to outweigh the benefit of encoding the frame (e.g., in terms of better quality). For example, a frame dropping module detects whether there is significant change in a given frame relative to a control frame, which is a previous frame stored in a control frame buffer. If significant change is detected, the frame dropping module stores the given frame in the control frame buffer, thereby replacing the control frame, and passes the given frame to a video encoder. Otherwise, the frame dropping module drops the given frame without replacing the control frame in the control frame buffer and without passing the given frame to the video encoder.
-
公开(公告)号:US10242714B2
公开(公告)日:2019-03-26
申请号:US15384210
申请日:2016-12-19
发明人: Dibyajyoti Roy , Vladislav Alexandrov , David H. Mebane , Aaron Oneal , Matthew Wozniak , Bakkama Srinath Reddy , Shyam Sadhwani
IPC分类号: H04N13/00 , H04N21/6587 , G11B27/10 , H04N5/232 , H04N21/81 , H04N21/472 , H04N21/44 , H04N21/4402 , H04N21/218
摘要: Innovations in reconstruction and rendering of panoramic video are described, including the use of a platform rendering engine to provide a screen projection based on a view direction specified for an application through an interface. For example, based at least in part on the view direction specified for the application, at least a section of panoramic video in an input projection is identified. At least some of sample values of the at least a section of the picture of panoramic video in the input projection are mapped to a screen projection. The screen projection is output for display to a buffer for the application. Thus, an application may use panoramic video, including updating a view direction, without itself having to render a screen projection for the panoramic video.
-
公开(公告)号:US11483475B2
公开(公告)日:2022-10-25
申请号:US16935476
申请日:2020-07-22
摘要: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.
-
4.
公开(公告)号:US20180152682A1
公开(公告)日:2018-05-31
申请号:US15384265
申请日:2016-12-19
发明人: Matthew Wozniak , Bakkama Srinath Reddy , Vladislav Alexandrov , David H. Mebane , Dibyajyoti Roy , Shyam Sadhwani
CPC分类号: H04N9/3185 , G06T3/0043 , H04N9/646 , H04N9/67 , H04N19/44 , H04N19/597 , H04N19/85
摘要: Innovations in reconstruction and rendering of panoramic video are described. For example, a view-dependent operation controller of a panoramic video playback system receives an indication of a view direction for an application and, based at least in part on the view direction, identifies a section of a picture of panoramic video in an input projection. The view-dependent operation controller limits operations of a color converter, video decoder, and/or streaming controller to the identified section. In this way, the panoramic video playback system can avoid performing operations to reconstruct sections of the picture of panoramic video that will not be viewed. As another example, a mapper of a panoramic video playback system re-projects at least some sample values in an input flat projection towards a center location for a view direction, producing an output flat projection, which an application can use to generate one or more screen projections.
-
公开(公告)号:US20170127072A1
公开(公告)日:2017-05-04
申请号:US14927166
申请日:2015-10-29
发明人: Yuechuan Li , Yongjun Wu , Shyam Sadhwani , Bakkama Srinath Reddy , Matthew R. Wozniak , Victor V. Cherepanov
IPC分类号: H04N19/436 , H04N19/13 , H04N19/44 , H04N19/96 , H04N19/593 , H04N19/513
CPC分类号: H04N19/436 , H04N19/13 , H04N19/44 , H04N19/513 , H04N19/593 , H04N19/96
摘要: Aspects extend to methods, systems, and computer program products for transforming video bit streams for parallel decoding. Aspects of the invention can be used to break segment coding structure limitations in video bit streams. Aspects can be used to maximize parallelization of video decoding tasks, including motion compensation processing, to more efficiently utilize multi-core and multi-processor computer systems. Multiple portions of intra-segment data can be processed in parallel to speed up single frame processing. Video communication latency and memory requirements are also reduced.
-
6.
公开(公告)号:US10574955B2
公开(公告)日:2020-02-25
申请号:US16269230
申请日:2019-02-06
发明人: Matthew Wozniak , Bakkama Srinath Reddy , Vladislav Alexandrov , David H. Mebane , Dibyajyoti Roy , Shyam Sadhwani
摘要: Innovations in reconstruction and rendering of panoramic video are described. For example, a view-dependent operation controller of a panoramic video playback system receives an indication of a view direction for an application and, based at least in part on the view direction, identifies a section of a picture of panoramic video in an input projection. The view-dependent operation controller limits operations of a color converter, video decoder, and/or streaming controller to the identified section. In this way, the panoramic video playback system can avoid performing operations to reconstruct sections of the picture of panoramic video that will not be viewed. As another example, a mapper of a panoramic video playback system re-projects at least some sample values in an input flat projection towards a center location for a view direction, producing an output flat projection, which an application can use to generate one or more screen projections.
-
7.
公开(公告)号:US10244215B2
公开(公告)日:2019-03-26
申请号:US15384265
申请日:2016-12-19
发明人: Matthew Wozniak , Bakkama Srinath Reddy , Vladislav Alexandrov , David H. Mebane , Dibyajyoti Roy , Shyam Sadhwani
摘要: Innovations in reconstruction and rendering of panoramic video are described. For example, a view-dependent operation controller of a panoramic video playback system receives an indication of a view direction for an application and, based at least in part on the view direction, identifies a section of a picture of panoramic video in an input projection. The view-dependent operation controller limits operations of a color converter, video decoder, and/or streaming controller to the identified section. In this way, the panoramic video playback system can avoid performing operations to reconstruct sections of the picture of panoramic video that will not be viewed. As another example, a mapper of a panoramic video playback system re-projects at least some sample values in an input flat projection towards a center location for a view direction, producing an output flat projection, which an application can use to generate one or more screen projections.
-
公开(公告)号:US10200707B2
公开(公告)日:2019-02-05
申请号:US14927127
申请日:2015-10-29
IPC分类号: H04N19/44 , H04N19/423
摘要: Aspects extend to methods, systems, and computer program products for video bit stream decoding. Aspects include flexible definition and detection of surface alignment requirements for decoding hardware. Surface alignment requirements can be handled by render cropping (e.g., cropping at a video output device), through adjustment and modification of original syntax values in a video bit stream and relaxed media type negotiation in a software (host) decoder. Resolution changes can be hidden with the aligned surface allocation when applicable. Performance can be improved and power consumption reduced by using hidden resolution changes.
-
公开(公告)号:US20180174619A1
公开(公告)日:2018-06-21
申请号:US15384210
申请日:2016-12-19
发明人: Dibyajyoti Roy , Vladislav Alexandrov , David H. Mebane , Aaron Oneal , Matthew Wozniak , Bakkama Srinath Reddy , Shyam Sadhwani
IPC分类号: G11B27/10 , H04N5/232 , G11B20/00 , H04N21/81 , H04N21/472 , H04N21/44 , H04N21/4402
CPC分类号: G11B27/102 , H04N5/23238 , H04N13/00 , H04N21/21805 , H04N21/44004 , H04N21/440218 , H04N21/440245 , H04N21/47217 , H04N21/6587 , H04N21/816
摘要: Innovations in reconstruction and rendering of panoramic video are described, including the use of a platform rendering engine to provide a screen projection based on a view direction specified for an application through an interface. For example, based at least in part on the view direction specified for the application, at least a section of panoramic video in an input projection is identified. At least some of sample values of the at least a section of the picture of panoramic video in the input projection are mapped to a screen projection. The screen projection is output for display to a buffer for the application. Thus, an application may use panoramic video, including updating a view direction, without itself having to render a screen projection for the panoramic video.
-
公开(公告)号:US09998745B2
公开(公告)日:2018-06-12
申请号:US14927166
申请日:2015-10-29
发明人: Yuechuan Li , Yongjun Wu , Shyam Sadhwani , Bakkama Srinath Reddy , Matthew R. Wozniak , Victor V. Cherepanov
IPC分类号: H04N19/436 , H04N19/593 , H04N19/513 , H04N19/44 , H04N19/96 , H04N19/13
CPC分类号: H04N19/436 , H04N19/13 , H04N19/44 , H04N19/513 , H04N19/593 , H04N19/96
摘要: Aspects extend to methods, systems, and computer program products for transforming video bit streams for parallel decoding. Aspects of the invention can be used to break segment coding structure limitations in video bit streams. Aspects can be used to maximize parallelization of video decoding tasks, including motion compensation processing, to more efficiently utilize multi-core and multi-processor computer systems. Multiple portions of intra-segment data can be processed in parallel to speed up single frame processing. Video communication latency and memory requirements are also reduced.
-
-
-
-
-
-
-
-
-