-
公开(公告)号:US10242714B2
公开(公告)日:2019-03-26
申请号:US15384210
申请日:2016-12-19
Applicant: Microsoft Technology Licensing, LLC
Inventor: Dibyajyoti Roy , Vladislav Alexandrov , David H. Mebane , Aaron Oneal , Matthew Wozniak , Bakkama Srinath Reddy , Shyam Sadhwani
IPC: H04N13/00 , H04N21/6587 , G11B27/10 , H04N5/232 , H04N21/81 , H04N21/472 , H04N21/44 , H04N21/4402 , H04N21/218
Abstract: Innovations in reconstruction and rendering of panoramic video are described, including the use of a platform rendering engine to provide a screen projection based on a view direction specified for an application through an interface. For example, based at least in part on the view direction specified for the application, at least a section of panoramic video in an input projection is identified. At least some of sample values of the at least a section of the picture of panoramic video in the input projection are mapped to a screen projection. The screen projection is output for display to a buffer for the application. Thus, an application may use panoramic video, including updating a view direction, without itself having to render a screen projection for the panoramic video.
-
2.
公开(公告)号:US20180218481A1
公开(公告)日:2018-08-02
申请号:US15418530
申请日:2017-01-27
Applicant: Microsoft Technology Licensing, LLC
Inventor: Glenn F. Evans , Mehmet Kucukgoz , Matthew Wozniak
CPC classification number: G06T5/009 , G06K9/00 , G06T2207/10016 , G06T2207/20208 , G09G3/342 , G09G5/02 , G09G5/10 , G09G5/36 , G09G2320/0271 , G09G2320/0646 , G09G2320/0673 , G09G2330/021 , G09G2360/08 , G09G2360/144 , G09G2360/16 , G09G2370/04 , H04N5/20 , H04N7/147 , H04N7/15 , H04N9/68
Abstract: Innovations in rendering of high dynamic range (“HDR”) content are described. A playback system can adjust a tone mapping function used when rendering the HDR content, thereby improving quality when rendering the HDR content. For example, the playback system includes decision logic, which is configured to receive summary information (e.g., histogram information) for sample values of a picture of HDR content, and set a tone mapping function based at least in part on the summary information. The tone mapping function can be selected from among multiple available tone mapping functions, and parameters of the selected tone mapping function can be determined based at least in part on the summary information. A tone mapper is configured to apply tone mapping to input values for the sample values of the picture of HDR content, according to the tone mapping function, and thereby produce output values.
-
公开(公告)号:US11483475B2
公开(公告)日:2022-10-25
申请号:US16935476
申请日:2020-07-22
Applicant: Microsoft Technology Licensing, LLC
Inventor: Matthew Wozniak , Bakkama Srinath Reddy , Amr Martini
Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.
-
4.
公开(公告)号:US10218952B2
公开(公告)日:2019-02-26
申请号:US15385711
申请日:2016-12-20
Applicant: Microsoft Technology Licensing, LLC
Inventor: Matthew Wozniak , Mehmet Kucukgoz , Abhijit Sarkar
Abstract: Innovations in rendering of high dynamic range (“HDR”) video on a display device having enhanced dynamic range (“EDR”). The peak brightness for an EDR display device is lower than the peak brightness for a typical HDR display device but higher than the peak brightness for a typical display device having standard dynamic range. The increased range of brightness values in an EDR display device can be utilized effectively to show bright highlights of the HDR video. For example, decision logic is configured to evaluate a peak brightness of a target display device and select an HDR-to-EDR tone mapping mode. A tone mapper is configured to apply tone mapping to input values for the sample values of HDR video, according to a tone mapping function, thereby producing output values for sample values of EDR video.
-
5.
公开(公告)号:US20180152682A1
公开(公告)日:2018-05-31
申请号:US15384265
申请日:2016-12-19
Applicant: Microsoft Technology Licensing, LLC
Inventor: Matthew Wozniak , Bakkama Srinath Reddy , Vladislav Alexandrov , David H. Mebane , Dibyajyoti Roy , Shyam Sadhwani
CPC classification number: H04N9/3185 , G06T3/0043 , H04N9/646 , H04N9/67 , H04N19/44 , H04N19/597 , H04N19/85
Abstract: Innovations in reconstruction and rendering of panoramic video are described. For example, a view-dependent operation controller of a panoramic video playback system receives an indication of a view direction for an application and, based at least in part on the view direction, identifies a section of a picture of panoramic video in an input projection. The view-dependent operation controller limits operations of a color converter, video decoder, and/or streaming controller to the identified section. In this way, the panoramic video playback system can avoid performing operations to reconstruct sections of the picture of panoramic video that will not be viewed. As another example, a mapper of a panoramic video playback system re-projects at least some sample values in an input flat projection towards a center location for a view direction, producing an output flat projection, which an application can use to generate one or more screen projections.
-
公开(公告)号:US20160353128A1
公开(公告)日:2016-12-01
申请号:US14727805
申请日:2015-06-01
Applicant: Microsoft Technology Licensing, LLC
Inventor: Matthew Wozniak , Yongjun Wu , Shyam Sadhwani
IPC: H04N19/593 , H04N19/182 , H04N19/192 , H04N19/176
CPC classification number: H04N19/593 , H04N19/176 , H04N19/182 , H04N19/192 , H04N19/433 , H04N19/436 , H04N19/44
Abstract: In a computer with a graphics processing unit as a coprocessor of a central processing unit, the graphics processing unit is programmed to perform waves of parallel operations to decode intra-prediction blocks of an image encoded in a certain video coding format. To decode the intra-prediction blocks of an image using the graphics processing unit, the intra-predicted blocks and their reference blocks are identified. The computer identifies whether pixel data from the reference blocks for these intra-predicted blocks are available. Blocks for which pixel data from reference blocks are available are processed in waves of parallel operations on the graphics processing unit as the pixel data becomes available. The process repeats until all intra-predicted blocks are processed. The identification of blocks to process in each wave can be determined by the graphics processing unit or the central processing unit.
Abstract translation: 在具有作为中央处理单元的协处理器的图形处理单元的计算机中,图形处理单元被编程为执行并行操作波,以解码以某种视频编码格式编码的图像的帧内预测块。 为了使用图形处理单元解码图像的帧内预测块,识别出帧内预测块及其参考块。 计算机识别来自这些帧内预测块的参考块的像素数据是否可用。 当像素数据变得可用时,来自参考块的像素数据可用的块在图形处理单元上的并行操作波中被处理。 该过程重复直到所有内部预测块被处理。 每个波中要处理的块的识别可由图形处理单元或中央处理单元确定。
-
公开(公告)号:US10666863B2
公开(公告)日:2020-05-26
申请号:US15990557
申请日:2018-05-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Matthew Wozniak , Bakkama Srinath Reddy , Amr Martini
IPC: H04N5/232 , H04N19/184 , H04N19/30 , G06K9/00 , G06T11/00
Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with overlapping sections. For example, a stream configuration tool splits an input picture of panoramic video into overlapping sections. A playback tool reconstructs one or more of the sections. Because of overlap between adjacent sections, for gradual changes in a view window, the playback tool can, in effect, preemptively fetch a new section as the view window moves out of a current section into the new section. By the time the view window reaches a non-overlapping part of the adjacent, new section, the playback tool has retrieved encoded data for the new section and can reconstruct the new section. This hides network latency and stream switching latency from the viewer, and disruption of playback is avoided.
-
公开(公告)号:US20190364205A1
公开(公告)日:2019-11-28
申请号:US15990557
申请日:2018-05-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Matthew Wozniak , Bakkama Srinath Reddy , Amr Martini
IPC: H04N5/232 , G06T11/00 , G06K9/00 , H04N19/184 , H04N19/30
Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with overlapping sections. For example, a stream configuration tool splits an input picture of panoramic video into overlapping sections. A playback tool reconstructs one or more of the sections. Because of overlap between adjacent sections, for gradual changes in a view window, the playback tool can, in effect, preemptively fetch a new section as the view window moves out of a current section into the new section. By the time the view window reaches a non-overlapping part of the adjacent, new section, the playback tool has retrieved encoded data for the new section and can reconstruct the new section. This hides network latency and stream switching latency from the viewer, and disruption of playback is avoided.
-
公开(公告)号:US20190364204A1
公开(公告)日:2019-11-28
申请号:US15990548
申请日:2018-05-25
Applicant: Microsoft Technology Licensing, LLC
Inventor: Matthew Wozniak , Bakkama Srinath Reddy , Amr Martini
IPC: H04N5/232 , H04N19/33 , G06T11/00 , G06K9/00 , H04N19/184
Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.
-
公开(公告)号:US10244200B2
公开(公告)日:2019-03-26
申请号:US15384237
申请日:2016-12-19
Applicant: Microsoft Technology Licensing, LLC
Inventor: Matthew Wozniak , Bakkama Srinath Reddy , Vladislav Alexandrov , David H. Mebane , Dibyajyoti Roy , Shyam Sadhwani
IPC: H04N5/775 , H04N19/136 , H04N19/44 , G06T7/13 , G06T7/90 , G06T3/20 , H04N9/67 , H04N13/243 , H04N5/76 , H04N5/232 , G06T3/00
Abstract: Innovations in reconstruction and rendering of panoramic video are described. For example, a view-dependent operation controller of a panoramic video playback system receives an indication of a view direction for an application and, based at least in part on the view direction, identifies a section of a picture of panoramic video in an input projection. The view-dependent operation controller limits operations of a color converter, video decoder, and/or streaming controller to the identified section. In this way, the panoramic video playback system can avoid performing operations to reconstruct sections of the picture of panoramic video that will not be viewed. As another example, a mapper of a panoramic video playback system re-projects at least some sample values in an input flat projection towards a center location for a view direction, producing an output flat projection, which an application can use to generate one or more screen projections.
-
-
-
-
-
-
-
-
-