公开(公告)号：US20190364205A1

公开(公告)日：2019-11-28

申请号：US15990557

申请日：2018-05-25

Applicant: Microsoft Technology Licensing, LLC

Inventor： Matthew Wozniak ,  Bakkama Srinath Reddy ,  Amr Martini

IPC: H04N5/232 ,  G06T11/00 ,  G06K9/00 ,  H04N19/184 ,  H04N19/30

Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with overlapping sections. For example, a stream configuration tool splits an input picture of panoramic video into overlapping sections. A playback tool reconstructs one or more of the sections. Because of overlap between adjacent sections, for gradual changes in a view window, the playback tool can, in effect, preemptively fetch a new section as the view window moves out of a current section into the new section. By the time the view window reaches a non-overlapping part of the adjacent, new section, the playback tool has retrieved encoded data for the new section and can reconstruct the new section. This hides network latency and stream switching latency from the viewer, and disruption of playback is avoided.

公开(公告)号：US20190364204A1

公开(公告)日：2019-11-28

申请号：US15990548

申请日：2018-05-25

Applicant: Microsoft Technology Licensing, LLC

Inventor： Matthew Wozniak ,  Bakkama Srinath Reddy ,  Amr Martini

IPC: H04N5/232 ,  H04N19/33 ,  G06T11/00 ,  G06K9/00 ,  H04N19/184

Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.

公开(公告)号：US20190208226A1

公开(公告)日：2019-07-04

申请号：US16294680

申请日：2019-03-06

Applicant: Microsoft Technology Licensing, LLC

Inventor： Bakkama Srinath Reddy ,  Shyam Sadhwani ,  Victor Cherepanov

IPC: H04N19/70 ,  H04N21/44

CPC classification number: H04N19/70 ,  H04N21/44008

Abstract: Approaches to selectively using start code emulation prevention (“SCEP”) on encoded data for media content are described herein. For example, a media encoder selectively performs SCEP processing on encoded data for media content, and sets a value of a syntax element that indicates whether or not to perform SCEP processing on the encoded data. The encoder stores the encoded data for output as part of a bitstream, where the syntax element is signaled in association with the bitstream. A media decoder receives the encoded data, determines, from the value of the syntax element, whether or not to perform SCEP processing on the encoded data, and selectively performs SCEP processing on the encoded data. In this way, the computational cost of scanning operations for SCEP processing can be avoided in many scenarios, and bit rate increases due to insertion of SCEP bytes can be limited.

公开(公告)号：US10244200B2

公开(公告)日：2019-03-26

申请号：US15384237

申请日：2016-12-19

Applicant: Microsoft Technology Licensing, LLC

Inventor： Matthew Wozniak ,  Bakkama Srinath Reddy ,  Vladislav Alexandrov ,  David H. Mebane ,  Dibyajyoti Roy ,  Shyam Sadhwani

IPC: H04N5/775 ,  H04N19/136 ,  H04N19/44 ,  G06T7/13 ,  G06T7/90 ,  G06T3/20 ,  H04N9/67 ,  H04N13/243 ,  H04N5/76 ,  H04N5/232 ,  G06T3/00

Abstract: Innovations in reconstruction and rendering of panoramic video are described. For example, a view-dependent operation controller of a panoramic video playback system receives an indication of a view direction for an application and, based at least in part on the view direction, identifies a section of a picture of panoramic video in an input projection. The view-dependent operation controller limits operations of a color converter, video decoder, and/or streaming controller to the identified section. In this way, the panoramic video playback system can avoid performing operations to reconstruct sections of the picture of panoramic video that will not be viewed. As another example, a mapper of a panoramic video playback system re-projects at least some sample values in an input flat projection towards a center location for a view direction, producing an output flat projection, which an application can use to generate one or more screen projections.