公开(公告)号：US11483475B2

公开(公告)日：2022-10-25

申请号：US16935476

申请日：2020-07-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Matthew Wozniak ,  Bakkama Srinath Reddy ,  Amr Martini

IPC: H04N5/232 ,  H04N19/184 ,  H04N19/33 ,  G06K9/00 ,  G06T11/00 ,  G06V20/40

Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.

公开(公告)号：US11451710B2

公开(公告)日：2022-09-20

申请号：US16935476

申请日：2020-07-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Matthew Wozniak ,  Bakkama Srinath Reddy ,  Amr Martini

IPC: H04N5/232 ,  H04N19/184 ,  H04N19/33 ,  G06K9/00 ,  G06T11/00 ,  G06V20/40

Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.

公开(公告)号：US20200351442A1

公开(公告)日：2020-11-05

申请号：US16935476

申请日：2020-07-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Matthew Wozniak ,  Bakkama Srinath Reddy ,  Amr Martini

IPC: H04N5/232 ,  H04N19/184 ,  H04N19/33 ,  G06K9/00 ,  G06T11/00

Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.

公开(公告)号：US10764494B2

公开(公告)日：2020-09-01

申请号：US15990548

申请日：2018-05-25

Applicant: Microsoft Technology Licensing, LLC

Inventor： Matthew Wozniak ,  Bakkama Srinath Reddy ,  Amr Martini

IPC: H04N19/33 ,  H04N5/232 ,  H04N19/184 ,  G06K9/00 ,  G06T11/00

Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.

公开(公告)号：US10666863B2

公开(公告)日：2020-05-26

申请号：US15990557

申请日：2018-05-25

Applicant: Microsoft Technology Licensing, LLC

Inventor： Matthew Wozniak ,  Bakkama Srinath Reddy ,  Amr Martini

IPC: H04N5/232 ,  H04N19/184 ,  H04N19/30 ,  G06K9/00 ,  G06T11/00

Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with overlapping sections. For example, a stream configuration tool splits an input picture of panoramic video into overlapping sections. A playback tool reconstructs one or more of the sections. Because of overlap between adjacent sections, for gradual changes in a view window, the playback tool can, in effect, preemptively fetch a new section as the view window moves out of a current section into the new section. By the time the view window reaches a non-overlapping part of the adjacent, new section, the playback tool has retrieved encoded data for the new section and can reconstruct the new section. This hides network latency and stream switching latency from the viewer, and disruption of playback is avoided.

公开(公告)号：US20190364205A1

公开(公告)日：2019-11-28

申请号：US15990557

申请日：2018-05-25

Applicant: Microsoft Technology Licensing, LLC

Inventor： Matthew Wozniak ,  Bakkama Srinath Reddy ,  Amr Martini

IPC: H04N5/232 ,  G06T11/00 ,  G06K9/00 ,  H04N19/184 ,  H04N19/30

Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with overlapping sections. For example, a stream configuration tool splits an input picture of panoramic video into overlapping sections. A playback tool reconstructs one or more of the sections. Because of overlap between adjacent sections, for gradual changes in a view window, the playback tool can, in effect, preemptively fetch a new section as the view window moves out of a current section into the new section. By the time the view window reaches a non-overlapping part of the adjacent, new section, the playback tool has retrieved encoded data for the new section and can reconstruct the new section. This hides network latency and stream switching latency from the viewer, and disruption of playback is avoided.

公开(公告)号：US20190364204A1

公开(公告)日：2019-11-28

申请号：US15990548

申请日：2018-05-25

Applicant: Microsoft Technology Licensing, LLC

Inventor： Matthew Wozniak ,  Bakkama Srinath Reddy ,  Amr Martini

IPC: H04N5/232 ,  H04N19/33 ,  G06T11/00 ,  G06K9/00 ,  H04N19/184

Abstract: Innovations in stream configuration operations and playback operations for adaptive streaming of panoramic video are described. The innovations include features of adaptive streaming of panoramic video with composite pictures. For example, a stream configuration tool splits an input picture of panoramic video into multiple sections and creates multiple composite pictures. A composite picture includes one of the sections as well as a low-resolution version of the input picture. A playback tool reconstructs one or more composite pictures. Under normal operation, the playback tool can use the reconstructed section(s) of the composite picture(s) to render high-quality views of the panoramic video. If the view window dramatically changes, however, or if encoded data for a section is lost or corrupted, the playback tool can use the low-resolution version of the input picture to render lower-quality details for views of the panoramic video, without disruption of playback.