公开(公告)号：US20240080475A1

公开(公告)日：2024-03-07

申请号：US18386778

申请日：2023-11-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Gary J. Sullivan ,  Yongjun Wu

IPC: H04N19/58 ,  H04N19/423 ,  H04N19/46 ,  H04N19/573 ,  H04N19/70

CPC classification number: H04N19/58 ,  H04N19/423 ,  H04N19/46 ,  H04N19/573 ,  H04N19/70

Abstract: Innovations for signaling state of a decoded picture buffer (“DPB”) and reference picture lists (“RPLs”). In example implementations, rather than rely on internal state of a decoder to manage and update DPB and RPLs, state information about the DPB and RPLs is explicitly signaled. This permits a decoder to determine which pictures are expected to be available for reference from the signaled state information. For example, an encoder determines state information that identifies which pictures are available for use as reference pictures (optionally considering feedback information from a decoder about which pictures are available). The encoder sets syntax elements that represent the state information. In doing so, the encoder sets identifying information for a long-term reference picture (“LTRP”), where the identifying information is a value of picture order count least significant bits for the LTRB. The encoder then outputs the syntax elements as part of a bitstream.

公开(公告)号：US11902542B2

公开(公告)日：2024-02-13

申请号：US17947263

申请日：2022-09-19

Applicant: Microsoft Technology Licensing, LLC

Inventor： Gary J. Sullivan ,  Yongjun Wu

IPC: H04N19/172 ,  H04N19/136 ,  H04N19/16 ,  H04N19/46 ,  H04N19/70

CPC classification number: H04N19/172 ,  H04N19/136 ,  H04N19/16 ,  H04N19/46 ,  H04N19/70

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

公开(公告)号：US20230017315A1

公开(公告)日：2023-01-19

申请号：US17947263

申请日：2022-09-19

Applicant: Microsoft Technology Licensing, LLC

Inventor： Gary J. Sullivan ,  Yongjun Wu

IPC: H04N19/172 ,  H04N19/136 ,  H04N19/16 ,  H04N19/46

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

公开(公告)号：US20210377578A1

公开(公告)日：2021-12-02

申请号：US17394696

申请日：2021-08-05

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Naveen Thumpudi ,  Shyam Sadhwani

IPC: H04N21/2383 ,  H04N21/235 ,  H04N21/438 ,  H04N21/84 ,  H04N21/2343

Abstract: A media processing tool adds custom data to an elementary media bitstream or media container. The custom data indicates nominal range of samples of media content, but the meaning of the custom data is not defined in the codec format or media container format. For example, the custom data indicates the nominal range is full range or limited range. For playback, a media processing tool parses the custom data and determines an indication of media content type. A rendering engine performs color conversion operations whose logic changes based at least in part on the media content type. In this way, a codec format or media container format can in effect be extended to support full nominal range media content as well as limited nominal range media content, and hence preserve full or correct color fidelity, while maintaining backward compatibility and conformance with the codec format or media container format.

公开(公告)号：US11115668B2

公开(公告)日：2021-09-07

申请号：US16416017

申请日：2019-05-17

Applicant: Microsoft Technology Licensing, LLC

Inventor： Gary J. Sullivan ,  Yongjun Wu

IPC: H04N19/172 ,  H04N19/16 ,  H04N19/46 ,  H04N19/136

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

公开(公告)号：US20210092441A1

公开(公告)日：2021-03-25

申请号：US17112304

申请日：2020-12-04

Applicant: Microsoft Technology Licensing, LLC

Inventor： Gary J. Sullivan ,  Yongjun Wu

IPC: H04N19/58 ,  H04N19/70 ,  H04N19/46 ,  H04N19/423 ,  H04N19/573

Abstract: Innovations for signaling state of a decoded picture buffer (“DPB”) and reference picture lists (“RPLs”). In example implementations, rather than rely on internal state of a decoder to manage and update DPB and RPLs, state information about the DPB and RPLs is explicitly signaled. This permits a decoder to determine which pictures are expected to be available for reference from the signaled state information. For example, an encoder determines state information that identifies which pictures are available for use as reference pictures (optionally considering feedback information from a decoder about which pictures are available). The encoder sets syntax elements that represent the state information. In doing so, the encoder sets identifying information for a long-term reference picture (“LTRP”), where the identifying information is a value of picture order count least significant bits for the LTRB. The encoder then outputs the syntax elements as part of a bitstream.

公开(公告)号：US20200304848A1

公开(公告)日：2020-09-24

申请号：US16899214

申请日：2020-06-11

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Naveen Thumpudi ,  Shyam Sadhwani

IPC: H04N21/2383 ,  H04N21/235 ,  H04N21/438 ,  H04N21/84 ,  H04N21/2343

Abstract: A media processing tool adds custom data to an elementary media bitstream or media container. The custom data indicates nominal range of samples of media content, but the meaning of the custom data is not defined in the codec format or media container format. For example, the custom data indicates the nominal range is full range or limited range. For playback, a media processing tool parses the custom data and determines an indication of media content type. A rendering engine performs color conversion operations whose logic changes based at least in part on the media content type. In this way, a codec format or media container format can in effect be extended to support full nominal range media content as well as limited nominal range media content, and hence preserve full or correct color fidelity, while maintaining backward compatibility and conformance with the codec format or media container format.

公开(公告)号：US10283091B2

公开(公告)日：2019-05-07

申请号：US14661643

申请日：2015-03-18

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Shyam Sadhwani

IPC: G09G5/39 ,  G06T15/00 ,  G06T1/20 ,  H04N21/436 ,  H04N21/44 ,  H04N21/4402 ,  H04N21/45 ,  G06F9/50

Abstract: Buffer optimization techniques are described herein in which a graphics processing system is configured to implement and select between a plurality of buffer schemes for processing of an encoded data stream in dependence upon formats used for decoding and rendering (e.g., video format, bit depth, resolution, content type, etc.) and device capabilities such as available memory and/or processing power. Processing of an encoded data stream for display and rendering via the graphics processing system then occurs using a selected one of the buffer schemes to define buffers employed for the decoding and rendering, including at least configuring the sizes of buffers. The plurality of schemes may include at least one buffer scheme for processing the encoded content when the input format and the output format are the same, and a different buffer scheme for processing the encoded content when the input format and the output format are different.

公开(公告)号：US10205966B2

公开(公告)日：2019-02-12

申请号：US15713414

申请日：2017-09-22

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Lihua Zhu ,  Shyam Sadhwani ,  Gary J. Sullivan

IPC: H04N19/70 ,  H04N19/167 ,  H04N19/172 ,  H04N19/169 ,  H04N19/119 ,  H04N19/44 ,  H04N19/89

Abstract: Syntax structures that indicate the completion of coded regions of pictures are described. For example, a syntax structure in an elementary bitstream indicates the completion of a coded region of a picture. The syntax structure can be a type of network abstraction layer unit, a type of supplemental enhancement information message or another syntax structure. For example, a media processing tool such as an encoder can detect completion of a coded region of a picture, then output, in a predefined order in an elementary bitstream, syntax structure(s) that contain the coded region as well as a different syntax structure that indicates the completion of the coded region. Another media processing tool such as a decoder can receive, in a predefined order in an elementary bitstream, syntax structure(s) that contain a coded region of a picture as well as a different syntax structure that indicates the completion of the coded region.

公开(公告)号：US20190045237A1

公开(公告)日：2019-02-07

申请号：US16100519

申请日：2018-08-10

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Naveen Thumpudi ,  Shyam Sadhwani

IPC: H04N21/2383 ,  H04N21/84 ,  H04N21/438 ,  H04N21/235 ,  H04N21/2343 ,  H04N21/236 ,  H04N21/4402

Abstract: A media processing tool adds custom data to an elementary media bitstream or media container. The custom data indicates nominal range of samples of media content, but the meaning of the custom data is not defined in the codec format or media container format. For example, the custom data indicates the nominal range is full range or limited range. For playback, a media processing tool parses the custom data and determines an indication of media content type. A rendering engine performs color conversion operations whose logic changes based at least in part on the media content type. In this way, a codec format or media container format can in effect be extended to support full nominal range media content as well as limited nominal range media content, and hence preserve full or correct color fidelity, while maintaining backward compatibility and conformance with the codec format or media container format.