公开(公告)号：US20160100196A1

公开(公告)日：2016-04-07

申请号：US14705705

申请日：2015-05-06

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Lihua Zhu ,  Shyam Sadhwani ,  Gary J. Sullivan

IPC: H04N19/70 ,  H04N19/119 ,  H04N19/169 ,  H04N19/167 ,  H04N19/172

CPC classification number: H04N19/70 ,  H04N19/119 ,  H04N19/167 ,  H04N19/172 ,  H04N19/188 ,  H04N19/44 ,  H04N19/89

Abstract: Syntax structures that indicate the completion of coded regions of pictures are described. For example, a syntax structure in an elementary bitstream indicates the completion of a coded region of a picture. The syntax structure can be a type of network abstraction layer unit, a type of supplemental enhancement information message or another syntax structure. For example, a media processing tool such as an encoder can detect completion of a coded region of a picture, then output, in a predefined order in an elementary bitstream, syntax structure(s) that contain the coded region as well as a different syntax structure that indicates the completion of the coded region. Another media processing tool such as a decoder can receive, in a predefined order in an elementary bitstream, syntax structure(s) that contain a coded region of a picture as well as a different syntax structure that indicates the completion of the coded region.

Abstract translation: 描述指示图像的编码区域的完成的语法结构。 例如，基本比特流中的语法结构指示图像的编码区域的完成。 语法结构可以是一种网络抽象层单元，一种补充增强信息消息或另一种语法结构。 例如，诸如编码器的媒体处理工具可以检测图像的编码区域的完成，然后在基本比特流中以预定义的顺序输出包含编码区域的语法结构以及不同的语法 指示编码区域完成的结构。 诸如解码器的另一媒体处理工具可以在基本比特流中以预定义的顺序接收包含图像的编码区域的语法结构以及指示编码区域的完成的不同语法结构。

公开(公告)号：US20240155135A1

公开(公告)日：2024-05-09

申请号：US18400318

申请日：2023-12-29

Applicant: Microsoft Technology Licensing, LLC

Inventor： Gary J. Sullivan ,  Yongjun Wu

IPC: H04N19/172 ,  H04N19/136 ,  H04N19/16 ,  H04N19/46

CPC classification number: H04N19/172 ,  H04N19/136 ,  H04N19/16 ,  H04N19/46 ,  H04N19/70

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

公开(公告)号：US11902541B2

公开(公告)日：2024-02-13

申请号：US17889978

申请日：2022-08-17

Applicant: Microsoft Technology Licensing, LLC

Inventor： Gary J. Sullivan ,  Yongjun Wu

IPC: H04N19/172 ,  H04N19/136 ,  H04N19/16 ,  H04N19/46 ,  H04N19/70

CPC classification number: H04N19/172 ,  H04N19/136 ,  H04N19/16 ,  H04N19/46 ,  H04N19/70

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

公开(公告)号：US20220394277A1

公开(公告)日：2022-12-08

申请号：US17889978

申请日：2022-08-17

Applicant: Microsoft Technology Licensing, LLC

Inventor： Gary J. Sullivan ,  Yongjun Wu

IPC: H04N19/172 ,  H04N19/136 ,  H04N19/16 ,  H04N19/46

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SET message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

公开(公告)号：US10701401B2

公开(公告)日：2020-06-30

申请号：US16240017

申请日：2019-01-04

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Lihua Zhu ,  Shyam Sadhwani ,  Gary J. Sullivan

IPC: H04N19/70 ,  H04N19/167 ,  H04N19/172 ,  H04N19/169 ,  H04N19/119 ,  H04N19/44 ,  H04N19/89

Abstract: Syntax structures that indicate the completion of coded regions of pictures are described. For example, a syntax structure in an elementary bitstream indicates the completion of a coded region of a picture. The syntax structure can be a type of network abstraction layer unit, a type of supplemental enhancement information message or another syntax structure. For example, a media processing tool such as an encoder can detect completion of a coded region of a picture, then output, in a predefined order in an elementary bitstream, syntax structure(s) that contain the coded region as well as a different syntax structure that indicates the completion of the coded region. Another media processing tool such as a decoder can receive, in a predefined order in an elementary bitstream, syntax structure(s) that contain a coded region of a picture as well as a different syntax structure that indicates the completion of the coded region.

公开(公告)号：US10523953B2

公开(公告)日：2019-12-31

申请号：US15955558

申请日：2018-04-17

Applicant: Microsoft Technology Licensing, LLC

Inventor： Lihua Zhu ,  Sridhar Sankuratri ,  B. Anil Kumar ,  Yongjun Wu ,  Sandeep Kanumuri ,  Shyam Sadhwani ,  Gary J. Sullivan

IPC: H04N19/182 ,  H04N9/64 ,  H04N19/70 ,  H04N19/30 ,  H04N19/186 ,  H04N19/80 ,  H04N19/59 ,  H04N19/88 ,  H04N1/64 ,  H04N21/2343

Abstract: Video frames of a higher-resolution chroma sampling format such as YUV 4:4:4 are packed into video frames of a lower-resolution chroma sampling format such as YUV 4:2:0 for purposes of video encoding. For example, sample values for a frame in YUV 4:4:4 format are packed into two frames in YUV 4:2:0 format. After decoding, the video frames of the lower-resolution chroma sampling format can be unpacked to reconstruct the video frames of the higher-resolution chroma sampling format. In this way, available encoders and decoders operating at the lower-resolution chroma sampling format can be used, while still retaining higher resolution chroma information. In example implementations, frames in YUV 4:4:4 format are packed into frames in YUV 4:2:0 format such that geometric correspondence is maintained between Y, U and V components for the frames in YUV 4:2:0 format.

公开(公告)号：US10432964B2

公开(公告)日：2019-10-01

申请号：US15952796

申请日：2018-04-13

Applicant: Microsoft Technology Licensing, LLC

Inventor： Gary J. Sullivan ,  Yongjun Wu

IPC: H04N19/58 ,  H04N19/70 ,  H04N19/46 ,  H04N19/423 ,  H04N19/573

Abstract: Innovations for signaling state of a decoded picture buffer (“DPB”) and reference picture lists (“RPLs”). In example implementations, rather than rely on internal state of a decoder to manage and update DPB and RPLs, state information about the DPB and RPLs is explicitly signaled. This permits a decoder to determine which pictures are expected to be available for reference from the signaled state information. For example, an encoder determines state information that identifies which pictures are available for use as reference pictures (optionally considering feedback information from a decoder about which pictures are available). The encoder sets syntax elements that represent the state information. In doing so, the encoder sets identifying information for a long-term reference picture (“LTRP”), where the identifying information is a value of picture order count least significant bits for the LTRB. The encoder then outputs the syntax elements as part of a bitstream.

公开(公告)号：US20190273927A1

公开(公告)日：2019-09-05

申请号：US16416017

申请日：2019-05-17

Applicant: Microsoft Technology Licensing, LLC

Inventor： Gary J. Sullivan ,  Yongjun Wu

IPC: H04N19/172 ,  H04N19/16 ,  H04N19/46 ,  H04N19/136

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

公开(公告)号：US10217200B2

公开(公告)日：2019-02-26

申请号：US15284524

申请日：2016-10-03

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Matthew Wozniak ,  Simon Baker ,  Catalin Alexandru Negrila ,  Venkata S. K. Kamal Lanka ,  Kevin Chin ,  Brian Kohlwey

IPC: G06T5/10 ,  G06T5/00 ,  G06T5/50 ,  H04N5/232 ,  G06T3/00 ,  G06T7/20

Abstract: In one embodiment, a video processing system 300 may filter a video data set to correct skew and wobble using a central processing unit 220 and a graphical processing unit 230. The video processing system 300 may apply a rolling shutter effect correction filter to an initial version of a video data set. The video processing system 300 may simultaneously apply a video stabilization filter to the initial version to produce a final version video data set.

公开(公告)号：US20180329978A1

公开(公告)日：2018-11-15

申请号：US15863337

申请日：2018-01-05

Applicant: Microsoft Technology Licensing, LLC

Inventor： Gary J. Sullivan ,  Leon Bottou ,  Sandeep Kanumuri ,  Yongjun Wu

IPC: G06F17/30 ,  H04N19/44

CPC classification number: G06F17/30598 ,  H04N19/44

Abstract: Innovations for category-prefixed data batching (“CPDB”) of entropy-coded data or other payload data for coded media data, as well as innovations for corresponding recovery of the entropy-coded data (or other payload data) formatted with CPDB. The CPDB can be used in conjunction with coding/decoding for video content, image content, audio content or another type of content. For example, after receiving coded media data in multiple categories from encoding units, a formatting tool formats payload data with CPDB, generating a batch prefix for a batch of the CPDB-formatted payload data. The batch prefix includes a category identifier and a data quantity indicator. The formatting tool outputs the CPDB-formatted payload data to a bitstream. At the decoder side, a formatting tool receives the CPDB-formatted payload data in a bitstream, recovers the payload data from the CPDB-formatted payload data, and outputs the payload data (e.g., to decoding units).