公开(公告)号：US10455286B2

公开(公告)日：2019-10-22

申请号：US16296924

申请日：2019-03-08

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Balachandar Sivakumar ,  Shyam Sadhwani

IPC: H04N7/167 ,  H04N21/4627 ,  H04N21/4408 ,  G06F21/10 ,  H04N21/4385 ,  H04N21/435

Abstract: Video content is protected using a digital rights management (DRM) mechanism, the video content having been previously encrypted and compressed for distribution, and also including metadata such as closed captioning data, which might be encrypted or clear. The video content is obtained by a system of a computing device, the metadata is extracted from the video content and provided to a video decoder, and the video content is provided to a secure DRM component. The secure DRM component decrypts the video content and provides the decrypted video content to a secure decoder component of a video decoder. As part of the decryption, the secure DRM component drops the metadata that was included in the obtained video content. However, the video decoder receives the extracted metadata in a non-protected environment and thus is able to provide the extracted metadata and the decoded video content to a content playback application.

公开(公告)号：US10380358B2

公开(公告)日：2019-08-13

申请号：US16039021

申请日：2018-07-18

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Yongjun Wu ,  Shyam Sadhwani ,  Robert K. Hughes

IPC: G06F21/60 ,  H04N21/2347 ,  H04N21/236 ,  H04N21/434 ,  H04N21/4405 ,  H04N21/235 ,  H04N21/435 ,  H04N19/70 ,  H04N19/169

Abstract: Techniques are described for communicating encoded data using start code emulation prevention. The described techniques include obtaining at least one partially encrypted packet, identifying at least one portion of the packet that is unencrypted, and determining that the identified unencrypted portion(s) emulates a start code. Start code emulation prevention data or emulation prevention bytes (EPBs) may be inserted into only the encrypted portion of the packet. The modified packet may be communicated to another device/storage, along with an indication of which portion(s) of the packet are unencrypted. Upon receiving the packet and indication, the receiving device may identify and remove the EPBs in the identified unencrypted portion(s) of the packet, and decrypt the packet to recover the data. In some aspects, upon identifying the indication, the receiving device may only search for EPBs in the unencrypted portion(s) of the packet, thus yielding a more efficient start code emulation prevention process.

公开(公告)号：US20190158881A1

公开(公告)日：2019-05-23

申请号：US16240017

申请日：2019-01-04

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Lihua Zhu ,  Shyam Sadhwani ,  Gary J. Sullivan

IPC: H04N19/70 ,  H04N19/172 ,  H04N19/44 ,  H04N19/119 ,  H04N19/89 ,  H04N19/167 ,  H04N19/169

CPC classification number: H04N19/70 ,  H04N19/119 ,  H04N19/167 ,  H04N19/172 ,  H04N19/188 ,  H04N19/44 ,  H04N19/89

Abstract: Syntax structures that indicate the completion of coded regions of pictures are described. For example, a syntax structure in an elementary bitstream indicates the completion of a coded region of a picture. The syntax structure can be a type of network abstraction layer unit, a type of supplemental enhancement information message or another syntax structure. For example, a media processing tool such as an encoder can detect completion of a coded region of a picture, then output, in a predefined order in an elementary bitstream, syntax structure(s) that contain the coded region as well as a different syntax structure that indicates the completion of the coded region. Another media processing tool such as a decoder can receive, in a predefined order in an elementary bitstream, syntax structure(s) that contain a coded region of a picture as well as a different syntax structure that indicates the completion of the coded region.

公开(公告)号：US20180234686A1

公开(公告)日：2018-08-16

申请号：US15955558

申请日：2018-04-17

Applicant: Microsoft Technology Licensing, LLC

Inventor： Lihua Zhu ,  Sridhar Sankuratri ,  B. Anil Kumar ,  Yongjun Wu ,  Sandeep Kanumuri ,  Shyam Sadhwani ,  Gary J. Sullivan

IPC: H04N19/182 ,  H04N21/2343 ,  H04N9/64 ,  H04N1/64 ,  H04N19/186 ,  H04N19/80 ,  H04N19/70 ,  H04N19/59 ,  H04N19/30 ,  H04N19/88

CPC classification number: H04N19/182 ,  H04N1/646 ,  H04N9/64 ,  H04N19/186 ,  H04N19/30 ,  H04N19/59 ,  H04N19/70 ,  H04N19/80 ,  H04N19/88 ,  H04N21/234327 ,  H04N21/234363

Abstract: Video frames of a higher-resolution chroma sampling format such as YUV 4:4:4 are packed into video frames of a lower-resolution chroma sampling format such as YUV 4:2:0 for purposes of video encoding. For example, sample values for a frame in YUV 4:4:4 format are packed into two frames in YUV 4:2:0 format. After decoding, the video frames of the lower-resolution chroma sampling format can be unpacked to reconstruct the video frames of the higher-resolution chroma sampling format. In this way, available encoders and decoders operating at the lower-resolution chroma sampling format can be used, while still retaining higher resolution chroma information. In example implementations, frames in YUV 4:4:4 format are packed into frames in YUV 4:2:0 format such that geometric correspondence is maintained between Y, U and V components for the frames in YUV 4:2:0 format.

公开(公告)号：US09800898B2

公开(公告)日：2017-10-24

申请号：US14705705

申请日：2015-05-06

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Lihua Zhu ,  Shyam Sadhwani ,  Gary J. Sullivan

IPC: H04N19/70 ,  H04N19/167 ,  H04N19/172 ,  H04N19/169 ,  H04N19/119 ,  H04N19/44 ,  H04N19/89

CPC classification number: H04N19/70 ,  H04N19/119 ,  H04N19/167 ,  H04N19/172 ,  H04N19/188 ,  H04N19/44 ,  H04N19/89

Abstract: Syntax structures that indicate the completion of coded regions of pictures are described. For example, a syntax structure in an elementary bitstream indicates the completion of a coded region of a picture. The syntax structure can be a type of network abstraction layer unit, a type of supplemental enhancement information message or another syntax structure. For example, a media processing tool such as an encoder can detect completion of a coded region of a picture, then output, in a predefined order in an elementary bitstream, syntax structure(s) that contain the coded region as well as a different syntax structure that indicates the completion of the coded region. Another media processing tool such as a decoder can receive, in a predefined order in an elementary bitstream, syntax structure(s) that contain a coded region of a picture as well as a different syntax structure that indicates the completion of the coded region.

公开(公告)号：US09749646B2

公开(公告)日：2017-08-29

申请号：US14599416

申请日：2015-01-16

Applicant: Microsoft Technology Licensing, LLC

Inventor： Lihua Zhu ,  Shir Aharon ,  Yongjun Wu ,  B. Anil Kumar ,  Jeroen E. van Eesteren ,  Costin Hagiu ,  Shyam Sadhwani

IPC: H04N19/30 ,  H04N19/186 ,  H04N19/136 ,  H04N19/167 ,  H04N19/51 ,  H04N19/132 ,  H04N19/182

CPC classification number: H04N19/186 ,  H04N19/132 ,  H04N19/136 ,  H04N19/167 ,  H04N19/182 ,  H04N19/30 ,  H04N19/51

Abstract: Innovations in encoding and decoding of video pictures in a high-resolution chroma sampling format (such as YUV 4:4:4) using a video encoder and decoder operating on coded pictures in a low-resolution chroma sampling format (such as YUV 4:2:0) are presented. For example, high chroma resolution details are selectively encoded on a region-by-region basis. Or, as another example, coded pictures that contain sample values for low chroma resolution versions of input pictures and coded pictures that contain sample values for high chroma resolution details of the input pictures are encoded as separate sub-sequences of a single sequence of coded pictures, which can facilitate effective motion compensation. In this way, available encoders and decoders operating on coded pictures in the low-resolution chroma sampling format can be effectively used to provide high chroma resolution details.

公开(公告)号：US20170220283A1

公开(公告)日：2017-08-03

申请号：US15011085

申请日：2016-01-29

Applicant: Microsoft Technology Licensing, LLC

Inventor： Wenbo Zhang ,  Shyam Sadhwani ,  Sudhakar Prabhu ,  Yongjun Wu

IPC: G06F3/06 ,  H04N19/184

CPC classification number: H04N19/423 ,  H04N19/44

Abstract: Techniques and systems for reducing memory usage by a decoder during a format change are disclosed. In a first example technique, discretized memory allocations for new output buffers are sequenced with discretized release operations of previously-allocated memory for previous output buffers in a manner that reduces the amount of in-use memory of a computing device during a format change. In a second example technique, the allocation of new memory for new decoder buffers associated with a new format is conditioned upon the release of previously-allocated memory for decoder buffers associated with a previous format to reduce memory usage during a format change. The first and second techniques, when combined, result in optimized reduction in memory usage by a decoder during a format change.

公开(公告)号：US20170127074A1

公开(公告)日：2017-05-04

申请号：US14927127

申请日：2015-10-29

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Shyam Sadhwani ,  Bakkama Srinath Reddy

IPC: H04N19/44 ,  G06T3/40 ,  H04N19/70 ,  H04N19/136 ,  H04N19/176 ,  H04N19/423

CPC classification number: H04N19/44 ,  H04N19/423

Abstract: Aspects extend to methods, systems, and computer program products for video bit stream decoding. Aspects include flexible definition and detection of surface alignment requirements for decoding hardware. Surface alignment requirements can be handled by render cropping (e.g., cropping at a video output device), through adjustment and modification of original syntax values in a video bit stream and relaxed media type negotiation in a software (host) decoder. Resolution changes can be hidden with the aligned surface allocation when applicable. Performance can be improved and power consumption reduced by using hidden resolution changes.

公开(公告)号：US20170064313A1

公开(公告)日：2017-03-02

申请号：US14841689

申请日：2015-08-31

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Yongjun Wu ,  Shyam Sadhwani ,  Abo Talib Mahfoodh

IPC: H04N19/33 ,  H04N19/124 ,  H04N19/172 ,  H04N19/119

CPC classification number: H04N19/33 ,  H04N19/119 ,  H04N19/124 ,  H04N19/172 ,  H04N19/42 ,  H04N19/43 ,  H04N19/46 ,  H04N19/61 ,  H04N19/70 ,  H04N19/91

Abstract: A host decoder and accelerator communicate across an acceleration interface. The host decoder receives at least part of a bitstream for video, and it manages certain decoding operations of the accelerator across the acceleration interface. The accelerator receives data from the host decoder across the acceleration interface, then performs decoding operations. For a given frame, settings based on an uncompressed frame header can be transferred in a different buffer of the acceleration interface than a compressed frame header and compressed frame data. Among other features, the host decoder can assign settings used by the accelerator that override values of bitstream syntax elements, can assign surface index values used by the accelerator to update reference frame buffers, and can handle skipped frames without invoking the accelerator. Among other features, the accelerator can use surface index values to update reference frame buffers, and can handle changes in spatial resolution at non-key frames.

Abstract translation: 主机解码器和加速器通过加速接口进行通信。 主机解码器接收用于视频的比特流的至少一部分，并且它管理加速器界面上的加速器的某些解码操作。 加速器通过加速接口从主机解码器接收数据，然后执行解码操作。 对于给定的帧，基于未压缩帧头的设置可以在加速接口的不同缓冲器中传送，而不是压缩帧头和压缩帧数据。 在其他特征中，主机解码器可以分配由加速器使用的设置来覆盖比特流语法元素的值，可以分配加速器使用的表面索引值来更新参考帧缓冲器，并且可以处理跳过的帧而不调用加速器。 在其他特征中，加速器可以使用表面索引值来更新参考帧缓冲器，并且可以处理非关键帧处的空间分辨率的变化。

公开(公告)号：US20170048532A1

公开(公告)日：2017-02-16

申请号：US14825589

申请日：2015-08-13

Applicant: Microsoft Technology Licensing, LLC

Inventor： Shyam Sadhwani ,  Yongjun Wu

IPC: H04N19/39 ,  H04N19/33

CPC classification number: H04N19/39 ,  H04N19/30 ,  H04N19/33 ,  H04N19/423 ,  H04N19/70

Abstract: An encoded bitstream of video data can include layers of encoded video data. Such layers can be removed by a device in response to, for example, available bandwidth or device capabilities. The encoded bitstream also includes values for reference count parameters that are used by a video decoder to allocate memory when decoding the video data. If layers of the encoded video data are removed from the encoded bitstream, the values for these reference count parameters are modified. By modifying the values of these parameters, the video decoder allocates a different amount of memory and memory utilization is improved. Such modifications can be made by processing the encoded bitstream without re-encoding the encoded video data.

Abstract translation: 视频数据的编码比特流可以包括编码视频数据的层。 响应于例如可用带宽或设备能力，可以通过设备去除这样的层。 经编码的比特流还包括参考计数参数的值，视频解码器在解码视频数据时分配存储器。 如果编码视频数据的层从编码比特流中移除，则这些参考计数参数的值被修改。 通过修改这些参数的值，视频解码器分配不同量的存储器，并提高存储器利用率。 可以通过处理编码的比特流而不对编码的视频数据进行重新编码来进行这种修改。