公开(公告)号：WO2014175910A1

公开(公告)日：2014-10-30

申请号：PCT/US2013/058831

申请日：2013-09-09

Applicant: MICROSOFT CORPORATION

Inventor： EVANS, Glenn F. ,  SADHWANI, Shyam ,  WU, Yongjun

IPC: G06F21/10 ,  H04N21/00

CPC classification number: H04N21/83 ,  G06F21/10 ,  G06F2221/0735 ,  H04N21/23476 ,  H04N21/241 ,  H04N21/44055 ,  H04N21/443 ,  H04N21/4627

Abstract: Disclosed herein are representative embodiments of tools and techniques for facilitating decoding of protected media information using a secure operating system. According to one exemplary technique, encoded media information that is encrypted is received at a secure process of a secure operating system of a computing system. At least a portion of the encoded media information that is encrypted is decrypted in the secure process. The portion of the encoded media information includes header information. Additionally, the header information is sent from the secure operating system to a software decoder for control of decoding hardware. The software decoder is included in a process for an application. Also, the decoding hardware is securely provided access to the encoded media information for decoding of the encoded media information to produce decoded media information.

Abstract translation: 这里公开的是使用安全操作系统促进对受保护媒体信息进行解码的工具和技术的代表性实施例。 根据一个示例性技术，在计算系统的安全操作系统的安全过程中接收被加密的编码媒体信息。 在安全处理中解密加密的编码媒体信息的至少一部分。 编码媒体信息的部分包括标题信息。 此外，标题信息从安全操作系统发送到用于控制解码硬件的软件解码器。 软件解码器包含在应用程序的过程中。 此外，解码硬件被安全地提供对编码的媒体信息的访问，用于解码编码的媒体信息以产生解码的媒体信息。

公开(公告)号：WO2014055310A1

公开(公告)日：2014-04-10

申请号：PCT/US2013/061784

申请日：2013-09-26

Applicant: MICROSOFT CORPORATION

Inventor： ZHU, Lihua ,  SANKURATRI, Sridhar ,  KUMAR, Anil B. ,  WU, Yongjun ,  KANUMURI, Sandeep ,  SADHWANI, Shyam ,  SULLIVAN, Gary J.

IPC: H04N1/64 ,  H04N7/26 ,  H04N21/2343 ,  H04N7/46

CPC classification number: H04N19/88 ,  H04N1/646 ,  H04N9/64 ,  H04N19/186 ,  H04N19/30 ,  H04N19/59 ,  H04N19/70 ,  H04N19/80 ,  H04N21/234327 ,  H04N21/234363

Abstract: Video frames of a higher-resolution chroma sampling format such as YUV 4:4:4 are packed into video frames of a lower-resolution chroma sampling format such as YUV 4:2:0 for purposes of video encoding. For example, sample values for a frame in YUV 4:4:4 format are packed into two frames in YUV 4:2:0 format. After decoding, the video frames of the lower-resolution chroma sampling format can be unpacked to reconstruct the video frames of the higher-resolution chroma sampling format. In this way, available encoders and decoders operating at the lower-resolution chroma sampling format can be used, while still retaining higher resolution chroma information. In example implementations, frames in YUV 4:4:4 format are packed into frames in YUV 4:2:0 format such that geometric correspondence is maintained between Y, U and V components for the frames in YUV 4:2:0 format.

Abstract translation: 出于视频编码的目的，诸如YUV 4：4：4的更高分辨率色度采样格式的视频帧被打包成较低分辨率色度采样格式的视频帧，例如YUV 4：2：0。 例如，YUV 4：4：4格式的帧的样本值以YUV 4：2：0格式打包成两帧。 在解码之后，可以解压缩较低分辨率色度采样格式的视频帧以重构更高分辨率色度采样格式的视频帧。 以这种方式，可以使用以较低分辨率色度采样格式工作的可用编码器和解码器，同时仍然保留更高分辨率的色度信息。 在示例实现中，YUV 4：4：4格式的帧以YUV 4：2：0格式打包成帧，使得在YUV 4：2：0格式的帧中的Y，U和V分量之间保持几何对应。

公开(公告)号：WO2014052250A1

公开(公告)日：2014-04-03

申请号：PCT/US2013/061243

申请日：2013-09-23

Applicant: MICROSOFT CORPORATION

Inventor： SULLIVAN, Gary J. ,  WU, Yongjun

IPC: H04N19/16 ,  H04N19/172 ,  H04N19/136

CPC classification number: H04N19/00545 ,  H04N19/136 ,  H04N19/16 ,  H04N19/172 ,  H04N19/46

Abstract: This application relates to video encoding and decoding, and specifically to tools and techniques for using and providing supplemental enhancement information in bitstreams. Among other things, the detailed description presents innovations for bitstreams having supplemental enhancement information (SEI). In particular embodiments, the SEI message includes picture source data (e.g., data indicating whether the associated picture is a progressive scan picture or an interlaced scan picture and/or data indicating whether the associated picture is a duplicate picture). The SEI message can also express a confidence level of the encoder's relative confidence in the accuracy of this picture source data. A decoder can use the confidence level indication to determine whether the decoder should separately identify the picture as progressive or interlaced and/or a duplicate picture or honor the picture source scanning information in the SEI as it is.

Abstract translation: 本申请涉及视频编码和解码，具体涉及在比特流中使用和提供补充增强信息的工具和技术。 其中，详细描述提供了具有补充增强信息（SEI）的比特流的创新。 在特定实施例中，SEI消息包括图像源数据（例如，指示相关联的图像是逐行扫描图像还是隔行扫描图像的数据和/或指示相关图像是否是重复图像的数据）。 SEI消息还可以表示编码器对该图像源数据的准确性的相对置信度的置信度。 解码器可以使用置信度指示来确定解码器是否应该单独地将图像识别为渐进的或隔行扫描的和/或重复的图像，或者像SEI一样尊重图像源扫描信息。

公开(公告)号：WO2013070630A1

公开(公告)日：2013-05-16

申请号：PCT/US2012/063748

申请日：2012-11-06

Applicant: MICROSOFT CORPORATION

Inventor： SULLIVAN, Gary J. ,  WU, Yongjun

IPC: H04N7/24

CPC classification number: H04N19/58 ,  H04N19/423 ,  H04N19/46 ,  H04N19/573 ,  H04N19/70

Abstract: Innovations for signaling state of a decoded picture buffer ("DPB") and reference picture lists ("RPLs"). In example implementations, rather than rely on internal state of a decoder to manage and update DPB and RPLs, state information about the DPB and RPLs is explicitly signaled. This permits a decoder to determine which pictures are expected to be available for reference from the signaled state information. For example, an encoder determines state information that identifies which pictures are available for use as reference pictures (optionally considering feedback information from a decoder about which pictures are available). The encoder sets syntax elements that represent the state information. In doing so, the encoder sets identifying information for a long-term reference picture ("LTRP"), where the identifying information is a value of picture order count least significant bits for the LTRB. The encoder then outputs the syntax elements as part of a bitstream.

Abstract translation: 解码图像缓冲器（“DPB”）和参考图像列表（“RPL”）的信令状态的创新。 在示例实现中，不是依赖于解码器的内部状态来管理和更新DPB和RPL，而是明确地表示关于DPB和RPL的状态信息。 这允许解码器根据信号状态信息来确定哪些图像被预期可用于参考。 例如，编码器确定识别哪些图像可用作参考图像的状态信息（可选地考虑来自解码器的关于哪些图像可用的反馈信息）。 编码器设置表示状态信息的语法元素。 这样做，编码器设置长期参考图像（“LTRP”）的识别信息，其中识别信息是LTRB的图像顺序计数最小有效位的值。 然后，编码器输出语法元素作为比特流的一部分。

公开(公告)号：WO2014163663A1

公开(公告)日：2014-10-09

申请号：PCT/US2013/059564

申请日：2013-09-13

Applicant: MICROSOFT CORPORATION

Inventor： DALAL, Firoz ,  WU, Yongjun

IPC: G11B27/36 ,  H04N21/85 ,  G06F17/30

CPC classification number: G06F17/30017 ,  G11B27/36

Abstract: A container format processing tool performs syntax-aware manipulation of hierarchically organized syntax elements defined according to a container format in a media file. For example, a container format verifier checks conformance of a media file to a container format, which can help ensure interoperability between diverse sources of media content and playback equipment. Conformance verification can include verification of individual syntax elements, cross-verification, verification that any mandatory syntax elements are present and/or verification of synchronization. Or, a container format "fuzzer" simulates corruption of a media file, which can help test the resilience of playback equipment to errors in the media files. The container format fuzzer can simulate random bit flipping errors, an audio recording failure or incorrect termination of recording. Or, a container format editor can otherwise edit the media file in the container format.

Abstract translation: 容器格式处理工具执行根据媒体文件中的容器格式定义的分层组织语法元素的语法感知操作。 例如，容器格式验证器检查媒体文件与容器格式的一致性，这有助于确保媒体内容和播放设备的不同来源之间的互操作性。 一致性验证可以包括对各个语法元素的验证，交叉验证，验证任何强制性语法元素和/或同步验证。 或者，容器格式“fuzzer”模拟媒体文件的损坏，这可以帮助测试播放设备的弹性到媒体文件中的错误。 容器格式模糊器可以模拟随机位翻转错误，录音失败或记录不正确的终止。 或者，容器格式编辑器可以以容器格式编辑媒体文件。

公开(公告)号：WO2013123100A1

公开(公告)日：2013-08-22

申请号：PCT/US2013/026004

申请日：2013-02-13

Applicant: MICROSOFT CORPORATION

Inventor： WU, Yongjun ,  SADHWANI, Shyam ,  THUMPUDI, Naveen

IPC: H04N7/26

CPC classification number: H04N19/44 ,  H04N19/103 ,  H04N19/12 ,  H04N19/129 ,  H04N19/157 ,  H04N19/174 ,  H04N19/176 ,  H04N19/46 ,  H04N19/70

Abstract: A video decoder is disclosed that uses metadata in order to make optimization decisions. In one embodiment, metadata is used to choose which of multiple available decoder engines should receive a video sequence. In another embodiment, the optimization decisions can be based on length and location metadata information associated with a video sequence. Using such metadata information, a decoder engine can skip start-code scanning to make the decoding process more efficient. Also based on the choice of decoder engine, it can decide whether emulation prevention byte removal shall happen together with start code scanning or not.

Abstract translation: 公开了使用元数据以进行优化决定的视频解码器。 在一个实施例中，使用元数据来选择多个可用解码器引擎应当接收视频序列中的哪一个。 在另一个实施例中，优化决定可以基于与视频序列相关联的长度和位置元数据信息。 使用这样的元数据信息，解码器引擎可以跳过起始码扫描，以使解码过程更有效率。 同样基于解码器引擎的选择，它可以决定是否与启动代码扫描一起发生仿真预防字节删除。

公开(公告)号：WO2014158211A1

公开(公告)日：2014-10-02

申请号：PCT/US2013/058351

申请日：2013-09-06

Applicant: MICROSOFT CORPORATION

Inventor： WU, Yongjun ,  THUMPUDI, Naveen ,  SADHWANI, Shyam

IPC: H04N21/2343 ,  H04N21/235 ,  H04N21/2383 ,  H04N21/84

CPC classification number: H04N21/2383 ,  H04N21/234309 ,  H04N21/2351 ,  H04N21/23614 ,  H04N21/4382 ,  H04N21/440218 ,  H04N21/84

Abstract: A media processing tool adds custom data to an elementary media bitstream or media container. The custom data indicates nominal range of samples of media content, but the meaning of the custom data is not defined in the codec format or media container format. For example, the custom data indicates the nominal range is full range or limited range. For playback, a media processing tool parses the custom data and determines an indication of media content type. A rendering engine performs color conversion operations whose logic changes based at least in part on the media content type. In this way, a codec format or media container format can in effect be extended to support full nominal range media content as well as limited nominal range media content, and hence preserve full or correct color fidelity, while maintaining backward compatibility and conformance with the codec format or media container format.

Abstract translation: 媒体处理工具将自定义数据添加到基本媒体比特流或媒体容器。 自定义数据表示媒体内容的样本的标称范围，但自定义数据的含义未以编解码器格式或媒体容器格式定义。 例如，自定义数据表示标称范围是全范围或有限范围。 对于播放，媒体处理工具解析定制数据并确定媒体内容类型的指示。 渲染引擎执行颜色转换操作，其逻辑至少部分地基于媒体内容类型而改变。 以这种方式，编解码器格式或媒体容器格式实际上可以被扩展以支持完整的标称范围的媒体内容以及有限的标称范围的媒体内容，并因此保持完全或正确的色彩保真度，同时保持向后的兼容性和与编解码器的一致性 格式或媒体容器格式。

公开(公告)号：WO2014066182A1

公开(公告)日：2014-05-01

申请号：PCT/US2013/065754

申请日：2013-10-18

Applicant: MICROSOFT CORPORATION

Inventor： SULLIVAN, Gary, J. ,  MALVAR, Henrique, Sarmento ,  WU, Yongjun

IPC: H04N7/26

CPC classification number: H04N19/46 ,  H04N19/85 ,  H04N19/88

Abstract: When packing a video frame of a higher-resolution chroma sampling format such as YUV 4:4:4 into frames of a lower-resolution chroma sampling format such as YUV 4:2:0, a computing device performs wavelet decomposition (or other band separation filtering) on sample values of chroma components of the higher-resolution frame, producing sample values of multiple bands. The device assigns the sample values of the bands to parts of the lower-resolution frames. During corresponding unpacking operations, a computing device assigns parts of the frames of the lower-resolution chroma sampling format to sample values of multiple bands. The device performs wavelet reconstruction (or other inverse band separation filtering) on the sample values of the bands, producing sample values of chroma components of the frame of the higher-resolution chroma sampling format. Band separation filtering can help improve quality of reconstruction when distortion has been introduced during encoding of the chroma components packed into low-resolution frames.

Abstract translation: 当将诸如YUV 4：4：4的较高分辨率色度采样格式的视频帧打包成诸如YUV 4：2：0的较低分辨率色度采样格式的帧时，计算设备执行小波分解（或其他频带 分离滤波）对较高分辨率帧的色度分量的样本值，产生多个频带的样本值。 设备将频带的采样值分配给较低分辨率帧的部分。 在相应的打包操作期间，计算设备将较低分辨率色度采样格式的帧的一部分分配给多个频带的采样值。 该装置对频带的采样值执行小波重建（或其他反频带分离滤波），产生较高分辨率色度采样格式的帧的色度分量的采样值。 当在包含在低分辨率帧中的色度分量的编码期间已经引入失真时，带分离滤波可以帮助提高重构质量。

公开(公告)号：WO2013151873A1

公开(公告)日：2013-10-10

申请号：PCT/US2013/034512

申请日：2013-03-29

Applicant: MICROSOFT CORPORATION

Inventor： WU, Yongjun ,  WOZNIAK, Matthew ,  BAKER, Simon ,  NEGRILA, Catalin Alexandru ,  LANKA, Venkata S. K. Kamal ,  CHIN, Kevin ,  KOHLWEY, Brian

IPC: G06T5/50

CPC classification number: G06T5/10 ,  G06T3/0093 ,  G06T5/006 ,  G06T5/50 ,  G06T7/20 ,  G06T2207/10016 ,  G06T2207/20016 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/2329

Abstract: In one embodiment, a video processing system 300 may filter a video data set to correct skew and wobble using a central processing unit 220 and a graphical processing unit 230. The video processing system 300 may apply a rolling shutter effect correction filter to an initial version of a video data set. The video processing system 300 may simultaneously apply a video stabilization filter to the initial version to produce a final version video data set.

Abstract translation: 在一个实施例中，视频处理系统300可以使用中央处理单元220和图形处理单元230来过滤视频数据集以校正偏斜和摆动。视频处理系统300可以将滚动快门效应校正滤波器应用于初始版本 的视频数据集。 视频处理系统300可以同时将视频稳定滤波器应用于初始版本以产生最终版本的视频数据集。

公开(公告)号：WO2011100174A2

公开(公告)日：2011-08-18

申请号：PCT/US2011/023839

申请日：2011-02-05

Applicant: MICROSOFT CORPORATION

Inventor： WU, Yongjun ,  BORISOV, Nikola ,  ZHAO, Weidong ,  SADHWANI, Shyam ,  THUMPUDI, Naveen

IPC: H04N5/235

CPC classification number: H04N5/23267 ,  G06T3/0093 ,  G06T7/207 ,  H04L67/10 ,  H04N5/145 ,  H04N5/23248 ,  H04N5/23254 ,  H04N21/4223 ,  H04N21/44

Abstract: Video image stabilization provides better performance on a generic platform for computing devices by evaluating available multimedia digital signal processing components, and selecting the available components to utilize according to a hierarchy structure for video stabilization performance for processing parts of the video stabilization. The video stabilization has improved motion vector estimation that employs refinement motion vector searching according to a pyramid block structure relationship starting from a downsampled resolution version of the video frames. The video stabilization also improves global motion transform estimation by performing a random sample consensus approach for processing the local motion vectors, and selection criteria for motion vector reliability. The video stabilization achieves the removal of hand shakiness smoothly by real-time one-pass or off-line two-pass temporal smoothing with error detection and correction.

Abstract translation: 视频图像稳定通过评估可用的多媒体数字信号处理部件并选择可用部件以根据用于视频稳定性能的层级结构来利用以用于处理部分 视频稳定。 视频稳定化已经改进了运动矢量估计，该运动矢量估计使用根据从视频帧的下采样分辨率版本开始的金字塔块结构关系进行精化运动矢量搜索。 视频稳定化还通过执行用于处理局部运动矢量的随机采样共识方法以及用于运动矢量可靠性的选择标准来改进全局运动变换估计。 视频稳定通过实时一次通过或离线两通时间平滑以及错误检测和纠正，可以平滑地消除手抖动。