公开(公告)号：US20170034530A1

公开(公告)日：2017-02-02

申请号：US14811721

申请日：2015-07-28

Applicant: Microsoft Technology Licensing, LLC

Inventor： Victor Cherepanov ,  Yongjun Wu ,  Srinath Reddy ,  Yuechuan Li ,  Shyam Sadhwani ,  Chihlung Lin ,  Binlong Li

IPC: H04N19/61 ,  H04N19/593 ,  H04N19/139 ,  H04N19/124 ,  H04N19/107 ,  H04N19/18 ,  H04N19/122 ,  H04N19/176 ,  H04N19/119 ,  H04N19/52 ,  H04N19/91 ,  H04N19/70 ,  H04N19/44

CPC classification number: H04N19/61 ,  H04N19/107 ,  H04N19/119 ,  H04N19/122 ,  H04N19/124 ,  H04N19/132 ,  H04N19/139 ,  H04N19/176 ,  H04N19/18 ,  H04N19/42 ,  H04N19/44 ,  H04N19/46 ,  H04N19/52 ,  H04N19/593 ,  H04N19/70 ,  H04N19/91

Abstract: Innovations are provided for encoding and/or decoding video and/or image content using reduced size inverse transforms. For example, a reduced size inverse transform can be performed during encoding or decoding of video or image content using a subset of coefficients (e.g., primarily non-zero coefficients) of a given block. For example, a bounding area can be determined for a block that encompasses the non-zero coefficients of the block. Meta-data for the block can then be generated, including a shortcut code that indicates whether a reduced size inverse transform will be performed. The inverse transform can then be performed using a subset of coefficients for the block (e.g., identified by the bounding area) and the meta-data, which results in decreased utilization of computing resources. The subset of coefficients and the meta-data can be transferred to a graphics processing unit (GPU), which also results in savings in terms of data transfer.

Abstract translation: 提供了使用缩小尺寸逆变换对视频和/或图像内容进行编码和/或解码的创新。 例如，可以在使用给定块的系数（例如，主要是非零系数）的子集的视频或图像内容的编码或解码期间执行缩小尺寸的逆变换。 例如，可以为包含块的非零系数的块确定边界区域。 然后可以生成块的元数据，包括指示是否执行缩小尺寸逆变换的快捷代码。 然后可以使用块的系数子集（例如，由边界区域识别）和元数据来执行逆变换，这导致计算资源的利用率降低。 系数和元数据的子集可以传送到图形处理单元（GPU），这也导致数据传输方面的节省。

公开(公告)号：US20160360206A1

公开(公告)日：2016-12-08

申请号：US14731306

申请日：2015-06-04

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Weidong Zhao ,  Shyam Sadhwani

IPC: H04N19/146 ,  H04N19/142 ,  H04N19/895 ,  H04N19/593 ,  H04N19/87 ,  H04N19/115 ,  H04N19/179

CPC classification number: H04N19/146 ,  H04N19/107 ,  H04N19/115 ,  H04N19/127 ,  H04N19/142 ,  H04N19/149 ,  H04N19/179 ,  H04N19/87

Abstract: In response to a scene change being detected in screen content, a rate controller instructs a video encoder to generate an intraframe compressed image. The rate controller computes a target size for compressed image data using a function based on a maximum compressed size for a single image, i.e., without buffers for additional image data. For a number of images processed after detection of the scene change, this target size is computed and used to control the video encoder. After this number of images is processed, the rate controller can resume to a prior mode of operation. Such rate control reduces latency in encoding and transmission of screen content, which improves user perception of responsiveness of a host computer, such as for interactive video applications.

Abstract translation: 响应于在屏幕内容中检测到场景变化，速率控制器指示视频编码器生成帧内压缩图像。 速率控制器使用基于单个图像的最大压缩大小的功能（即，没有用于附加图像数据的缓冲器）来计算压缩图像数据的目标大小。 对于在检测到场景变化之后处理的多个图像，计算该目标大小并用于控制视频编码器。 在处理此数量的图像之后，速率控制器可以恢复到先前的操作模式。 这种速率控制减少了屏幕内容的编码和传输中的延迟，这提高了用户对主机的响应性的感知，诸如用于交互式视频应用。

公开(公告)号：US20160308931A1

公开(公告)日：2016-10-20

申请号：US14690058

申请日：2015-04-17

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Shyam Sadhwani ,  Wenbo Zhang ,  Sudhakar V. Prabhu

IPC: H04L29/06 ,  H04L29/08

CPC classification number: H04L65/608 ,  H04L65/607 ,  H04L67/02 ,  H04N21/4341 ,  H04N21/44016 ,  H04N21/8456

Abstract: Techniques are described for split processing of streaming segments in which processing operations are split between a source component and a decoder component. For example, the source component can perform operations for receiving a streaming segment, demultiplexing the streaming segment to separate a video content bit stream, scanning the video content bit stream to find a location at which decoding can begin (e.g., scanning up to a first decodable I-picture, for which header parameter sets are available for decoding), and send the video content bit stream to the decoder component beginning at the location (e.g., the first decodable I-picture). The decoder component can begin decoding at the identified location (e.g., the first decodable I-picture). The decoder component can also discard subsequent pictures that reference a reference picture not present in the video content bit stream (e.g., when decoding starts with a new streaming segment).

Abstract translation: 描述了用于流分段的分割处理的技术，其中处理操作在源组件和解码器组件之间分离。 例如，源组件可以执行用于接收流分段的操作，解复用流分段以分离视频内容比特流，扫描视频内容比特流以找到解码可以开始的位置（例如，扫描到第一 可解码的I图像，其中标题参数集可用于解码），并且将视频内容比特流发送到从该位置开始的解码器组件（例如，第一可解码I图像）。 解码器组件可以在所识别的位置（例如，第一可解码I图像）开始解码。 解码器组件还可以丢弃引用视频内容比特流中不存在的参考图像的后续图像（例如，当以新的流分段开始解码时）。

公开(公告)号：US20160293212A1

公开(公告)日：2016-10-06

申请号：US14675371

申请日：2015-03-31

Applicant: Microsoft Technology Licensing, LLC

Inventor： Li Li ,  Cheng-mean Liu ,  Sumit Malhotra ,  Xin Xin ,  Kristin Carr ,  Yongjun Wu ,  Bryan Tsai

IPC: G11B27/031 ,  G11B27/10

CPC classification number: G11B27/031

Abstract: A facility for completing a set of operations is described. Under the control of an application, the facility registers the background task to perform the set of operations. In response to the registration of the background task, the facility repeatedly invokes the background task to perform the set of operations.

Abstract translation: 描述完成一组操作的设施。 在应用程序的控制下，设备注册后台任务来执行一组操作。 响应于后台任务的注册，设备反复调用后台任务来执行该组操作。

公开(公告)号：US20160212433A1

公开(公告)日：2016-07-21

申请号：US14599416

申请日：2015-01-16

Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC

Inventor： Lihua Zhu ,  Shir Aharon ,  Yongjun Wu ,  B. Anil Kumar ,  Jeroen E. van Eesteren ,  Costin Hagiu ,  Shyam Sadhwani

IPC: H04N19/186 ,  H04N19/51 ,  H04N19/167 ,  H04N19/136

CPC classification number: H04N19/186 ,  H04N19/132 ,  H04N19/136 ,  H04N19/167 ,  H04N19/182 ,  H04N19/30 ,  H04N19/51

Abstract: Innovations in encoding and decoding of video pictures in a high-resolution chroma sampling format (such as YUV 4:4:4) using a video encoder and decoder operating on coded pictures in a low-resolution chroma sampling format (such as YUV 4:2:0) are presented. For example, high chroma resolution details are selectively encoded on a region-by-region basis. Or, as another example, coded pictures that contain sample values for low chroma resolution versions of input pictures and coded pictures that contain sample values for high chroma resolution details of the input pictures are encoded as separate sub-sequences of a single sequence of coded pictures, which can facilitate effective motion compensation. In this way, available encoders and decoders operating on coded pictures in the low-resolution chroma sampling format can be effectively used to provide high chroma resolution details.

Abstract translation: 使用以低分辨率色度采样格式（例如YUV 4：4：4）对编码图像进行操作的视频编码器和解码器以高分辨率色度采样格式（例如YUV 4：4：4）对视频图像进行编码和解码的创新， 2：0）。 例如，高色度分辨率细节在逐个区域的基础上被有选择地编码。 或者，作为另一示例，包含输入图像的低色度分辨率版本的输入图像的编码图像和包含用于输入图像的高色度分辨率细节的采样值的编码图像的编码图像被编码为单个编码图像序列的单独子序列 ，可以促进有效的运动补偿。 以这种方式，可以有效地使用以低分辨率色度采样格式对编码图像进行操作的可用编码器和解码器来提供高色度分辨率细节。

公开(公告)号：US20160117796A1

公开(公告)日：2016-04-28

申请号：US14923406

申请日：2015-10-26

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Radhika Jandhyala ,  Shyam Sadhwani ,  Li Li

IPC: G06T1/20 ,  G09G5/39

CPC classification number: G09G5/39 ,  G09G2340/02 ,  H04L21/00 ,  H04L69/04 ,  H04N19/12 ,  H04N19/132 ,  H04N19/159 ,  H04N19/162 ,  H04N19/169 ,  H04N19/172 ,  H04N19/44 ,  H04N19/61 ,  H04N21/00 ,  H04N21/44 ,  H04N21/44008 ,  H04N21/442

Abstract: In one example, a quality management controller of a video processing system may optimize a video recovery action through the selective dropping of video frames. The video processing system may store a compressed video data set in memory. The video processing system may receive a recovery quality indication describing a recovery priority of a user. The video processing system may apply a quality management controller in a video pipeline to execute a video recovery action to retrieve an output data set from the compressed video data set using a video decoder. The quality management controller may select a recovery initiation frame from the compressed video data set to be an initial frame to decompress based upon the recovery quality indication.

Abstract translation: 在一个示例中，视频处理系统的质量管理控制器可以通过选择性地丢弃视频帧来优化视频恢复动作。 视频处理系统可以将压缩视频数据集存储在存储器中。 视频处理系统可以接收描述用户恢复优先级的恢复质量指示。 视频处理系统可以在视频流水线中应用质量管理控制器来执行视频恢复动作，以使用视频解码器从压缩视频数据集中检索输出数据集。 质量管理控制器可以基于恢复质量指示从压缩视频数据集中选择恢复发起帧作为初始帧，以解压缩。

公开(公告)号：US20160104457A1

公开(公告)日：2016-04-14

申请号：US14661643

申请日：2015-03-18

Applicant: Microsoft Technology Licensing, LLC

Inventor： Yongjun Wu ,  Shyam Sadhwani

IPC: G09G5/39 ,  G06T1/20 ,  G06T15/00

CPC classification number: G09G5/39 ,  G06F9/5011 ,  G06F9/5044 ,  G06F9/5055 ,  G06T1/20 ,  G06T15/005 ,  G09G2360/18 ,  H04N21/43615 ,  H04N21/44004 ,  H04N21/4402 ,  H04N21/440218 ,  H04N21/4516

Abstract: Buffer optimization techniques are described herein in which a graphics processing system is configured to implement and select between a plurality of buffer schemes for processing of an encoded data stream in dependence upon formats used for decoding and rendering (e.g., video format, bit depth, resolution, content type, etc.) and device capabilities such as available memory and/or processing power. Processing of an encoded data stream for display and rendering via the graphics processing system then occurs using a selected one of the buffer schemes to define buffers employed for the decoding and rendering, including at least configuring the sizes of buffers. The plurality of schemes may include at least one buffer scheme for processing the encoded content when the input format and the output format are the same, and a different buffer scheme for processing the encoded content when the input format and the output format are different.

Abstract translation: 本文描述了缓冲器优化技术，其中图形处理系统被配置为根据用于解码和渲染的格式（例如，视频格式，比特深度，分辨率）来在多个缓冲器方案之间实现和选择用于处理编码数据流 ，内容类型等）和设备能力，例如可用的存储器和/或处理能力。 然后通过图形处理系统处理用于显示和呈现的编码数据流，然后使用所选择的一个缓冲器方案来定义用于解码和呈现的缓冲器，包括至少配置缓冲器的大小。 当输入格式和输出格式相同时，多个方案可以包括用于处理编码内容的至少一个缓冲方案，以及用于当输入格式和输出格式不同时用于处理编码内容的不同缓冲方案。

公开(公告)号：US20150237381A1

公开(公告)日：2015-08-20

申请号：US14700503

申请日：2015-04-30

Applicant: Microsoft Technology Licensing, LLC

Inventor： Wenfeng Gao ,  Yongjun Wu ,  Shyam Sadhwani

IPC: H04N19/86 ,  H04N19/82 ,  H04N19/159 ,  H04N19/172 ,  H04N19/117 ,  H04N19/436 ,  H04N19/157

CPC classification number: H04N19/865 ,  H04N19/117 ,  H04N19/127 ,  H04N19/157 ,  H04N19/159 ,  H04N19/16 ,  H04N19/172 ,  H04N19/436 ,  H04N19/82 ,  H04N19/86

Abstract: Multi-threaded implementations of deblock filtering improve encoding and/or decoding efficiency. For example, a video encoder or decoder partitions a video picture into multiple segments. The encoder/decoder selects between multiple different patterns for splitting operations of deblock filtering into multiple passes. The encoder/decoder organizes the deblock filtering as multiple tasks, where a given task includes the operations of one of the passes for one of the segments. The encoder/decoder then performs the tasks with multiple threads. The performance of the tasks is constrained by task dependencies which, in general, are based at least in part on which lines of the picture are in the respective segments and which deblock filtering operations are in the respective passes. The task dependencies can include a cross-pass, cross-segment dependency between a given pass of a given segment and an adjacent pass of an adjacent segment.

Abstract translation: 去块滤波的多线程实现提高了编码和/或解码效率。 例如，视频编码器或解码器将视频图像分割成多个段。 编码器/解码器在多个不同的模式之间进行选择，用于将去块滤波的分割操作分成多个通道。 编码器/解码器将去块滤波器组织为多个任务，其中给定任务包括其中一个段的一个通路的操作。 然后，编码器/解码器使用多个线程执行任务。 任务的执行受到任务依赖性的约束，通常，至少部分地基于图片的哪些行在相应的段中，以及哪些去块过滤操作在相应的遍历中。 任务依赖性可以包括给定段的给定遍和相邻段的相邻段之间的交叉遍，跨段依赖性。