公开(公告)号：US20140307771A1

公开(公告)日：2014-10-16

申请号：US13922948

申请日：2013-06-20

Applicant: Microsoft Corporation

Inventor： Magnus Hemmendorff ,  David Zhao ,  Sergey Sablin ,  Pontus Carlsson ,  Konrad Hofbauer ,  Sergei Nikiforov

IPC: H04N19/156 ,  H04N19/136 ,  H04N19/172 ,  H04N19/103

CPC classification number: H04N19/176 ,  H04N19/103 ,  H04N19/156 ,  H04N19/17 ,  H04N19/172 ,  H04N19/46 ,  H04N19/895

Abstract: An apparatus for encoding video data, the apparatus comprising a compliance module configured to compare a resource requirement associated with encoding video data to form at least part of an encoded frame using a standard encoding mode with an acceptable resource level and an encoder configured to, responsive to a determination that the resource requirement will exceed the acceptable resource level, form the at least part of an encoded frame by encoding some of the video data using the standard encoding mode and filling a remainder of the at least part of the encoded frame with data that is associated with a lower resource usage than data generated using the standard encoding mode.

Abstract translation: 一种用于对视频数据进行编码的装置，所述装置包括：依从模块，被配置为比较与编码视频数据相关联的资源需求，以便使用具有可接受的资源级别的标准编码模式来形成编码帧的至少一部分;以及编码器， 确定所述资源需求将超过所述可接受资源水平，通过使用所述标准编码模式对所述视频数据进行编码来形成所述编码帧的所述至少部分，并且用所述数据填充所述编码帧的至少部分的剩余部分 这与使用标准编码模式生成的数据相比具有较低的资源使用。

公开(公告)号：US20140211860A1

公开(公告)日：2014-07-31

申请号：US13803738

申请日：2013-03-14

Applicant: MICROSOFT CORPORATION

Inventor： David Zhao ,  Sergey Nikiforov ,  Konrad Hofbauer ,  Magnus Hemmendorff ,  Pontus Carlsson

IPC: H04N19/89

CPC classification number: H04N19/895 ,  H04N19/127 ,  H04N19/154 ,  H04N19/167 ,  H04N19/172 ,  H04N19/46 ,  H04N19/503

Abstract: A receiving apparatus comprises a receiver for receiving a video signal, an output for outputting the video signal to a screen, storage device or further terminal; and a concealment module for applying a concealment algorithm to a lost area of the video signal. The concealment module is configured to determine an estimate of concealment quality selectively directed toward a region of interest within the area in question, and based on this estimate to determine whether or not to apply the concealment algorithm.

Abstract translation: 一种接收装置，包括用于接收视频信号的接收机，用于将视频信号输出到屏幕，存储装置或其他终端的输出; 以及用于将隐藏算法应用于视频信号的丢失区域的隐藏模块。 隐藏模块被配置为基于该估计来确定选择性地针对所讨论的区域内的感兴趣区域的隐藏质量的估计，以确定是否应用隐藏算法。

公开(公告)号：US20150016510A1

公开(公告)日：2015-01-15

申请号：US14038580

申请日：2013-09-26

Applicant: Microsoft Corporation

Inventor： Pontus Carlsson ,  Magnus Hemmendorff ,  Konrad Hofbauer ,  Sergei Nikiforov ,  David Zhao

IPC: H04N19/126 ,  H04N19/167 ,  H04N19/146 ,  H04N19/17

CPC classification number: H04N19/17 ,  H04N19/126 ,  H04N19/146 ,  H04N19/15 ,  H04N19/167 ,  H04N19/192 ,  H04N19/198

Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.

Abstract translation: 一种编码器，包括编码模块和适配模块。 编码模块被配置为在至少一个感兴趣的区域中并且在感兴趣区域之外对视频进行编码。 编码包括量化，并且编码模块可操作以在兴趣区域内外的编码之间应用量化粒度的差异。 适配模块被配置为确定表示在感兴趣区域内外的量化的有益差异的至少一个度量，并且根据该度量来适应量化粒度的差异。

公开(公告)号：US20130329751A1

公开(公告)日：2013-12-12

申请号：US13678508

申请日：2012-11-15

Applicant: MICROSOFT CORPORATION

Inventor： David Zhao ,  Christoffer Asgaard Rodbro

IPC: H04L29/06

CPC classification number: H04L65/1066 ,  H04L47/25 ,  H04L65/4069 ,  H04L65/4092 ,  H04L65/604 ,  H04L65/608 ,  H04L65/80

Abstract: Receiver, computer program product and method for processing data of a real-time communication event. A processing module of the receiver implements a real-time communication application to receive a data stream of the real-time communication event. Data of the received data stream is output to a user in the real-time communication event. Interaction of the user with the real-time communication application during the real-time communication event is determined, and the data rate of the received data stream in the real-time communication event is controlled based on the determined interaction.

Abstract translation: 接收机，用于处理实时通信事件数据的计算机程序产品和方法。 接收机的处理模块实现实时通信应用，以接收实时通信事件的数据流。 接收到的数据流的数据在实时通信事件中输出给用户。 确定在实时通信事件期间用户与实时通信应用的交互，并且基于确定的交互来控制实时通信事件中接收的数据流的数据速率。

公开(公告)号：US09237289B2

公开(公告)日：2016-01-12

申请号：US13659573

申请日：2012-10-24

Applicant: Microsoft Corporation

Inventor： Pontus Carlsson ,  Andrei Jefremov ,  Sergey Silkin ,  David Zhao

IPC: H04N9/64 ,  H04N5/44 ,  H04N17/04 ,  H04N19/139 ,  H04N19/176 ,  H04N19/895 ,  H04N21/44 ,  H04N21/442

CPC classification number: H04N17/04 ,  H04N5/44 ,  H04N19/139 ,  H04N19/176 ,  H04N19/895 ,  H04N21/44008 ,  H04N21/44209

Abstract: Method, device and computer program product for estimating quality of a video signal, wherein frames of the video signal are received at receiving means of the device, each frame comprising a plurality of blocks of pixels. A section of a first frame of the video signal, which is correctly received, is used to provide a concealed block for use in place of a block of a second frame of the video signal. A difference measure is determined indicative of a difference between at least some of the pixels surrounding the block in the second frame and the corresponding pixels surrounding the section in the first frame. The difference measure is used to estimate the quality of the second frame of the video signal.

Abstract translation: 用于估计视频信号的质量的方法，设备和计算机程序产品，其中视频信号的帧在设备的接收装置处被接收，每个帧包括多个像素块。 被正确接收的视频信号的第一帧的一部分用于提供用于代替视频信号的第二帧的块的隐藏块。 确定指示在第二帧中的块周围的至少一些像素与围绕第一帧中的部分的对应像素之间的差异的差异度量。 差分测量用于估计视频信号的第二帧的质量。

公开(公告)号：US20140211858A1

公开(公告)日：2014-07-31

申请号：US13804038

申请日：2013-03-14

Applicant: MICROSOFT CORPORATION

Inventor： David Zhao ,  Sergey Nikiforov ,  Konrad Hofbauer ,  Magnus Hemmendorff ,  Pontus Carlsson

IPC: H04N19/85

CPC classification number: G06T3/0093 ,  G06T3/0006 ,  G06T3/0012 ,  G06T3/0056 ,  G06T3/4007 ,  H04N19/117 ,  H04N19/119 ,  H04N19/167 ,  H04N19/172 ,  H04N19/59 ,  H04N19/85

Abstract: A video signal comprises a sequence of source frames to be encoded. A pre-processing stage determines a region of interest for a plurality of the source frames, and spatially adapts each of the plurality of the source frames to produce a respective warped frame. In the respective warped frame, the region of interest comprises a higher spatial proportion of the warped frame than in the source frame. The pre-processing stage supplies the warped frames to an encoder to be encoded into an encoded version of the video signal.

Abstract translation: 视频信号包括要编码的源帧序列。 预处理阶段确定多个源帧的感兴趣区域，并且空间地适配多个源帧中的每一个以产生相应的翘曲帧。 在相应的翘曲框架中，感兴趣的区域包括翘曲框架的空间比例高于源框架。 预处理阶段将翘曲的帧提供给编码器以被编码为视频信号的编码版本。

公开(公告)号：US20140211842A1

公开(公告)日：2014-07-31

申请号：US13838283

申请日：2013-03-15

Applicant: MICROSOFT CORPORATION

Inventor： David Zhao ,  Sergey Nikiforov ,  Konrad Hofbauer ,  Magnus Hemmendorff ,  Pontus Carlsson

IPC: H04N7/26

CPC classification number: H04N19/147 ,  H04N19/103 ,  H04N19/12 ,  H04N19/167 ,  H04N19/17 ,  H04N19/19

Abstract: An input receives a video signal comprising a plurality of frames, each comprising a plurality of image portions. Each of the image portions is encoded by an encoder, to generate an encoded signal. An adaptation module selects a respective encoding mode used to encode each of the image portions. The selection is based on a process that balances an estimate of distortion for the image portion if encoded using the respective encoding mode and a bitrate that would be incurred by encoding the image portion using the respective encoding mode. The adaptation module is also configured to determine, within each of one or more frames of the video signal, at least two different regions having different perceptual significance, and to adapt the above-mentioned process in dependence on which of the regions the image portion being encoded is in.

Abstract translation: 输入接收包括多个帧的视频信号，每个帧包括多个图像部分。 每个图像部分由编码器编码，以产生编码信号。 适配模块选择用于编码每个图像部分的相应编码模式。 该选择基于如下处理：如果使用相应的编码模式进行编码，则平衡图像部分的失真估计，以及使用相应编码模式对图像部分进行编码将产生的比特率。 适配模块还被配置为在视频信号的一个或多个帧的每一个内确定具有不同感知意义的至少两个不同区域，并且根据图像部分是哪个区域来适应上述处理 编码在。

公开(公告)号：US20130114002A1

公开(公告)日：2013-05-09

申请号：US13659573

申请日：2012-10-24

Applicant: Microsoft Corporation

Inventor： Pontus Carlsson ,  Andrei Jefremov ,  Sergey Silkin ,  David Zhao

IPC: H04N5/44

CPC classification number: H04N17/04 ,  H04N5/44 ,  H04N19/139 ,  H04N19/176 ,  H04N19/895 ,  H04N21/44008 ,  H04N21/44209

Abstract: Method, device and computer program product for estimating quality of a video signal, wherein frames of the video signal are received at receiving means of the device, each frame comprising a plurality of blocks of pixels. A section of a first frame of the video signal, which is correctly received, is used to provide a concealed block for use in place of a block of a second frame of the video signal. A difference measure is determined indicative of a difference between at least some of the pixels surrounding the block in the second frame and the corresponding pixels surrounding the section in the first frame. The difference measure is used to estimate the quality of the second frame of the video signal.

Abstract translation: 用于估计视频信号的质量的方法，设备和计算机程序产品，其中视频信号的帧在设备的接收装置处被接收，每个帧包括多个像素块。 被正确接收的视频信号的第一帧的一部分用于提供用于代替视频信号的第二帧的块的隐藏块。 确定指示在第二帧中的块周围的至少一些像素与围绕第一帧中的部分的对应像素之间的差异的差异度量。 差分测量用于估计视频信号的第二帧的质量。

公开(公告)号：US09167255B2

公开(公告)日：2015-10-20

申请号：US14038580

申请日：2013-09-26

Applicant: Microsoft Corporation

Inventor： Pontus Carlsson ,  Magnus Hemmendorff ,  Konrad Hofbauer ,  Sergei Nikiforov ,  David Zhao

IPC: G06K9/36 ,  G06K9/46 ,  H04N19/146 ,  H04N19/15 ,  H04N19/126 ,  H04N19/17 ,  H04N19/192 ,  H04N19/196 ,  H04N19/167

CPC classification number: H04N19/17 ,  H04N19/126 ,  H04N19/146 ,  H04N19/15 ,  H04N19/167 ,  H04N19/192 ,  H04N19/198

Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.

Abstract translation: 一种编码器，包括编码模块和适配模块。 编码模块被配置为在至少一个感兴趣的区域中并且在感兴趣区域之外对视频进行编码。 编码包括量化，并且编码模块可操作以在兴趣区域内外的编码之间应用量化粒度的差异。 适配模块被配置为确定表示在感兴趣区域内外的量化的有益差异的至少一个度量，并且根据该度量来适应量化粒度的差异。