公开(公告)号：US20140307771A1

公开(公告)日：2014-10-16

申请号：US13922948

申请日：2013-06-20

Applicant: Microsoft Corporation

Inventor： Magnus Hemmendorff ,  David Zhao ,  Sergey Sablin ,  Pontus Carlsson ,  Konrad Hofbauer ,  Sergei Nikiforov

IPC: H04N19/156 ,  H04N19/136 ,  H04N19/172 ,  H04N19/103

CPC classification number: H04N19/176 ,  H04N19/103 ,  H04N19/156 ,  H04N19/17 ,  H04N19/172 ,  H04N19/46 ,  H04N19/895

Abstract: An apparatus for encoding video data, the apparatus comprising a compliance module configured to compare a resource requirement associated with encoding video data to form at least part of an encoded frame using a standard encoding mode with an acceptable resource level and an encoder configured to, responsive to a determination that the resource requirement will exceed the acceptable resource level, form the at least part of an encoded frame by encoding some of the video data using the standard encoding mode and filling a remainder of the at least part of the encoded frame with data that is associated with a lower resource usage than data generated using the standard encoding mode.

Abstract translation: 一种用于对视频数据进行编码的装置，所述装置包括：依从模块，被配置为比较与编码视频数据相关联的资源需求，以便使用具有可接受的资源级别的标准编码模式来形成编码帧的至少一部分;以及编码器， 确定所述资源需求将超过所述可接受资源水平，通过使用所述标准编码模式对所述视频数据进行编码来形成所述编码帧的所述至少部分，并且用所述数据填充所述编码帧的至少部分的剩余部分 这与使用标准编码模式生成的数据相比具有较低的资源使用。

公开(公告)号：US20140211860A1

公开(公告)日：2014-07-31

申请号：US13803738

申请日：2013-03-14

Applicant: MICROSOFT CORPORATION

Inventor： David Zhao ,  Sergey Nikiforov ,  Konrad Hofbauer ,  Magnus Hemmendorff ,  Pontus Carlsson

IPC: H04N19/89

CPC classification number: H04N19/895 ,  H04N19/127 ,  H04N19/154 ,  H04N19/167 ,  H04N19/172 ,  H04N19/46 ,  H04N19/503

Abstract: A receiving apparatus comprises a receiver for receiving a video signal, an output for outputting the video signal to a screen, storage device or further terminal; and a concealment module for applying a concealment algorithm to a lost area of the video signal. The concealment module is configured to determine an estimate of concealment quality selectively directed toward a region of interest within the area in question, and based on this estimate to determine whether or not to apply the concealment algorithm.

Abstract translation: 一种接收装置，包括用于接收视频信号的接收机，用于将视频信号输出到屏幕，存储装置或其他终端的输出; 以及用于将隐藏算法应用于视频信号的丢失区域的隐藏模块。 隐藏模块被配置为基于该估计来确定选择性地针对所讨论的区域内的感兴趣区域的隐藏质量的估计，以确定是否应用隐藏算法。

公开(公告)号：US09167255B2

公开(公告)日：2015-10-20

申请号：US14038580

申请日：2013-09-26

Applicant: Microsoft Corporation

Inventor： Pontus Carlsson ,  Magnus Hemmendorff ,  Konrad Hofbauer ,  Sergei Nikiforov ,  David Zhao

IPC: G06K9/36 ,  G06K9/46 ,  H04N19/146 ,  H04N19/15 ,  H04N19/126 ,  H04N19/17 ,  H04N19/192 ,  H04N19/196 ,  H04N19/167

CPC classification number: H04N19/17 ,  H04N19/126 ,  H04N19/146 ,  H04N19/15 ,  H04N19/167 ,  H04N19/192 ,  H04N19/198

Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.

Abstract translation: 一种编码器，包括编码模块和适配模块。 编码模块被配置为在至少一个感兴趣的区域中并且在感兴趣区域之外对视频进行编码。 编码包括量化，并且编码模块可操作以在兴趣区域内外的编码之间应用量化粒度的差异。 适配模块被配置为确定表示在感兴趣区域内外的量化的有益差异的至少一个度量，并且根据该度量来适应量化粒度的差异。

公开(公告)号：US20150109406A1

公开(公告)日：2015-04-23

申请号：US14184228

申请日：2014-02-19

Applicant: Microsoft Corporation

Inventor： Pontus Carlsson ,  Magnus Hemmendorff ,  Konrad Hofbauer ,  Sergei Nikiforov ,  David Yuheng Zhao

IPC: H04N19/85 ,  H04N7/14 ,  H04N19/61

CPC classification number: H04N7/147 ,  H04N7/15 ,  H04N19/132 ,  H04N19/164 ,  H04N19/167 ,  H04N19/46 ,  H04N19/59 ,  H04N19/63 ,  H04N19/85

Abstract: A user terminal for participating in video calls comprises: an encoder having a frame size, being the size in pixels at which it encodes frames of video; and a pre-processing stage which supplies a sequence of frames to the encoder at that frame size, each frame comprising at least an image region representing a source video image at a respective moment in time. The pre-processing stage is configured to supply at least some of the frames to the encoder in a modified form, by resizing the source video image to produce the image region of each modified frame with a size smaller than the frame size of the encoder, and combining with a border region such that the modified frame matches the frame size of the encoder. The encoder encodes the frames at the frame size and transmits them to a receiving terminal as part of a live video call.

Abstract translation: 用于参与视频呼叫的用户终端包括：具有帧大小的编码器，其大小为其编码视频帧的像素尺寸; 以及预处理阶段，其以该帧大小向编码器提供一系列帧，每个帧至少包括表示相应时刻的源视频图像的图像区域。 预处理级被配置为通过调整源视频图像的大小以产生尺寸小于编码器的帧大小的每个修改的帧的图像区域，以修改的形式将至少一些帧提供给编码器， 并且与边界区域组合，使得修改的帧与编码器的帧大小匹配。 编码器以帧大小对帧进行编码，并将其作为实时视频呼叫的一部分发送到接收终端。

公开(公告)号：US20150016510A1

公开(公告)日：2015-01-15

申请号：US14038580

申请日：2013-09-26

Applicant: Microsoft Corporation

Inventor： Pontus Carlsson ,  Magnus Hemmendorff ,  Konrad Hofbauer ,  Sergei Nikiforov ,  David Zhao

IPC: H04N19/126 ,  H04N19/167 ,  H04N19/146 ,  H04N19/17

CPC classification number: H04N19/17 ,  H04N19/126 ,  H04N19/146 ,  H04N19/15 ,  H04N19/167 ,  H04N19/192 ,  H04N19/198

Abstract: An encoder comprising an encoding module and an adaptation module. The encoding module is configured to encode video in at least one region-of-interest and outside the region-of-interest. The encoding comprises quantization, and the encoding module is operable to apply a difference in quantization granularity between the encoding inside and outside the region-of-interest. The adaptation module is configured to determine at least one metric representative of a difference in benefit of the quantization inside and outside the region-of-interest, and to adapt the difference in quantization granularity in dependence on this metric.

Abstract translation: 一种编码器，包括编码模块和适配模块。 编码模块被配置为在至少一个感兴趣的区域中并且在感兴趣区域之外对视频进行编码。 编码包括量化，并且编码模块可操作以在兴趣区域内外的编码之间应用量化粒度的差异。 适配模块被配置为确定表示在感兴趣区域内外的量化的有益差异的至少一个度量，并且根据该度量来适应量化粒度的差异。

公开(公告)号：US20140211858A1

公开(公告)日：2014-07-31

申请号：US13804038

申请日：2013-03-14

Applicant: MICROSOFT CORPORATION

Inventor： David Zhao ,  Sergey Nikiforov ,  Konrad Hofbauer ,  Magnus Hemmendorff ,  Pontus Carlsson

IPC: H04N19/85

CPC classification number: G06T3/0093 ,  G06T3/0006 ,  G06T3/0012 ,  G06T3/0056 ,  G06T3/4007 ,  H04N19/117 ,  H04N19/119 ,  H04N19/167 ,  H04N19/172 ,  H04N19/59 ,  H04N19/85

Abstract: A video signal comprises a sequence of source frames to be encoded. A pre-processing stage determines a region of interest for a plurality of the source frames, and spatially adapts each of the plurality of the source frames to produce a respective warped frame. In the respective warped frame, the region of interest comprises a higher spatial proportion of the warped frame than in the source frame. The pre-processing stage supplies the warped frames to an encoder to be encoded into an encoded version of the video signal.

Abstract translation: 视频信号包括要编码的源帧序列。 预处理阶段确定多个源帧的感兴趣区域，并且空间地适配多个源帧中的每一个以产生相应的翘曲帧。 在相应的翘曲框架中，感兴趣的区域包括翘曲框架的空间比例高于源框架。 预处理阶段将翘曲的帧提供给编码器以被编码为视频信号的编码版本。

公开(公告)号：US20140211842A1

公开(公告)日：2014-07-31

申请号：US13838283

申请日：2013-03-15

Applicant: MICROSOFT CORPORATION

Inventor： David Zhao ,  Sergey Nikiforov ,  Konrad Hofbauer ,  Magnus Hemmendorff ,  Pontus Carlsson

IPC: H04N7/26

CPC classification number: H04N19/147 ,  H04N19/103 ,  H04N19/12 ,  H04N19/167 ,  H04N19/17 ,  H04N19/19

Abstract: An input receives a video signal comprising a plurality of frames, each comprising a plurality of image portions. Each of the image portions is encoded by an encoder, to generate an encoded signal. An adaptation module selects a respective encoding mode used to encode each of the image portions. The selection is based on a process that balances an estimate of distortion for the image portion if encoded using the respective encoding mode and a bitrate that would be incurred by encoding the image portion using the respective encoding mode. The adaptation module is also configured to determine, within each of one or more frames of the video signal, at least two different regions having different perceptual significance, and to adapt the above-mentioned process in dependence on which of the regions the image portion being encoded is in.

Abstract translation: 输入接收包括多个帧的视频信号，每个帧包括多个图像部分。 每个图像部分由编码器编码，以产生编码信号。 适配模块选择用于编码每个图像部分的相应编码模式。 该选择基于如下处理：如果使用相应的编码模式进行编码，则平衡图像部分的失真估计，以及使用相应编码模式对图像部分进行编码将产生的比特率。 适配模块还被配置为在视频信号的一个或多个帧的每一个内确定具有不同感知意义的至少两个不同区域，并且根据图像部分是哪个区域来适应上述处理 编码在。