公开(公告)号：US10477249B2

公开(公告)日：2019-11-12

申请号：US12479068

申请日：2009-06-05

申请人： Yuxin Liu ,  Hsi-Jung Wu ,  Xiaojin Shi ,  Chris Yoochang Chung

发明人： Yuxin Liu ,  Hsi-Jung Wu ,  Xiaojin Shi ,  Chris Yoochang Chung

IPC分类号： H04N7/12 ,  H04N11/04 ,  H04N19/86 ,  H04N19/46 ,  H04N19/117 ,  H04N19/136 ,  H04N19/44

摘要： A video decoder system includes a video decoding engine, noise database, artifact estimator and post-processing unit. The video coder may generate recovered video from a data stream of coded video data, which may have visually-perceptible artifacts introduced as a byproduct of compression. The noise database may store a plurality of previously developed noise patches. The artifact estimator may estimate the location of coding artifacts present in the recovered video and select noise patches from the database to mask the artifacts and the post-processing unit may integrate the selected noise patches into the recovered video. In this manner, the video decoder may generate post-processed noise which may mask artifacts that otherwise would be generated by a video coding process.

公开(公告)号：US08599238B2

公开(公告)日：2013-12-03

申请号：US12581043

申请日：2009-10-16

申请人： Hsi-Jung Wu ,  Chris Yoochang Chung ,  Xiaojin Shi ,  James Normile

发明人： Hsi-Jung Wu ,  Chris Yoochang Chung ,  Xiaojin Shi ,  James Normile

IPC分类号： H04N7/14

CPC分类号： G06K9/00228 ,  G06T3/00 ,  G06T5/006 ,  G06T2207/20104 ,  G06T2207/30201 ,  H04N5/217 ,  H04N5/23219 ,  H04N5/23258 ,  H04N5/23267

摘要： Methods, systems, and apparatus are presented for reducing distortion in an image, such as a video image. A video image can be captured by an image capture device, e.g. during a video conferencing session. Distortion correction processing, such as the application of one or more warping techniques, can be applied to the captured image to produce a distortion corrected image, which can be transmitted to one or more participants. The warping techniques can be performed in accordance with one or more warp parameters specifying a transformation of the captured image. Further, the warp parameters can be generated in accordance with an orientation of the image capture device, which can be determined based on sensor data or can be a fixed value. Additionally or alternatively, the warp parameters can be determined in accordance with a reference image or model to which the captured image should be warped.

摘要翻译： 呈现了用于减少诸如视频图像的图像中的失真的方法，系统和装置。 视频图像可以由图像捕获设备捕获，例如， 在视频会议期间。 畸变校正处理，例如应用一个或多个翘曲技术，可以应用于所捕获的图像，以产生可以发送到一个或多个参与者的失真校正图像。 翘曲技术可以根据指定捕获图像的变换的一个或多个翘曲参数来执行。 此外，可以根据可以基于传感器数据确定的图像捕获装置的取向来生成翘曲参数，或者可以是固定值。 附加地或替代地，可以根据捕获的图像应该翘曲的参考图像或模型来确定翘曲参数。

公开(公告)号：US20110090303A1

公开(公告)日：2011-04-21

申请号：US12581043

申请日：2009-10-16

申请人： Hsi-Jung Wu ,  Chris Yoochang Chung ,  Xiaojin Shi ,  James Normile

发明人： Hsi-Jung Wu ,  Chris Yoochang Chung ,  Xiaojin Shi ,  James Normile

IPC分类号： H04N7/15 ,  H04N5/217

CPC分类号： G06K9/00228 ,  G06T3/00 ,  G06T5/006 ,  G06T2207/20104 ,  G06T2207/30201 ,  H04N5/217 ,  H04N5/23219 ,  H04N5/23258 ,  H04N5/23267

摘要： Methods, systems, and apparatus are presented for reducing distortion in an image, such as a video image. A video image can be captured by an image capture device, e.g. during a video conferencing session. Distortion correction processing, such as the application of one or more warping techniques, can be applied to the captured image to produce a distortion corrected image, which can be transmitted to one or more participants. The warping techniques can be performed in accordance with one or more warp parameters specifying a transformation of the captured image. Further, the warp parameters can be generated in accordance with an orientation of the image capture device, which can be determined based on sensor data or can be a fixed value. Additionally or alternatively, the warp parameters can be determined in accordance with a reference image or model to which the captured image should be warped.

摘要翻译： 呈现了用于减少诸如视频图像的图像中的失真的方法，系统和装置。 视频图像可以由图像捕获设备捕获，例如， 在视频会议期间。 畸变校正处理，例如应用一个或多个翘曲技术，可以应用于所捕获的图像，以产生可以发送到一个或多个参与者的失真校正图像。 翘曲技术可以根据指定捕获图像的变换的一个或多个翘曲参数来执行。 此外，可以根据可以基于传感器数据确定的图像捕获装置的取向来生成翘曲参数，或者可以是固定值。 附加地或替代地，可以根据捕获的图像应该翘曲的参考图像或模型来确定翘曲参数。

公开(公告)号：US08558903B2

公开(公告)日：2013-10-15

申请号：US12755620

申请日：2010-04-07

申请人： Yuxin Liu ,  Xiaojin Shi ,  James Oliver Normile ,  Hsi-Jung Wu

发明人： Yuxin Liu ,  Xiaojin Shi ,  James Oliver Normile ,  Hsi-Jung Wu

IPC分类号： H04N5/228

CPC分类号： H04N5/23248 ,  H04N5/23254 ,  H04N5/23258 ,  H04N5/23267

摘要： Embodiments of the present invention provide a control system for video processes that selectively control the operation of motion stabilization processes. According to the present invention, motion sensor data indicative of motion of a mobile device may be received and processed. A determination may be made by comparing processed motion sensor data to a threshold. Based on the determination, motion stabilization may be suspended on select portions of a captured video sequence.

摘要翻译： 本发明的实施例提供了一种用于视频过程的控制系统，其选择性地控制运动稳定过程的操作。 根据本发明，可以接收并处理表示移动设备的运动的运动传感器数据。 可以通过将经处理的运动传感器数据与阈值进行比较来确定。 基于该确定，可以在拍摄的视频序列的选择部分上暂停运动稳定。

公开(公告)号：US08780986B2

公开(公告)日：2014-07-15

申请号：US12415478

申请日：2009-03-31

申请人： Hsi-Jung Wu ,  Xiaosong Zhou ,  Xiaojin Shi ,  Yuxin Liu

发明人： Hsi-Jung Wu ,  Xiaosong Zhou ,  Xiaojin Shi ,  Yuxin Liu

IPC分类号： H04N7/68 ,  H04N7/48 ,  H04N7/32 ,  H04N7/34 ,  H04N7/26 ,  H04N7/50 ,  H04N7/36

CPC分类号： H04N7/26031 ,  H04N7/5086 ,  H04N19/107 ,  H04N19/137 ,  H04N19/176 ,  H04N19/61

摘要： Apparatuses and methods for improving coding processes and coding parameters for coding video data are provided for. A coder may select coding parameters for video data according to a default coding policy. The default coding policy may include selection of prediction modes (e.g., intra-coding or inter-coding) for each pixel group in each frame. A video coder may select some pixel groups in a frame to be coded as refresh pixel groups as an exception to the default assignment policies. The selection of refresh pixel groups may be based on prediction relationships among multiple frames of source video data. The default coding of the refresh pixel groups is then modified to enhanced the coding of the refresh pixel groups. The refresh pixel groups may permit fewer intra (I) frames be sent and/or may improve the quality of the recovered video.

摘要翻译： 提供了用于改进用于编码视频数据的编码处理和编码参数的装置和方法。 编码器可以根据默认编码策略选择视频数据的编码参数。 默认编码策略可以包括对每个帧中的每个像素组的预测模式（例如，帧内编码或帧间编码）的选择。 视频编码器可以将要编码的帧中的一些像素组选择为刷新像素组，作为默认分配策略的例外。 刷新像素组的选择可以基于源视频数据的多个帧之间的预测关系。 然后修改刷新像素组的默认编码以增强刷新像素组的编码。 刷新像素组可以允许更少的帧内（I）帧被发送和/或可以提高恢复的视频的质量。

公开(公告)号：US08731064B2

公开(公告)日：2014-05-20

申请号：US11530810

申请日：2006-09-11

申请人： Hsi-Jung Wu ,  Ionut Hristodorescu ,  Christian L. Duvivier ,  James Normile ,  Jochen Christian Schmidt ,  Chris Yoochang Chung

发明人： Hsi-Jung Wu ,  Ionut Hristodorescu ,  Christian L. Duvivier ,  James Normile ,  Jochen Christian Schmidt ,  Chris Yoochang Chung

IPC分类号： H04N7/12 ,  H04N7/50 ,  H04N7/26

CPC分类号： H04N7/26946 ,  H04N19/117 ,  H04N19/156 ,  H04N19/176 ,  H04N19/196 ,  H04N19/423 ,  H04N19/44 ,  H04N19/46 ,  H04N19/61 ,  H04N19/70 ,  H04N19/86

摘要： Systems, apparatuses and methods whereby a base coded video signal is provided to a decoder having a set of post-processing stages. The base coded video signal can be decoded to produce a base decoded video signal. Post-processing of the base decoded video signal can be used to produce an enhanced quality video output signal. Application of a post-processing stage can be implemented according to the capabilities of the decoder and/or the instantaneous operating parameters of the decoder and/or characteristics of a display. A control signal, communicated over a dedicated channel separate from the base coded video signal, can be used initiate and/or aid implementation of a post-processing stage. The control signal can also provide information to assist/manage the decoding of the base coded video signal. The use of additional post-processing stages increases the complexity of an overall decoding process while improving the quality of a resulting reproduced video sequence.

摘要翻译： 将基本编码视频信号提供给具有一组后处理级的解码器的系统，装置和方法。 基编码视频信号可被解码以产生基本解码视频信号。 可以使用基本解码视频信号的后处理来产生增强的质量视频输出信号。 后处理阶段的应用可以根据解码器的能力和/或解码器的瞬时操作参数和/或显示器的特性来实现。 可以使用通过与基本编码视频信号分开的专用信道传送的控制信号来启动和/或辅助后处理阶段的实现。 控制信号还可以提供信息来辅助/管理基本编码视频信号的解码。 使用额外的后处理级增加了整体解码过程的复杂性，同时提高了所得到的再现视频序列的质量。

公开(公告)号：US08340194B2

公开(公告)日：2012-12-25

申请号：US12479336

申请日：2009-06-05

申请人： Jochen Christian Schmidt ,  Paul Seung Ho Chang ,  Chris Yoochang Chung ,  Christian Luc Duvivier ,  Ionut Hristodorescu ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Xiaosong Zhou

发明人： Jochen Christian Schmidt ,  Paul Seung Ho Chang ,  Chris Yoochang Chung ,  Christian Luc Duvivier ,  Ionut Hristodorescu ,  Hsi-Jung Wu ,  Dazhong Zhang ,  Xiaosong Zhou

IPC分类号： H04N11/04

CPC分类号： H04N19/436 ,  H04N19/102 ,  H04N19/172 ,  H04N19/174 ,  H04N19/176 ,  H04N19/61

摘要： Disclosed is an exemplary video coder and video coding method according to an embodiment of the present invention. The exemplary video coder includes a scheduler, a plurality of processors and a multiplexer. The scheduler can examine processing units in an input buffer to determine an order for the processing unit to be coded by a processor. If the processing unit under examination depends on a processing unit not yet processed, the processing unit under examination can be merged with other processing units, if any, that share a similar dependency. If the processing unit under examination does not depend on any processing units not yet processed, it can be sent to a next available processor for coding. When a processing unit is sent to a processor, any merged processing units that depend on sent processing unit can also be sent to a next available processor.

摘要翻译： 公开了根据本发明的实施例的示例性视频编码器和视频编码方法。 示例性视频编码器包括调度器，多个处理器和多路复用器。 调度器可以检查输入缓冲器中的处理单元以确定处理单元由处理器编码的顺序。 如果正在检查的处理单元依赖于尚未处理的处理单元，则被检查的处理单元可以与具有相似依赖性的其他处理单元（如果有的话）合并。 如果被检查的处理单元不依赖于尚未处理的任何处理单元，则可将其发送到下一个可用的处理器进行编码。 当处理单元被发送到处理器时，依赖于发送的处理单元的任何合并的处理单元也可以被发送到下一个可用的处理器。

公开(公告)号：US08345774B2

公开(公告)日：2013-01-01

申请号：US12013094

申请日：2008-01-11

申请人： Hsi-Jung Wu ,  Barin Geoffry Haskell ,  Xiaojin Shi ,  James Oliver Normile

发明人： Hsi-Jung Wu ,  Barin Geoffry Haskell ,  Xiaojin Shi ,  James Oliver Normile

IPC分类号： H04N7/12

CPC分类号： H04N19/44 ,  H04N19/149 ,  H04N19/152

摘要： Disclosed is a system and method of controlling a video decoder, including a reviewing channel data representing coded video data generated by an encoder to identify parameters of a hypothetical reference decoder (HRD) used by the encoder during coding operations. A parameter representing an exit data rate requirement of a coded picture buffer (CPB) of the HRD is compared against exit rate performance of the video decoder. If the exit rate performance of the video coder matches the exit rate requirement of the HRD, the coded video data is decoded, otherwise, a certain decoding degradation scheme can be applied, including disabling decoder from decoding the coded video data.

摘要翻译： 公开了一种控制视频解码器的系统和方法，包括：代表由编码器产生的编码视频数据的查看频道数据，以识别由编码器在编码操作期间使用的假设参考解码器（HRD）的参数。 将表示HRD的编码图像缓冲器（CPB）的退出数据速率要求的参数与视频解码器的退出速率性能进行比较。 如果视频编码器的退出速率性能与HRD的退出率要求相匹配，则编码的视频数据被解码，否则可以应用某种解码劣化方案，包括禁止解码器解码编码的视频数据。

公开(公告)号：US08270498B2

公开(公告)日：2012-09-18

申请号：US12463859

申请日：2009-05-11

申请人： Gianluca Filippini ,  Hsi-Jung Wu ,  James Oliver Normile ,  Xiaojin Shi ,  Xiaosong Zhou ,  Ionut Hristodorescu

发明人： Gianluca Filippini ,  Hsi-Jung Wu ,  James Oliver Normile ,  Xiaojin Shi ,  Xiaosong Zhou ,  Ionut Hristodorescu

IPC分类号： H04N7/12 ,  G06K9/40

CPC分类号： H04N19/90 ,  H04N19/124 ,  H04N19/136 ,  H04N19/154 ,  H04N19/86

摘要： A method and device for dithering video from a decoder. The method and device provide: selecting a segment of video frames from the video; computing a noise map for the segment of the video, the noise map computed from differences among pixels selected from spatially-distributed sampling patterns in the segment; determining contours of quantization artifacts within the video frame based on the noise map and a histogram of pixel values in the video frame; computing a gradient measurement of pixel values along the contours; identifying regions along the contours of quantization artifacts to apply dithering based on the noise map and the gradient measurement; determining a dithering strength based on the noise map and the gradient measurement; and applying dithering noise to the identified regions at the determined dithering strength.

摘要翻译： 一种从解码器抖动视频的方法和装置。 该方法和设备提供：从视频中选择一段视频帧; 计算视频段的噪声映射，根据从片段中的空间分布采样模式中选择的像素之间的差异计算的噪声图; 基于噪声图和视频帧中的像素值的直方图确定视频帧内的量化伪像的轮廓; 计算沿着轮廓的像素值的梯度测量; 识别沿着量化伪影轮廓的区域，以基于噪声图和梯度测量应用抖动; 基于噪声图和梯度测量确定抖动强度; 并以确定的抖动强度对所识别的区域施加抖动噪声。

公开(公告)号：US20110234430A1

公开(公告)日：2011-09-29

申请号：US13156610

申请日：2011-06-09

申请人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

发明人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

IPC分类号： H03M7/34

CPC分类号： H04N19/154 ,  H04N19/156 ,  H04N19/164

摘要： Techniques for encoding data based at least in part upon an awareness of the decoding complexity of the encoded data and the ability of a target decoder to decode the encoded data are disclosed. In some embodiments, a set of data is encoded based at least in part upon a state of a target decoder to which the encoded set of data is to be provided. In some embodiments, a set of data is encoded based at least in part upon the states of multiple decoders to which the encoded set of data is to be provided.

摘要翻译： 公开了至少部分地基于编码数据的解码复杂度的意识和目标解码器解码编码数据的能力对数据进行编码的技术。 在一些实施例中，至少部分地基于要提供编码数据集合的目标解码器的状态对数据集进行编码。 在一些实施例中，一组数据至少部分地基于要提供编码数据集的多个解码器的状态进行编码。