公开(公告)号：US08270498B2

公开(公告)日：2012-09-18

申请号：US12463859

申请日：2009-05-11

申请人： Gianluca Filippini ,  Hsi-Jung Wu ,  James Oliver Normile ,  Xiaojin Shi ,  Xiaosong Zhou ,  Ionut Hristodorescu

发明人： Gianluca Filippini ,  Hsi-Jung Wu ,  James Oliver Normile ,  Xiaojin Shi ,  Xiaosong Zhou ,  Ionut Hristodorescu

IPC分类号： H04N7/12 ,  G06K9/40

CPC分类号： H04N19/90 ,  H04N19/124 ,  H04N19/136 ,  H04N19/154 ,  H04N19/86

摘要： A method and device for dithering video from a decoder. The method and device provide: selecting a segment of video frames from the video; computing a noise map for the segment of the video, the noise map computed from differences among pixels selected from spatially-distributed sampling patterns in the segment; determining contours of quantization artifacts within the video frame based on the noise map and a histogram of pixel values in the video frame; computing a gradient measurement of pixel values along the contours; identifying regions along the contours of quantization artifacts to apply dithering based on the noise map and the gradient measurement; determining a dithering strength based on the noise map and the gradient measurement; and applying dithering noise to the identified regions at the determined dithering strength.

摘要翻译： 一种从解码器抖动视频的方法和装置。 该方法和设备提供：从视频中选择一段视频帧; 计算视频段的噪声映射，根据从片段中的空间分布采样模式中选择的像素之间的差异计算的噪声图; 基于噪声图和视频帧中的像素值的直方图确定视频帧内的量化伪像的轮廓; 计算沿着轮廓的像素值的梯度测量; 识别沿着量化伪影轮廓的区域，以基于噪声图和梯度测量应用抖动; 基于噪声图和梯度测量确定抖动强度; 并以确定的抖动强度对所识别的区域施加抖动噪声。

公开(公告)号：US20110249729A1

公开(公告)日：2011-10-13

申请号：US12794580

申请日：2010-06-04

申请人： Xiaosong ZHOU ,  Dazhong Zhang ,  Davide Concion ,  Hsi-Jung Wu ,  Douglas Scott Price

发明人： Xiaosong ZHOU ,  Dazhong Zhang ,  Davide Concion ,  Hsi-Jung Wu ,  Douglas Scott Price

IPC分类号： H04N7/26

CPC分类号： H04N19/105 ,  H04N19/114 ,  H04N19/166 ,  H04N19/58 ,  H04N19/89

摘要： Embodiments of the present invention provide a video encoding system that codes video sequence into a multi-level hierarchy based on levels of long term reference (LTR) frames. According to the present invention, an encoder designates a reference frame as a long term reference (LTR) frame and transmits the LTR frame to a receiver. Upon receiving feedback from the receiver acknowledging receipt of the LTR frame, the encoder periodically codes subsequent frames as reference frames using the acknowledged LTR frame as a reference and designates subsequent reference frames as secondary LTR frames. A determined number of frames after each secondary LTR frame may be coded using a preceding secondary LTR frame as a reference.

摘要翻译： 本发明的实施例提供了一种视频编码系统，其基于长期参考（LTR）帧的级别将视频序列编码为多级层级。 根据本发明，编码器将参考帧指定为长期参考（LTR）帧，并将LTR帧发送到接收机。 在接收到来自确认接收到LTR帧的接收机的反馈时，编码器使用确认的LTR帧作为参考，将后续帧定时作为参考帧，并将后续参考帧指定为辅助LTR帧。 每个辅助LTR帧之后的确定数量的帧可以使用先前的次级LTR帧作为参考进行编码。

公开(公告)号：US20110234430A1

公开(公告)日：2011-09-29

申请号：US13156610

申请日：2011-06-09

申请人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

发明人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

IPC分类号： H03M7/34

CPC分类号： H04N19/154 ,  H04N19/156 ,  H04N19/164

摘要： Techniques for encoding data based at least in part upon an awareness of the decoding complexity of the encoded data and the ability of a target decoder to decode the encoded data are disclosed. In some embodiments, a set of data is encoded based at least in part upon a state of a target decoder to which the encoded set of data is to be provided. In some embodiments, a set of data is encoded based at least in part upon the states of multiple decoders to which the encoded set of data is to be provided.

摘要翻译： 公开了至少部分地基于编码数据的解码复杂度的意识和目标解码器解码编码数据的能力对数据进行编码的技术。 在一些实施例中，至少部分地基于要提供编码数据集合的目标解码器的状态对数据集进行编码。 在一些实施例中，一组数据至少部分地基于要提供编码数据集的多个解码器的状态进行编码。

公开(公告)号：US20110019879A1

公开(公告)日：2011-01-27

申请号：US12772971

申请日：2010-05-03

申请人： Roger Kumar ,  Thomas Pun ,  Xiaochun Nie ,  Hsi-Jung Wu

发明人： Roger Kumar ,  Thomas Pun ,  Xiaochun Nie ,  Hsi-Jung Wu

IPC分类号： G06K9/00

CPC分类号： H04N19/533 ,  H04N19/61

摘要： Some embodiments of the invention provide a method for adaptively performing motion estimation. In some embodiments, the method initially performs a first motion estimation operation. It then determines whether the estimated error in the result of the first motion estimation is greater than a particular threshold. If not, the method uses the results of the first motion estimation operation. Otherwise, the method selects another motion estimation operation. The method continues in this manner until it performs a motion estimation operation that results in an acceptable estimated error, or until it tries all the motion estimation operations at its disposal. When the method cannot identify a motion estimation operation that produces results with an acceptable estimated error, the method selects the result of the motion estimation operation that produced the best results.

摘要翻译： 本发明的一些实施例提供了一种用于自适应地执行运动估计的方法。 在一些实施例中，该方法最初执行第一运动估计操作。 然后，确定第一运动估计的结果中的估计误差是否大于特定阈值。 如果不是，则该方法使用第一运动估计操作的结果。 否则，该方法选择另一运动估计操作。 该方法以这种方式继续，直到其执行导致可接受的估计误差的运动估计操作，或者直到它尝试其所有的所有运动估计操作。 当该方法无法识别产生具有可接受的估计误差的结果的运动估计运算时，该方法选择产生最佳结果的运动估计运算的结果。

公开(公告)号：US20090010325A1

公开(公告)日：2009-01-08

申请号：US12165625

申请日：2008-06-30

申请人： Xiaochun Nie ,  Thomas Pun ,  Roger Kumar ,  Hsi-Jung Wu

发明人： Xiaochun Nie ,  Thomas Pun ,  Roger Kumar ,  Hsi-Jung Wu

IPC分类号： H04N7/12

CPC分类号： H04N19/154 ,  H04N19/115 ,  H04N19/14 ,  H04N19/149 ,  H04N19/159 ,  H04N19/172 ,  H04N19/61

摘要： A rate controller for allocating a bit budget for video frames to be encoded is disclosed. The rate controller of the present invention considers many different factors when determining the frame bit budget including: desired video quality, target bit rate, frame type (intra-frame or inter-frame), frame duration, intra-frame frequency, frame complexity, intra-block frequency within an intra-frame, buffer overflow, buffer underflow, and the encoded video frame quality for a possible second pass.

摘要翻译： 公开了一种用于分配要编码的视频帧的位预算的速率控制器。 本发明的速率控制器在确定帧位预算时考虑许多不同的因素，包括：期望的视频质量，目标比特率，帧类型（帧内或帧间），帧持续时间，帧内频率，帧复杂度， 帧内的块内频率，缓冲器溢出，缓冲器下溢以及用于可能的第二遍的编码视频帧质量。

公开(公告)号：US07456760B2

公开(公告)日：2008-11-25

申请号：US11519843

申请日：2006-09-11

申请人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

发明人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

IPC分类号： H03M7/00

CPC分类号： H04N19/154 ,  H04N19/156 ,  H04N19/164

摘要： Techniques for encoding data based at least in part upon an awareness of the decoding complexity of the encoded data and the ability of a target decoder to decode the encoded data are disclosed. In some embodiments, a set of data is encoded based at least in part upon a state of a target decoder to which the encoded set of data is to be provided. In some embodiments, a set of data is encoded based at least in part upon the states of multiple decoders to which the encoded set of data is to be provided.

摘要翻译： 公开了至少部分地基于编码数据的解码复杂度的意识和目标解码器解码编码数据的能力对数据进行编码的技术。 在一些实施例中，至少部分地基于要提供编码数据集合的目标解码器的状态对数据集进行编码。 在一些实施例中，一组数据至少部分地基于要提供编码数据集的多个解码器的状态进行编码。

公开(公告)号：US20080240600A1

公开(公告)日：2008-10-02

申请号：US12136038

申请日：2008-06-09

申请人： Thomas Pun ,  Maynard Handley ,  Roger Kumar ,  Xiaochun Nie ,  Hsi-Jung Wu

发明人： Thomas Pun ,  Maynard Handley ,  Roger Kumar ,  Xiaochun Nie ,  Hsi-Jung Wu

IPC分类号： G06K9/40

CPC分类号： G06T5/002 ,  G06T2207/10016 ,  H04N19/117 ,  H04N19/127 ,  H04N19/156 ,  H04N19/527 ,  H04N19/86

摘要： Some embodiments of the invention provide a method of decoding an encoded video signal that includes a plurality of successive encoded images. The method initially receives an encoded image of the video signal. It then decodes the encoded image. The method next examines the decoded image to determine whether the decoded image satisfies at least one criterion for performing a post-filter operation on the decoded image. Only if the decoded image satisfies the criterion, the method performs the post-filter operation on the decoded image. The criterion in some embodiments is whether the amount of time for applying the post-filter operation exceeds the remaining amount of time that the method has to process the received image. Some embodiments of the invention provide a method of post-filtering a current image that was decoded from an encoded video signal, which includes a plurality of successive encoded images. The current image has several sub-sections. The method selects a sub-section of the current image. It then determines whether the selected sub-section satisfies at least one condition for performing a post-filter operation on the selected sub-section. The method next performs the post-filter operation on the selected sub-section only if the selected sub-section satisfies the criterion.

摘要翻译： 本发明的一些实施例提供了一种对包括多个连续编码图像的编码视频信号进行解码的方法。 该方法最初接收视频信号的编码图像。 然后解码编码图像。 接下来，该方法检查解码图像，以确定解码图像是否满足对解码图像执行后置滤波操作的至少一个准则。 只有解码图像满足标准，该方法对解码图像执行后置滤波操作。 一些实施例中的标准是用于应用后置滤波器操作的时间量是否超过该方法必须处理接收到的图像的剩余时间量。 本发明的一些实施例提供了一种对从包括多个连续编码图像的编码视频信号进行解码的当前图像进行后置滤波的方法。 当前图像有几个子部分。 该方法选择当前图像的子部分。 然后，确定所选择的子部分是否满足对所选择的子部分执行后置滤波操作的至少一个条件。 该方法仅在所选择的子部分满足标准时才对所选择的子部分执行后置滤波操作。

公开(公告)号：US20080181298A1

公开(公告)日：2008-07-31

申请号：US11627457

申请日：2007-01-26

申请人： Xiaojin Shi ,  Hsi-Jung Wu ,  James Oliver Normile

发明人： Xiaojin Shi ,  Hsi-Jung Wu ,  James Oliver Normile

IPC分类号： H04N7/32 ,  H04N7/26

CPC分类号： H04N21/23439 ,  H04N19/156 ,  H04N19/30 ,  H04N19/40 ,  H04N19/46 ,  H04N21/234327 ,  H04N21/235 ,  H04N21/2662 ,  H04N21/435 ,  H04N21/84

摘要： Systems, apparatuses and methods whereby coded bitstreams are delivered to downstream end-user devices having various performance capabilities. A head-end encoder/video store generates a primary coded bitstream and metadata for delivery to an intermediate re-encoding system. The re-encoding system recodes the primary coded bitstream to generate secondary coded bitstreams based on coding parameters in the metadata. Each secondary coded bitstream is matched to a conformance point of a downstream end-user device. Coding parameters for each conformance point can be derived from the head-end encoder encoding original source video to generate the secondary coded bitstreams and extracting information from the coding process/results. The metadata can then can be communicated as part of the primary coded bitstream (e.g., as SEI) or can be communicated separately. As a result, the complexity of the secondary coded bitstream is appropriately scaled to match the capabilities of the downstream end-user device to which it is delivered.

摘要翻译： 其中编码比特流被传送到具有各种性能能力的下游终端用户设备的系统，设备和方法。 头端编码器/视频存储器产生主编码比特流和元数据以传送到中间重编码系统。 重编码系统基于元数据中的编码参数来重新编码主编码比特流以生成辅助编码比特流。 每个辅助编码比特流与下游终端用户设备的一致性点匹配。 可以从编码原始源视频的前端编码器导出用于每个一致性点的编码参数，以生成辅助编码比特流并从编码处理/结果中提取信息。 然后可以将元数据作为主编码比特流的一部分（例如，作为SEI）传送或者可以单独通信。 结果，二次编码比特流的复杂度被适当地缩放以匹配其被传递到的下游终端用户设备的能力。

公开(公告)号：US20080062018A1

公开(公告)日：2008-03-13

申请号：US11519843

申请日：2006-09-11

申请人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

发明人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

IPC分类号： H03M7/00

CPC分类号： H04N19/154 ,  H04N19/156 ,  H04N19/164

摘要： Techniques for encoding data based at least in part upon an awareness of the decoding complexity of the encoded data and the ability of a target decoder to decode the encoded data are disclosed. In some embodiments, a set of data is encoded based at least in part upon a state of a target decoder to which the encoded set of data is to be provided. In some embodiments, a set of data is encoded based at least in part upon the states of multiple decoders to which the encoded set of data is to be provided.

公开(公告)号：US20070217514A1

公开(公告)日：2007-09-20

申请号：US11751552

申请日：2007-05-21

申请人： Roger Kumar ,  Thomas Pun ,  Xiaochun Nie ,  Hsi-Jung Wu

发明人： Roger Kumar ,  Thomas Pun ,  Xiaochun Nie ,  Hsi-Jung Wu

IPC分类号： H04N7/32

CPC分类号： G06T7/207

摘要： Some embodiments of the invention provide a method of performing motion estimation for an array of image values obtained from a current image. The method starts with an initial estimate of the motion of the current image. The method then determines whether the initial estimate of the motion of the current image array between the current image and a reference image is acceptable. If not, the method specifies a first value for a parameter for performing the motion estimation. Otherwise, the method specifies a second value for the parameter. The method then performs a motion estimation operation based on the specified value of the parameter. One example of a specified parameter is the size of the window that the motion estimation operation uses. Another example is the starting level for a hierarchical motion estimation operation that it performs. A hierarchical motion estimation operation searches the reference frame at several different levels of granularity.

摘要翻译： 本发明的一些实施例提供了一种对从当前图像获得的图像值阵列执行运动估计的方法。 该方法从当前图像的运动的初始估计开始。 该方法然后确定当前图像和参考图像之间的当前图像阵列的运动的初始估计是否可接受。 如果不是，则该方法指定用于执行运动估计的参数的第一值。 否则，该方法指定参数的第二个值。 然后，该方法基于参数的指定值执行运动估计操作。 指定参数的一个示例是运动估计操作使用的窗口的大小。 另一个例子是它执行的分层运动估计操作的起始水平。 分层运动估计操作以几个不同的粒度级别来搜索参考帧。