公开(公告)号：US09137535B2

公开(公告)日：2015-09-15

申请号：US12820106

申请日：2010-06-21

申请人： Thomas Pun ,  Roger Kumar ,  Xiaochun Nie ,  Hsi-Jung Wu

发明人： Thomas Pun ,  Roger Kumar ,  Xiaochun Nie ,  Hsi-Jung Wu

IPC分类号： H04N7/18 ,  H04N19/126 ,  H04N19/196 ,  H04N19/176 ,  H04N19/149 ,  H04N19/61

CPC分类号： H04N19/126 ,  H04N19/146 ,  H04N19/149 ,  H04N19/176 ,  H04N19/196 ,  H04N19/197 ,  H04N19/61 ,  H04N19/625

摘要： Method For Implementing A Quantizer In A Multimedia Compression And Encoding System is disclosed. In the Quantizer system of the present invention, several new quantization ideas are disclosed. In one embodiment, adjacent macroblocks are grouped together into macroblock groups. The macroblock groups are then assigned a common quantizer value. The common quantizer value may be selected based upon how the macroblocks are encoded, the type of macroblocks within the macroblock group (intra-blocks or inter-blocks), the history of the motion vectors associated with the macroblocks in the macroblock group, the residuals of the macroblocks in the macroblock group, and the energy of the macroblocks in the macroblock group. The quantizer value may be adjusted in a manner that is dependent on the current quantizer value. Specifically, if the quantizer value is at the low end of the quantizer scale, then only small adjustments are made. If the quantizer value is at the high end then larger adjustments may be made to the quantizer. Finally, in one embodiment, the quantizer is implemented along with an inverse quantizer for efficient operation.

摘要翻译： 公开了一种在多媒体压缩和编码系统中实现量化器的方法。 在本发明的量化器系统中，公开了几种新的量化思想。 在一个实施例中，相邻宏块被分组在一起成为宏块组。 然后向宏块组分配一个公共量化器值。 可以基于宏块如何编码，宏块组（块内或块内）中的宏块的类型，与宏块组中的宏块相关联的运动向量的历史来选择公共量化器值，残差 的宏块组中的宏块的能量，以及宏块组中的宏块的能量。 量化器值可以以取决于当前量化器值的方式进行调整。 具体地，如果量化器值处于量化器标尺的低端，则仅进行小的调整。 如果量化器值处于高端，则可以对量化器进行较大的调整。 最后，在一个实施例中，量化器与用于有效操作的逆量化器一起被实现。

公开(公告)号：US08599238B2

公开(公告)日：2013-12-03

申请号：US12581043

申请日：2009-10-16

申请人： Hsi-Jung Wu ,  Chris Yoochang Chung ,  Xiaojin Shi ,  James Normile

发明人： Hsi-Jung Wu ,  Chris Yoochang Chung ,  Xiaojin Shi ,  James Normile

IPC分类号： H04N7/14

CPC分类号： G06K9/00228 ,  G06T3/00 ,  G06T5/006 ,  G06T2207/20104 ,  G06T2207/30201 ,  H04N5/217 ,  H04N5/23219 ,  H04N5/23258 ,  H04N5/23267

摘要： Methods, systems, and apparatus are presented for reducing distortion in an image, such as a video image. A video image can be captured by an image capture device, e.g. during a video conferencing session. Distortion correction processing, such as the application of one or more warping techniques, can be applied to the captured image to produce a distortion corrected image, which can be transmitted to one or more participants. The warping techniques can be performed in accordance with one or more warp parameters specifying a transformation of the captured image. Further, the warp parameters can be generated in accordance with an orientation of the image capture device, which can be determined based on sensor data or can be a fixed value. Additionally or alternatively, the warp parameters can be determined in accordance with a reference image or model to which the captured image should be warped.

摘要翻译： 呈现了用于减少诸如视频图像的图像中的失真的方法，系统和装置。 视频图像可以由图像捕获设备捕获，例如， 在视频会议期间。 畸变校正处理，例如应用一个或多个翘曲技术，可以应用于所捕获的图像，以产生可以发送到一个或多个参与者的失真校正图像。 翘曲技术可以根据指定捕获图像的变换的一个或多个翘曲参数来执行。 此外，可以根据可以基于传感器数据确定的图像捕获装置的取向来生成翘曲参数，或者可以是固定值。 附加地或替代地，可以根据捕获的图像应该翘曲的参考图像或模型来确定翘曲参数。

公开(公告)号：US08451911B2

公开(公告)日：2013-05-28

申请号：US12136038

申请日：2008-06-09

申请人： Thomas Pun ,  Maynard Handley ,  Roger Kumar ,  Xiaochun Nie ,  Hsi-Jung Wu

发明人： Thomas Pun ,  Maynard Handley ,  Roger Kumar ,  Xiaochun Nie ,  Hsi-Jung Wu

IPC分类号： H04N7/12

CPC分类号： G06T5/002 ,  G06T2207/10016 ,  H04N19/117 ,  H04N19/127 ,  H04N19/156 ,  H04N19/527 ,  H04N19/86

摘要： Some embodiments of the invention provide a method of decoding an encoded video signal that includes a plurality of successive encoded images. The method initially receives an encoded image of the video signal. It then decodes the encoded image. The method next examines the decoded image to determine whether the decoded image satisfies at least one criterion for performing a post-filter operation on the decoded image. Only if the decoded image satisfies the criterion, the method performs the post-filter operation on the decoded image. The criterion in some embodiments is whether the amount of time for applying the post-filter operation exceeds the remaining amount of time that the method has to process the received image. Some embodiments of the invention provide a method of post-filtering a current image that was decoded from an encoded video signal, which includes a plurality of successive encoded images. The current image has several sub-sections. The method selects a sub-section of the current image. It then determines whether the selected sub-section satisfies at least one condition for performing a post-filter operation on the selected sub-section. The method next performs the post-filter operation on the selected sub-section only if the selected sub-section satisfies the criterion.

摘要翻译： 本发明的一些实施例提供了一种对包括多个连续编码图像的编码视频信号进行解码的方法。 该方法最初接收视频信号的编码图像。 然后解码编码图像。 接下来，该方法检查解码图像，以确定解码图像是否满足对解码图像执行后置滤波操作的至少一个准则。 只有解码图像满足标准，该方法对解码图像执行后置滤波操作。 一些实施例中的标准是用于应用后置滤波器操作的时间量是否超过该方法必须处理接收到的图像的剩余时间量。 本发明的一些实施例提供了一种对从包括多个连续编码图像的编码视频信号进行解码的当前图像进行后置滤波的方法。 当前图像有几个子部分。 该方法选择当前图像的子部分。 然后，确定所选择的子部分是否满足对所选择的子部分执行后置滤波操作的至少一个条件。 该方法仅在所选择的子部分满足标准时才对所选择的子部分执行后置滤波操作。

公开(公告)号：US20110234430A1

公开(公告)日：2011-09-29

申请号：US13156610

申请日：2011-06-09

申请人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

发明人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

IPC分类号： H03M7/34

CPC分类号： H04N19/154 ,  H04N19/156 ,  H04N19/164

摘要： Techniques for encoding data based at least in part upon an awareness of the decoding complexity of the encoded data and the ability of a target decoder to decode the encoded data are disclosed. In some embodiments, a set of data is encoded based at least in part upon a state of a target decoder to which the encoded set of data is to be provided. In some embodiments, a set of data is encoded based at least in part upon the states of multiple decoders to which the encoded set of data is to be provided.

摘要翻译： 公开了至少部分地基于编码数据的解码复杂度的意识和目标解码器解码编码数据的能力对数据进行编码的技术。 在一些实施例中，至少部分地基于要提供编码数据集合的目标解码器的状态对数据集进行编码。 在一些实施例中，一组数据至少部分地基于要提供编码数据集的多个解码器的状态进行编码。

公开(公告)号：US07929778B2

公开(公告)日：2011-04-19

申请号：US12538850

申请日：2009-08-10

申请人： Hsi-Jung Wu ,  Yu Tina Tian ,  Jian Lu ,  Ke-Chiang Chu

发明人： Hsi-Jung Wu ,  Yu Tina Tian ,  Jian Lu ,  Ke-Chiang Chu

IPC分类号： G06K9/36 ,  G06K9/00

CPC分类号： G06T9/007 ,  H04N19/122 ,  H04N19/132 ,  H04N19/139 ,  H04N19/14 ,  H04N19/154 ,  H04N19/176 ,  H04N19/18 ,  H04N19/196 ,  H04N19/198 ,  H04N19/61

摘要： In a digital signal processing system, a method for selecting a transform function to apply to an input signal based on characteristics of the signal, and for self-adjusting criteria which are used in selecting a transform function to apply to a subsequent signal. Characteristics are obtained from the signal. The characteristics are compared to adjustable criteria which are used in selecting a transform function. Differing criteria are maintained for the different selectable transform functions. A record is maintained of transform functions selected and the particular characteristics that caused the selection. Based on the ability of a transform function to minimally define the coded signal, an inverse transform function is selected to decode the signal. The criteria used in selecting a transform function to apply to a subsequent signal are adjusted based on a quality measure of the decoded signal and the record of selected transform functions.

摘要翻译： 在数字信号处理系统中，提供了一种用于根据信号的特性选择适用于输入信号的变换函数的方法，以及用于选择变换函数以应用于后续信号的自调整准则的方法。 从信号获得特性。 将特征与用于选择变换函数的可调标准进行比较。 对于不同的可选变换函数维持不同的标准。 保留所选择的变换函数和导致选择的特定特征的记录。 基于变换函数最小化定义编码信号的能力，选择逆变换函数来对信号进行解码。 基于解码信号的质量测量和所选择的变换函数的记录来调整用于选择应用于后续信号的变换函数的标准。

公开(公告)号：US20110019879A1

公开(公告)日：2011-01-27

申请号：US12772971

申请日：2010-05-03

申请人： Roger Kumar ,  Thomas Pun ,  Xiaochun Nie ,  Hsi-Jung Wu

发明人： Roger Kumar ,  Thomas Pun ,  Xiaochun Nie ,  Hsi-Jung Wu

IPC分类号： G06K9/00

CPC分类号： H04N19/533 ,  H04N19/61

摘要： Some embodiments of the invention provide a method for adaptively performing motion estimation. In some embodiments, the method initially performs a first motion estimation operation. It then determines whether the estimated error in the result of the first motion estimation is greater than a particular threshold. If not, the method uses the results of the first motion estimation operation. Otherwise, the method selects another motion estimation operation. The method continues in this manner until it performs a motion estimation operation that results in an acceptable estimated error, or until it tries all the motion estimation operations at its disposal. When the method cannot identify a motion estimation operation that produces results with an acceptable estimated error, the method selects the result of the motion estimation operation that produced the best results.

摘要翻译： 本发明的一些实施例提供了一种用于自适应地执行运动估计的方法。 在一些实施例中，该方法最初执行第一运动估计操作。 然后，确定第一运动估计的结果中的估计误差是否大于特定阈值。 如果不是，则该方法使用第一运动估计操作的结果。 否则，该方法选择另一运动估计操作。 该方法以这种方式继续，直到其执行导致可接受的估计误差的运动估计操作，或者直到它尝试其所有的所有运动估计操作。 当该方法无法识别产生具有可接受的估计误差的结果的运动估计运算时，该方法选择产生最佳结果的运动估计运算的结果。

公开(公告)号：US07577306B2

公开(公告)日：2009-08-18

申请号：US11436113

申请日：2006-05-16

申请人： Hsi-Jung Wu ,  Yu Tina Tian ,  Jian Lu ,  Ke-Chiang Chu

发明人： Hsi-Jung Wu ,  Yu Tina Tian ,  Jian Lu ,  Ke-Chiang Chu

IPC分类号： G06K9/36 ,  G06K9/46

CPC分类号： G06T9/007 ,  H04N19/122 ,  H04N19/132 ,  H04N19/139 ,  H04N19/14 ,  H04N19/154 ,  H04N19/176 ,  H04N19/18 ,  H04N19/196 ,  H04N19/198 ,  H04N19/61

摘要： In a digital signal processing system, a method for selecting a transform function to apply to an input signal based on characteristics of the signal, and for self-adjusting criteria which are used in selecting a transform function to apply to a subsequent signal. Characteristics are obtained from the signal. The characteristics are compared to adjustable criteria which are used in selecting a transform function. Differing criteria are maintained for the different selectable transform functions. A record is maintained of transform functions selected and the particular characteristics that caused the selection. Based on the ability of a transform function to minimally define the coded signal, an inverse transform function is selected to decode the signal. The criteria used in selecting a transform function to apply to a subsequent signal are adjusted based on a quality measure of the decoded signal and the record of selected transform functions.

摘要翻译： 在数字信号处理系统中，提供了一种用于根据信号的特性选择适用于输入信号的变换函数的方法，以及用于选择变换函数以应用于后续信号的自调整准则的方法。 从信号获得特性。 将特征与用于选择变换函数的可调标准进行比较。 对于不同的可选变换函数维持不同的标准。 保留所选择的变换函数和导致选择的特定特征的记录。 基于变换函数最小化定义编码信号的能力，选择逆变换函数来对信号进行解码。 基于解码信号的质量测量和所选择的变换函数的记录来调整用于选择应用于后续信号的变换函数的标准。

公开(公告)号：US20090010325A1

公开(公告)日：2009-01-08

申请号：US12165625

申请日：2008-06-30

申请人： Xiaochun Nie ,  Thomas Pun ,  Roger Kumar ,  Hsi-Jung Wu

发明人： Xiaochun Nie ,  Thomas Pun ,  Roger Kumar ,  Hsi-Jung Wu

IPC分类号： H04N7/12

CPC分类号： H04N19/154 ,  H04N19/115 ,  H04N19/14 ,  H04N19/149 ,  H04N19/159 ,  H04N19/172 ,  H04N19/61

摘要： A rate controller for allocating a bit budget for video frames to be encoded is disclosed. The rate controller of the present invention considers many different factors when determining the frame bit budget including: desired video quality, target bit rate, frame type (intra-frame or inter-frame), frame duration, intra-frame frequency, frame complexity, intra-block frequency within an intra-frame, buffer overflow, buffer underflow, and the encoded video frame quality for a possible second pass.

摘要翻译： 公开了一种用于分配要编码的视频帧的位预算的速率控制器。 本发明的速率控制器在确定帧位预算时考虑许多不同的因素，包括：期望的视频质量，目标比特率，帧类型（帧内或帧间），帧持续时间，帧内频率，帧复杂度， 帧内的块内频率，缓冲器溢出，缓冲器下溢以及用于可能的第二遍的编码视频帧质量。

公开(公告)号：US07456760B2

公开(公告)日：2008-11-25

申请号：US11519843

申请日：2006-09-11

申请人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

发明人： Jim Normile ,  Thomas Pun ,  Xiaojin Shi ,  Xin Tong ,  Hsi-Jung Wu

IPC分类号： H03M7/00

CPC分类号： H04N19/154 ,  H04N19/156 ,  H04N19/164

摘要： Techniques for encoding data based at least in part upon an awareness of the decoding complexity of the encoded data and the ability of a target decoder to decode the encoded data are disclosed. In some embodiments, a set of data is encoded based at least in part upon a state of a target decoder to which the encoded set of data is to be provided. In some embodiments, a set of data is encoded based at least in part upon the states of multiple decoders to which the encoded set of data is to be provided.

摘要翻译： 公开了至少部分地基于编码数据的解码复杂度的意识和目标解码器解码编码数据的能力对数据进行编码的技术。 在一些实施例中，至少部分地基于要提供编码数据集合的目标解码器的状态对数据集进行编码。 在一些实施例中，一组数据至少部分地基于要提供编码数据集的多个解码器的状态进行编码。

公开(公告)号：US20080240600A1

公开(公告)日：2008-10-02

申请号：US12136038

申请日：2008-06-09

申请人： Thomas Pun ,  Maynard Handley ,  Roger Kumar ,  Xiaochun Nie ,  Hsi-Jung Wu

发明人： Thomas Pun ,  Maynard Handley ,  Roger Kumar ,  Xiaochun Nie ,  Hsi-Jung Wu

IPC分类号： G06K9/40

CPC分类号： G06T5/002 ,  G06T2207/10016 ,  H04N19/117 ,  H04N19/127 ,  H04N19/156 ,  H04N19/527 ,  H04N19/86

摘要： Some embodiments of the invention provide a method of decoding an encoded video signal that includes a plurality of successive encoded images. The method initially receives an encoded image of the video signal. It then decodes the encoded image. The method next examines the decoded image to determine whether the decoded image satisfies at least one criterion for performing a post-filter operation on the decoded image. Only if the decoded image satisfies the criterion, the method performs the post-filter operation on the decoded image. The criterion in some embodiments is whether the amount of time for applying the post-filter operation exceeds the remaining amount of time that the method has to process the received image. Some embodiments of the invention provide a method of post-filtering a current image that was decoded from an encoded video signal, which includes a plurality of successive encoded images. The current image has several sub-sections. The method selects a sub-section of the current image. It then determines whether the selected sub-section satisfies at least one condition for performing a post-filter operation on the selected sub-section. The method next performs the post-filter operation on the selected sub-section only if the selected sub-section satisfies the criterion.

摘要翻译： 本发明的一些实施例提供了一种对包括多个连续编码图像的编码视频信号进行解码的方法。 该方法最初接收视频信号的编码图像。 然后解码编码图像。 接下来，该方法检查解码图像，以确定解码图像是否满足对解码图像执行后置滤波操作的至少一个准则。 只有解码图像满足标准，该方法对解码图像执行后置滤波操作。 一些实施例中的标准是用于应用后置滤波器操作的时间量是否超过该方法必须处理接收到的图像的剩余时间量。 本发明的一些实施例提供了一种对从包括多个连续编码图像的编码视频信号进行解码的当前图像进行后置滤波的方法。 当前图像有几个子部分。 该方法选择当前图像的子部分。 然后，确定所选择的子部分是否满足对所选择的子部分执行后置滤波操作的至少一个条件。 该方法仅在所选择的子部分满足标准时才对所选择的子部分执行后置滤波操作。