公开(公告)号：US07239721B1

公开(公告)日：2007-07-03

申请号：US10427891

申请日：2003-04-30

申请人： Roger Kumar ,  Thomas Pun ,  Xiaochun Nie ,  Hsi-Jung Wu

发明人： Roger Kumar ,  Thomas Pun ,  Xiaochun Nie ,  Hsi-Jung Wu

IPC分类号： G06K9/00

CPC分类号： G06T7/207

摘要： Some embodiments of the invention provide a method of performing motion estimation for an array of image values obtained from a current image. The method starts with an initial estimate of the motion of the current image. The method then determines whether the initial estimate of the motion of the current image array between the current image and a reference image is acceptable. If not, the method specifies a first value for a parameter for performing the motion estimation. Otherwise, the method specifies a second value for the parameter. The method then performs a motion estimation operation based on the specified value of the parameter. One example of a specified parameter is the size of the window that the motion estimation operation uses. Another example is the starting level for a hierarchical motion estimation operation that it performs. A hierarchical motion estimation operation searches the reference frame at several different levels of granularity.

摘要翻译： 本发明的一些实施例提供了一种对从当前图像获得的图像值阵列执行运动估计的方法。 该方法从当前图像的运动的初始估计开始。 该方法然后确定当前图像和参考图像之间的当前图像阵列的运动的初始估计是否可接受。 如果不是，则该方法指定用于执行运动估计的参数的第一值。 否则，该方法指定参数的第二个值。 然后，该方法基于参数的指定值执行运动估计操作。 指定参数的一个示例是运动估计操作使用的窗口的大小。 另一个例子是它执行的分层运动估计操作的起始水平。 分层运动估计操作以几个不同的粒度级别来搜索参考帧。

公开(公告)号：US20070116115A1

公开(公告)日：2007-05-24

申请号：US11473248

申请日：2006-06-23

申请人： Xin Tong ,  Barin Haskell ,  Hsi-Jung Wu

发明人： Xin Tong ,  Barin Haskell ,  Hsi-Jung Wu

IPC分类号： H04N11/04 ,  H04N7/12

CPC分类号： H04N19/198 ,  H04N19/124 ,  H04N19/146 ,  H04N19/152 ,  H04N19/172 ,  H04N19/177 ,  H04N19/192 ,  H04N19/196 ,  H04N19/61

摘要： This invention is directed to a video bit rate control method for encoding a video sequence based on a decoder buffer condition and a group of picture (GOP) size limitation of the encoded video sequence. The method includes iteratively adjusting a quantization parameter and/or a masking strength parameter and encoding the video sequence at the adjusted parameters until the buffer condition and GOP size limitation are satisfied. The method makes the above adjustments to avoid buffer underflow and GOP oversizing.

摘要翻译： 本发明涉及一种视频比特率控制方法，用于根据解码器缓冲器条件和编码视频序列的一组图像（GOP）尺寸限制对视频序列进行编码。 该方法包括迭代地调整量化参数和/或掩蔽强度参数，并且以调整的参数对视频序列进行编码，直到满足缓冲条件和GOP大小限制。 该方法进行上述调整，以避免缓冲区下溢和GOP超大。

公开(公告)号：US20050175093A1

公开(公告)日：2005-08-11

申请号：US10812062

申请日：2004-03-30

申请人： Barin Haskell ,  Adriana Dumitras ,  James Normile ,  Hsi-Jung Wu ,  Xiaochun Nie ,  Atul Puri

发明人： Barin Haskell ,  Adriana Dumitras ,  James Normile ,  Hsi-Jung Wu ,  Xiaochun Nie ,  Atul Puri

IPC分类号： H04N7/12

CPC分类号： H04N19/33 ,  H04N19/107 ,  H04N19/115 ,  H04N19/117 ,  H04N19/124 ,  H04N19/132 ,  H04N19/137 ,  H04N19/14 ,  H04N19/142 ,  H04N19/149 ,  H04N19/152 ,  H04N19/159 ,  H04N19/172 ,  H04N19/176 ,  H04N19/18 ,  H04N19/61

摘要： A rate control system is disclosed for video coding applications. The rate controller assigns a quantization parameter for video data in a picture in response to complexity indicators indicative of spatial complexity, motion complexity and/or bits per pel of the picture. A virtual buffer based quantizer parameter is proposed based on a virtual buffer fullness analysis and a target rate estimate, which is derived from the complexity indicators. A second quantizer parameter is proposed from a linear regression analysis of quantizer parameters used to code previously coded pictures of similar type (e.g., I pictures, P pictures or B pictures). A coding policy decision unit defines a final quantizer parameter from a comparison of the two proposed quantizer parameters.

摘要翻译： 公开了一种用于视频编码应用的速率控制系统。 速率控制器响应于表示图像的空间复杂度，运动复杂度和/或每像素的复杂度指示符，为图像中的视频数据分配量化参数。 基于虚拟缓冲区丰满度分析和目标速率估计提出了一种基于虚拟缓冲器的量化器参数，该参数是从复杂性指标中得出的。 从用于对先前编码的类似类型的图像（例如，I图像，P图像或B图像）进行编码的量化器参数的线性回归分析提出了第二量化参数。 编码策略决定单元根据两个提出的量化器参数的比较来定义最终的量化器参数。

公开(公告)号：US10477249B2

公开(公告)日：2019-11-12

申请号：US12479068

申请日：2009-06-05

申请人： Yuxin Liu ,  Hsi-Jung Wu ,  Xiaojin Shi ,  Chris Yoochang Chung

发明人： Yuxin Liu ,  Hsi-Jung Wu ,  Xiaojin Shi ,  Chris Yoochang Chung

IPC分类号： H04N7/12 ,  H04N11/04 ,  H04N19/86 ,  H04N19/46 ,  H04N19/117 ,  H04N19/136 ,  H04N19/44

摘要： A video decoder system includes a video decoding engine, noise database, artifact estimator and post-processing unit. The video coder may generate recovered video from a data stream of coded video data, which may have visually-perceptible artifacts introduced as a byproduct of compression. The noise database may store a plurality of previously developed noise patches. The artifact estimator may estimate the location of coding artifacts present in the recovered video and select noise patches from the database to mask the artifacts and the post-processing unit may integrate the selected noise patches into the recovered video. In this manner, the video decoder may generate post-processed noise which may mask artifacts that otherwise would be generated by a video coding process.

公开(公告)号：US10205953B2

公开(公告)日：2019-02-12

申请号：US13359377

申请日：2012-01-26

申请人： Douglas Scott Price ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Dazhong Zhang

发明人： Douglas Scott Price ,  Hsi-Jung Wu ,  Xiaosong Zhou ,  Dazhong Zhang

IPC分类号： H04N19/20 ,  H04N19/176 ,  H04N19/115 ,  H04N19/124 ,  H04N19/137 ,  H04N19/17 ,  G06K9/34 ,  G06K9/00 ,  G06K9/46 ,  G06K9/62 ,  G06T7/10 ,  G06T7/11 ,  G06T7/12 ,  G06T7/13 ,  G06T7/136 ,  G06T7/181 ,  G06T7/143 ,  G06T7/187 ,  G06T7/194

摘要： Embodiments of the present invention provide techniques for coding video data efficiently based on detection of objects within video sequences. A video coder may perform object detection on the frame and when an object is detected, develop statistics of an area of the frame in which the object is located. The video coder may compare pixels adjacent to the object location to the object's statistics and may define an object region to include pixel blocks corresponding to the object's location and pixel blocks corresponding to adjacent pixels having similar statistics as the detected object. The coder may code the video frame according to a block-based compression algorithm wherein pixel blocks of the object region are coded according to coding parameters generating relatively high quality coding and pixel blocks outside the object region are coded according to coding parameters generating relatively lower quality coding.

公开(公告)号：US09300846B2

公开(公告)日：2016-03-29

申请号：US13745256

申请日：2013-01-18

申请人： Douglas Price ,  Xiaosong Zhou ,  Hsi-Jung Wu

发明人： Douglas Price ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC分类号： H04N5/217 ,  H04N5/213 ,  H04N5/21

CPC分类号： H04N5/217 ,  H04N5/21 ,  H04N5/213

摘要： In certain low-light or other poor image capture conditions, the camera capture settings may create noise fitting a known profile, including certain specific color ranges and signal frequencies, in the captured image. A pre-processor may identify frequency bands and DC offsets that may indicate noise in an image captured with known settings. Then the areas of the image containing the identified frequencies and offsets may be analyzed spatially and temporally to confirm that the identified regions are noise and not part of the scene and an appropriate filter defined.

摘要翻译： 在某些低光或其他较差的图像捕获条件下，相机拍摄设置可能会在拍摄图像中产生包含某些特定颜色范围和信号频率的已知配置文件的噪声。 预处理器可以识别可能指示以已知设置捕获的图像中的噪声的频带和DC偏移。 然后，可以在空间和时间上分析包含所识别的频率和偏移的图像的区域，以确认所识别的区域是噪声，而不是场景的一部分，并且定义适当的滤波器。

公开(公告)号：US08917632B2

公开(公告)日：2014-12-23

申请号：US12794773

申请日：2010-06-06

申请人： Xiaosong Zhou ,  Hsi-Jung Wu

发明人： Xiaosong Zhou ,  Hsi-Jung Wu

IPC分类号： H04L12/16 ,  H04N7/14 ,  H04N7/15

CPC分类号： H04N7/141 ,  G06F3/04817 ,  G06F3/04842 ,  G06F3/04886 ,  G06F9/451 ,  G09G5/14 ,  H04M1/72583 ,  H04N5/2258 ,  H04N5/2624 ,  H04N5/272 ,  H04N7/147 ,  H04N7/15

摘要： Some embodiments provide a method for encoding video pictures captured by a mobile device having at least first and second cameras. The method identifies a first rate controller parameter that is based on at least a first value that quantifies one characteristic of the first camera. The method uses the first rate controller parameter to configure a set of rate controllers to adjust a bit rate for encoding video pictures captured by the first camera. The method identifies a second rate controller parameter that is based on at least a second value that quantifies the same characteristic of the second camera. The first and second values are different, and the difference causes the first and second rate controller parameters to be different. The method uses the second rate controller parameter to configure the set of rate controllers to adjust a bit rate for encoding video pictures captured by the second camera.

摘要翻译： 一些实施例提供了一种用于编码由具有至少第一和第二相机的移动设备捕获的视频图像的方法。 该方法识别基于量化第一相机的一个特征的至少第一值的第一速率控制器参数。 该方法使用第一速率控制器参数来配置一组速率控制器以调整用于对由第一相机捕获的视频图像进行编码的比特率。 该方法识别基于量化第二相机的相同特性的至少第二值的第二速率控制器参数。 第一和第二值是不同的，差异导致第一和第二速率控制器参数不同。 该方法使用第二速率控制器参数来配置速率控制器的集合以调整用于对由第二相机捕获的视频图像进行编码的比特率。

公开(公告)号：US08780986B2

公开(公告)日：2014-07-15

申请号：US12415478

申请日：2009-03-31

申请人： Hsi-Jung Wu ,  Xiaosong Zhou ,  Xiaojin Shi ,  Yuxin Liu

发明人： Hsi-Jung Wu ,  Xiaosong Zhou ,  Xiaojin Shi ,  Yuxin Liu

IPC分类号： H04N7/68 ,  H04N7/48 ,  H04N7/32 ,  H04N7/34 ,  H04N7/26 ,  H04N7/50 ,  H04N7/36

CPC分类号： H04N7/26031 ,  H04N7/5086 ,  H04N19/107 ,  H04N19/137 ,  H04N19/176 ,  H04N19/61

摘要： Apparatuses and methods for improving coding processes and coding parameters for coding video data are provided for. A coder may select coding parameters for video data according to a default coding policy. The default coding policy may include selection of prediction modes (e.g., intra-coding or inter-coding) for each pixel group in each frame. A video coder may select some pixel groups in a frame to be coded as refresh pixel groups as an exception to the default assignment policies. The selection of refresh pixel groups may be based on prediction relationships among multiple frames of source video data. The default coding of the refresh pixel groups is then modified to enhanced the coding of the refresh pixel groups. The refresh pixel groups may permit fewer intra (I) frames be sent and/or may improve the quality of the recovered video.

摘要翻译： 提供了用于改进用于编码视频数据的编码处理和编码参数的装置和方法。 编码器可以根据默认编码策略选择视频数据的编码参数。 默认编码策略可以包括对每个帧中的每个像素组的预测模式（例如，帧内编码或帧间编码）的选择。 视频编码器可以将要编码的帧中的一些像素组选择为刷新像素组，作为默认分配策略的例外。 刷新像素组的选择可以基于源视频数据的多个帧之间的预测关系。 然后修改刷新像素组的默认编码以增强刷新像素组的编码。 刷新像素组可以允许更少的帧内（I）帧被发送和/或可以提高恢复的视频的质量。

公开(公告)号：US08718129B2

公开(公告)日：2014-05-06

申请号：US11934394

申请日：2007-11-02

申请人： Hsi-Jung Wu ,  Ionut Hristodorescu ,  James Oliver Normile

发明人： Hsi-Jung Wu ,  Ionut Hristodorescu ,  James Oliver Normile

IPC分类号： H04N7/12

CPC分类号： H04N19/436 ,  H04N19/103 ,  H04N19/156 ,  H04N19/176 ,  H04N19/42 ,  H04N19/44 ,  H04N19/61 ,  H04N19/88

摘要： A method and system are provided for decoding coded video data by turning off or not loading at least one functional unit or functional subunit of the decoder while decoding a portion of the coded video data. A schedule may be created prior to substantive decoding and then the schedule may be used to decode coded video data. The coded video data may be reordered based on the functional units or subunits the portions of the coded video data need for decoding. The portions of the coded video data are reordered into their original order in an output buffer after being decoded. The decoder may determine which functional units or subunits are needed for decoding based on administration information included with the coded video data. The decoder may decode portions of the coded video data in parallel.

摘要翻译： 提供了一种方法和系统，用于通过在对一部分编码视频数据进行解码的同时关闭或不加载解码器的至少一个功能单元或功能子单元来解码编码的视频数据。 可以在实质性解码之前创建调度，然后可以使用调度来解码经编码的视频数据。 编码视频数据可以基于编码视频数据部分需要解码的功能单元或子单元重新排序。 在解码之后，将编码的视频数据的部分重新排序成输出缓冲器中的原始顺序。 解码器可以基于包括在编码视频数据中的管理信息来确定需要哪个功能单元或子单元进行解码。 解码器可以并行地解码编码视频数据的部分。

公开(公告)号：US08638851B2

公开(公告)日：2014-01-28

申请号：US12646065

申请日：2009-12-23

申请人： Hyeonkuk Jeong ,  Xiaosong Zhou ,  Joe Abuan ,  Xiaojin Shi ,  Hsi-Jung Wu ,  James Oliver Normile

发明人： Hyeonkuk Jeong ,  Xiaosong Zhou ,  Joe Abuan ,  Xiaojin Shi ,  Hsi-Jung Wu ,  James Oliver Normile

IPC分类号： H04N7/12

CPC分类号： H04N7/148 ,  H04N19/115 ,  H04N19/166 ,  H04N19/192 ,  H04N19/196 ,  H04N19/197 ,  H04N19/46

摘要： A video coding system and method for increasing a transmitted output bit rate of a video encoding system by altering the content of the bit stream. A video encoder may receive a coding mode signal from a computer application for coding source video data, the coding mode signal indicating a target bit rate having a risk factor related to transmission error associated to the target bit rate. The coded bitstream may be modified based on the risk factor indicated in the coding mode signal. A modified coded bitstream may be outputted at the target bit rate and at a reduced coding efficiency, and the channel may be tested for transmission errors. Based on the test results, a revised coding mode signal indicating the same target bit rate, but a revised risk factor may be provided. The coded bitstream may be revised by removing the modifications previously made to the coded bitstream and a revised coded bitstream having greater coding efficiency may be output at the target bit rate.

摘要翻译： 一种用于通过改变比特流的内容来增加视频编码系统的发送的输出比特率的视频编码系统和方法。 视频编码器可以接收来自用于编码源视频数据的计算机应用的编码模式信号，编码模式信号指示具有与目标比特率相关联的传输错误的风险因子的目标比特率。 可以基于编码模式信号中指示的危险因素来修改编码比特流。 可以以目标比特率和降低的编码效率输出经修改的编码比特流，并且可以测试该信道的传输错误。 基于测试结果，可以提供指示相同目标比特率的修订的编码模式信号，但是可以提供经修订的风险因子。 可以通过去除先前对编码比特流进行的修改来修改编码比特流，并且可以以目标比特率输出具有更大编码效率的修改编码比特流。