公开(公告)号：US20130003845A1

公开(公告)日：2013-01-03

申请号：US13175143

申请日：2011-07-01

申请人： Xiaosong Zhou ,  Hsi-Jung Wu ,  Yao-Chung Lin

发明人： Xiaosong Zhou ,  Hsi-Jung Wu ,  Yao-Chung Lin

IPC分类号： H04N7/32

CPC分类号： H04N19/58 ,  H04N19/105 ,  H04N19/109 ,  H04N19/139 ,  H04N19/172 ,  H04N19/197 ,  H04N19/46 ,  H04N19/61

摘要： In a video coding/decoding system, reference picture caches in a video coder and decoder may be partitioned dynamically based on camera and background motion can lead to improved coding efficiency and coding quality. When a camera is fixed and therefore exhibits low motion, a system may allocate larger portions of the reference picture cache to storage of long term reference frames. In this case, foreground elements of an image (for example, a person) may move in front of a relatively fixed background. Increasing the number of long term reference frames can increase the chances that, no matter where the foreground elements are within a frame currently being coded, the reference picture cache will contain at least one frame that provides an adequate prediction match to background elements within the new frame. Thus the background elements uncovered in the current frame can be coded at high quality with a low number of bits. When a camera exhibits high motion, the system may allocate larger portions of the reference picture cache to storage of short term reference frames.

摘要翻译： 在视频编码/解码系统中，视频编码器和解码器中的参考图像高速缓存可以基于相机进行动态分割，并且背景运动可以提高编码效率和编码质量。 当照相机固定并因此表现出低运动时，系统可以将较大部分的参考图像高速缓存分配给长期参考帧的存储。 在这种情况下，图像的前景元素（例如，人）可以在相对固定的背景之前移动。 增加长期参考帧的数量可以增加机会，无论前景元素在当前正被编码的帧内的何处，参考图像高速缓存将包含至少一个帧，其提供与新的背景元素内的足够的预测匹配 帧。 因此，当前帧中未覆盖的背景元素可以以低位数的高质量被编码。 当相机呈现高运动时，系统可以将较大部分的参考图像高速缓存分配给短期参考帧的存储。

公开(公告)号：US08989270B2

公开(公告)日：2015-03-24

申请号：US13397291

申请日：2012-02-15

申请人： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu

发明人： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC分类号： H04N7/32 ,  H04N7/26 ,  H04N19/573 ,  H04N19/105 ,  H04N19/51 ,  H04N19/14 ,  H04N11/02 ,  H04N11/04 ,  G06K9/00 ,  H04B1/66 ,  H04N7/12

CPC分类号： H04N19/573 ,  H04N19/105 ,  H04N19/14 ,  H04N19/51

摘要： A system and method for efficiently performing motion estimation during temporal prediction for coding. When a new frame is presented for coding, an encoder may identify a limited number of pixel blocks within the input frame that are complex. The encoder may perform motion estimation searches to find reference frame(s) that are adequate prediction references for the complex pixel blocks. The encoder may search for prediction references for the remaining pixel blocks of the new frame, confining the search to the reference frame(s) that were selected as prediction references of the complex pixel blocks.

摘要翻译： 一种用于在编码的时间预测期间有效执行运动估计的系统和方法。 当提供用于编码的新帧时，编码器可以识别输入帧内有限数量的复杂的像素块。 编码器可以执行运动估计搜索以找到作为复数像素块的足够的预测参考的参考帧。 编码器可以搜索新帧的剩余像素块的预测参考，将搜索限制为被选为复数像素块的预测参考的参考帧。

公开(公告)号：US20130329799A1

公开(公告)日：2013-12-12

申请号：US13755928

申请日：2013-01-31

申请人： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Douglas Scott Price ,  Chris Y. Chung ,  Dazhong Zhang

发明人： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu ,  Douglas Scott Price ,  Chris Y. Chung ,  Dazhong Zhang

IPC分类号： H04N7/26

CPC分类号： H04N19/51 ,  H04N19/503

摘要： Video coders may perform perspective transformation of reference frames during coding in a manner that conserves processing resources. When a new input frame is available for coding, a camera position for the input frame may be estimated. A video coder may search for reference pictures having similar camera positions as the position of the input frame and, for each reference picture identified, the video coder may perform a prediction search to identify a reference picture that is the best prediction match for the input frame. Once the video coder identifies a reference picture to serve as a prediction source for the input frame, the video coder may derive a transform to match the reference frame data to the input frame data and may transform the reference picture accordingly. The video coder may code the input frame using the transformed reference picture as a prediction reference and may transmit coded frame data and the camera position of the input frame to a decoder. Thus, the video coder may perform derivation and execution of transforms on a limited basis which conserves system resources.

摘要翻译： 视频编码器可以在编码期间以保存处理资源的方式执行参考帧的透视变换。 当新的输入帧可用于编码时，可以估计用于输入帧的摄像机位置。 视频编码器可以搜索具有与输入帧的位置相似的相机位置的参考图像，并且对于识别的每个参考图像，视频编码器可以执行预测搜索以识别作为输入帧的最佳预测匹配的参考图像 。 一旦视频编码器识别用作输入帧的预测源的参考图像，则视频编码器可以导出将参考帧数据与输入帧数据相匹配的变换，并且可以相应地变换参考图像。 视频编码器可以使用变换的参考图片作为预测参考来对输入帧进行编码，并且可以将编码的帧数据和输入帧的摄像机位置发送到解码器。 因此，视频编码器可以在有限的基础上进行变换的推导和执行，从而节省系统资源。

公开(公告)号：US20120207212A1

公开(公告)日：2012-08-16

申请号：US13075282

申请日：2011-03-30

申请人： Yao-Chung Lin ,  Feng Yi ,  Xiaosong Zhou ,  Hsi-Jung Wu

发明人： Yao-Chung Lin ,  Feng Yi ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC分类号： H04N7/26

CPC分类号： H04N19/85 ,  H04N19/132 ,  H04N19/14 ,  H04N19/154 ,  H04N19/176 ,  H04N19/61

摘要： Selecting a coding mode for coding video data by measuring a distortion sensitivity threshold for a pixel block, calculating a distortion threshold representative of the maximum distortion that may be effectively masked by the brightness and texture of the pixel block, estimating the distortion induced by coding the pixel block according to skip mode and coding the source pixel block with a predictive coding technique if the estimated distortion value exceeds the distortion threshold. The distortion sensitivity threshold may include, for example, a brightness value or a texture value. The contrast between the pixel block and the surrounding pixel blocks may also be considered such that if the contrast exceeds a contrast threshold calculated based on the measurement of brightness and texture, the source pixel block may be coded with a predictive coding technique even if the estimated distortion value does not exceed the distortion threshold.

摘要翻译： 通过测量像素块的失真灵敏度阈值来选择用于编码视频数据的编码模式，计算代表由像素块的亮度和纹理有效地屏蔽的最大失真的失真阈值，估计由编码 像素块，并且如果估计的失真值超过失真阈值，则用预测编码技术对源像素块进行编码。 失真灵敏度阈值可以包括例如亮度值或纹理值。 还可以考虑像素块和周围像素块之间的对比度，使得如果对比度超过基于亮度和纹理的测量计算的对比阈值，则可以用预测编码技术对源像素块进行编码，即使估计 失真值不超过失真阈值。

公开(公告)号：US09232233B2

公开(公告)日：2016-01-05

申请号：US13175143

申请日：2011-07-01

申请人： Xiaosong Zhou ,  Hsi-Jung Wu ,  Yao-Chung Lin

发明人： Xiaosong Zhou ,  Hsi-Jung Wu ,  Yao-Chung Lin

IPC分类号： H04N7/32 ,  H04N19/58 ,  H04N19/196 ,  H04N19/105 ,  H04N19/139 ,  H04N19/172 ,  H04N19/46 ,  H04N19/61 ,  H04N19/109

CPC分类号： H04N19/58 ,  H04N19/105 ,  H04N19/109 ,  H04N19/139 ,  H04N19/172 ,  H04N19/197 ,  H04N19/46 ,  H04N19/61

摘要： In a video coding/decoding system, reference picture caches in a video coder and decoder may be partitioned dynamically based on camera and background motion can lead to improved coding efficiency and coding quality. When a camera is fixed and therefore exhibits low motion, a system may allocate larger portions of the reference picture cache to storage of long term reference frames. In this case, foreground elements of an image (for example, a person) may move in front of a relatively fixed background. Increasing the number of long term reference frames can increase the chances that, no matter where the foreground elements are within a frame currently being coded, the reference picture cache will contain at least one frame that provides an adequate prediction match to background elements within the new frame. Thus the background elements uncovered in the current frame can be coded at high quality with a low number of bits. When a camera exhibits high motion, the system may allocate larger portions of the reference picture cache to storage of short term reference frames.

摘要翻译： 在视频编码/解码系统中，视频编码器和解码器中的参考图像高速缓存可以基于相机进行动态分割，并且背景运动可以提高编码效率和编码质量。 当照相机固定并因此表现出低运动时，系统可以将较大部分的参考图像高速缓存分配给长期参考帧的存储。 在这种情况下，图像的前景元素（例如，人）可以在相对固定的背景之前移动。 增加长期参考帧的数量可以增加机会，无论前景元素在当前正被编码的帧内的何处，参考图像高速缓存将包含至少一个帧，其提供与新的背景元素内的足够的预测匹配 帧。 因此，当前帧中未覆盖的背景元素可以以低位数的高质量被编码。 当相机呈现高运动时，系统可以将较大部分的参考图像高速缓存分配给短期参考帧的存储。

公开(公告)号：US20120207214A1

公开(公告)日：2012-08-16

申请号：US13077803

申请日：2011-03-31

申请人： Xiaosong Zhou ,  Douglas Scott Price ,  Yao-Chung Lin ,  Hsi-Jung Wu

发明人： Xiaosong Zhou ,  Douglas Scott Price ,  Yao-Chung Lin ,  Hsi-Jung Wu

IPC分类号： H04N7/26

CPC分类号： H04N19/85 ,  H04N19/105 ,  H04N19/137 ,  H04N19/14 ,  H04N19/17 ,  H04N19/176 ,  H04N19/61 ,  H04N19/80

摘要： Video coding systems incorporate techniques for deriving scalars W and/or O for use in weighted prediction. W represents a scaling factor and O represents an offset value. Given a frame of input video to be coded, a prediction match may be established one or more reference frames. The input frame may be parsed into a plurality of regions. Thereafter the scaling factor W and/or offset value O may be derived by developing a system of equations relating a predicted pixel to the pixel in the frame by the scaling factor W and/or offset value O. Equations within the system may be prioritized according to priority among regions, and scaling factor W and/or offset value O may be solved for. The scaling factor W and/or offset value O may be used during weighted prediction of the input frame.

摘要翻译： 视频编码系统包括用于导出用于加权预测的标量W和/或O的技术。 W表示缩放因子，O表示偏移值。 给定要编码的输入视频的帧，可以建立一个或多个参考帧的预测匹配。 输入框可以被解析成多个区域。 此后，可以通过将预测像素与帧中的像素相关联的等式系数通过缩放因子W和/或偏移值O来开发来推定比例因子W和/或偏移值O.系统内的等式可以根据 在区域之间优先，并且可以求解缩放因子W和/或偏移值O. 缩放因子W和/或偏移值O可以在输入帧的加权预测期间使用。

公开(公告)号：US20120328018A1

公开(公告)日：2012-12-27

申请号：US13397291

申请日：2012-02-15

申请人： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu

发明人： Yao-Chung Lin ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC分类号： H04N7/32 ,  H04N7/26

CPC分类号： H04N19/573 ,  H04N19/105 ,  H04N19/14 ,  H04N19/51

摘要： A system and method for efficiently performing motion estimation during temporal prediction for coding. When a new frame is presented for coding, an encoder may identify a limited number of pixel blocks within the input frame that are complex. The encoder may perform motion estimation searches to find reference frame(s) that are adequate prediction references for the complex pixel blocks. The encoder may search for prediction references for the remaining pixel blocks of the new frame, confining the search to the reference frame(s) that were selected as prediction references of the complex pixel blocks.

摘要翻译： 一种用于在编码的时间预测期间有效执行运动估计的系统和方法。 当提供用于编码的新帧时，编码器可以识别输入帧内有限数量的复杂的像素块。 编码器可以执行运动估计搜索以找到作为复数像素块的足够的预测参考的参考帧。 编码器可以搜索新帧的剩余像素块的预测参考，将搜索限制为被选为复数像素块的预测参考的参考帧。

公开(公告)号：US09602819B2

公开(公告)日：2017-03-21

申请号：US13018339

申请日：2011-01-31

申请人： Hsi-Jung Wu ,  Xiaosong Zhou ,  Douglas Price

发明人： Hsi-Jung Wu ,  Xiaosong Zhou ,  Douglas Price

IPC分类号： H04N7/32 ,  H04N19/105 ,  H04N19/59 ,  H04N19/577

CPC分类号： H04N19/105 ,  H04N19/577 ,  H04N19/59

摘要： In a video coder/decoder system using variable resolution adaptation, decoder techniques provide a mechanism to changing resolution of coded lower-resolution video to a higher resolution for rendering. Coded video data of a low resolution frame may be decoded. A motion estimation search may be performed between the decoded low resolution frame and a cache of previously-stored high resolution video frames. If the motion estimation search generates one or more matches, high resolution video data of the decoded frame may generated as a derivation of matching data from the cached video frames.

公开(公告)号：US09215466B2

公开(公告)日：2015-12-15

申请号：US13018298

申请日：2011-01-31

申请人： Jiefu Zhai ,  Xiaosong Zhou ,  Hsi-Jung Wu

发明人： Jiefu Zhai ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC分类号： H04N7/32 ,  H04N19/156 ,  H04N19/61 ,  H04N19/126 ,  H04N19/146

CPC分类号： H04N19/156 ,  H04N19/126 ,  H04N19/146 ,  H04N19/61

摘要： A video coder employs techniques for applying frame rate adaptation and variable resolution adaptation in response to environmental coding factors present at the coding terminal. According to such techniques, a coder may estimate a coding quality level to be applied based on the environmental coding factors. The coder may retrieve from a controller table, settings for resolution and frame rate based on the estimated quality level. Optionally, the coder further may retrieve settings identifying a range of quantization parameters that may be used during coding. Prior to coding, the coder may configure input video data to match the resolution and frame rate settings retrieved from the controller table. Thereafter, the coder may code the reconfigured input video data by motion-compensation prediction constrained, as applicable, by the retrieved quantization parameter range.

摘要翻译： 视频编码器根据存在于编码终端处的环境编码因素，采用应用帧速率适配和可变分辨率自适应的技术。 根据这样的技术，编码器可以基于环境编码因素估计要应用的编码质量等级。 编码器可以根据估计的质量水平从控制器表检索分辨率和帧速率的设置。 可选地，编码器还可以检索识别可能在编码期间使用的量化参数的范围的设置。 在编码之前，编码器可以配置输入视频数据以匹配从控制器表检索的分辨率和帧率设置。 此后，编码器可以通过运动补偿预测约束（如适用）通过检索的量化参数范围对重新配置的输入视频数据进行编码。

公开(公告)号：US08964838B2

公开(公告)日：2015-02-24

申请号：US13175079

申请日：2011-07-01

申请人： Dazhong Zhang ,  Hsi-Jung Wu ,  Xiaosong Zhou

发明人： Dazhong Zhang ,  Hsi-Jung Wu ,  Xiaosong Zhou

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04N21/2343 ,  H04N21/2381 ,  H04N21/438 ,  H04N21/63 ,  H04N21/6583 ,  H04N19/61 ,  H04N19/37 ,  H04N19/157 ,  H04N19/166 ,  H04N19/89 ,  H04N19/31

CPC分类号： H04N21/234381 ,  H04N19/157 ,  H04N19/166 ,  H04N19/31 ,  H04N19/37 ,  H04N19/61 ,  H04N19/89 ,  H04N21/2381 ,  H04N21/4381 ,  H04N21/631 ,  H04N21/6583

摘要： A coding technique is disclosed in which frames of a video sequence are assigned to one of a plurality of sub-channels to be transmitted to a decoder. The frames are coded according to predictive coding techniques such that ordinarily prediction references of the frames in each sub-channel only reach the reference frames that occur within the same sub-channel. Thus, if transmission errors arise with respect to one sub-channel, decoding may occur for another sub-channel until the transmission error is detected and corrected.

摘要翻译： 公开了一种编码技术，其中将视频序列的帧分配给多个子信道之一以发送到解码器。 帧根据预测编码技术进行编码，使得每个子信道中的帧的通常预测参考仅到达发生在相同子信道内的参考帧。 因此，如果相对于一个子信道出现传输错误，则对于另一个子信道可能发生解码，直到检测和纠正传输错误。