公开(公告)号：US10979703B2

公开(公告)日：2021-04-13

申请号：US13991606

申请日：2012-06-15

Applicant: Lidong Xu ,  Wenhao Zhang ,  Yi-Jen Chiu ,  Hong Jiang ,  Yu Han

Inventor： Lidong Xu ,  Wenhao Zhang ,  Yi-Jen Chiu ,  Hong Jiang ,  Yu Han

IPC: H04N19/66 ,  H04N19/105 ,  H04N19/187 ,  H04N19/117 ,  H04N19/136 ,  H04N19/172 ,  H04N19/176 ,  H04N19/182 ,  H04N19/154 ,  H04N19/463 ,  H04N19/33

Abstract: In a scalable video codec, an adaptive Wiener filter with offset aims to minimize the differences between two input pictures or picture regions, and the filter coefficients need to be transmitted to decoder site.

公开(公告)号：US09591326B2

公开(公告)日：2017-03-07

申请号：US13638628

申请日：2010-03-31

Applicant: Lidong Xu ,  Yi-Jen Chiu ,  Hong Jiang

Inventor： Lidong Xu ,  Yi-Jen Chiu ,  Hong Jiang

IPC: H04N19/53 ,  H04N19/30 ,  H04N19/187 ,  H04N19/37 ,  H04N19/33 ,  H04N19/57 ,  H04N19/105 ,  H04N19/174 ,  H04N19/61 ,  H04N19/176 ,  H04N19/573 ,  H04N19/109

CPC classification number: H04N19/53 ,  H04N19/105 ,  H04N19/109 ,  H04N19/174 ,  H04N19/176 ,  H04N19/187 ,  H04N19/30 ,  H04N19/33 ,  H04N19/37 ,  H04N19/57 ,  H04N19/573 ,  H04N19/61

Abstract: Adaptive control can use hierarchical motion estimation (HME) and/or multiple reference motion estimation (MRME) for the motion estimation of current encoding blocks. Both HME and MRME are allowed in the motion estimation to achieve a high coding gain. Control consists of slice level control and macro-block (MB) level control. A slice is one or more contiguous macroblocks. In slice level control, it is decided to use only one reference frame or use multiple reference frames to coding current slice based on the motion vectors obtained in coarse level motion estimation. In MB level control, it is decided to perform MRME or perform HME for the MB and its subblocks based on the coarse level motion vectors of the MB.

Abstract translation: 自适应控制可以对当前编码块的运动估计使用分层运动估计（HME）和/或多参考运动估计（MRME）。 在运动估计中允许HME和MRME两者实现高编码增益。 控制由片级控制和宏块（MB）级控制组成。 切片是一个或多个连续的宏块。 在片级控制中，决定仅使用一个参考帧或者使用多个参考帧来基于在粗略级运动估计中获得的运动矢量对当前片进行编码。 在MB级别控制中，决定执行MRME或基于MB的粗略级别运动向量对MB及其子块执行HME。

公开(公告)号：US20160073126A1

公开(公告)日：2016-03-10

申请号：US14782593

申请日：2013-12-23

Applicant: Wenhao ZHANG ,  Yi-jen CHIU ,  Lidong XU ,  Yu HAN ,  Zhipin DENG ,  Xiaoxia CAI ,  INTEL CORPORATION

Inventor： WENHAO ZHANG ,  YI-JEN CHIU ,  LIDONG XU ,  YU HAN ,  ZHIPIN DENG ,  XIAOXIA CAI

IPC: H04N19/51 ,  H04N19/187 ,  H04N19/176

CPC classification number: H04N19/51 ,  H04N19/103 ,  H04N19/157 ,  H04N19/176 ,  H04N19/187 ,  H04N19/19 ,  H04N19/30 ,  H04N19/50 ,  H04N19/61

Abstract: Techniques for inter-layer residual prediction are described. In one embodiment, for example, an apparatus may comprise an encoding component to determine whether a predicted motion for an enhancement layer block is consistent with a predicted motion for a collocated lower-layer block, determine whether to apply inter-layer residual prediction to the enhancement layer block based on whether the predicted motion for the enhancement layer block is consistent with the predicted motion for the collocated lower-layer block, and in response to a determination that inter-layer residual prediction is to be applied to the enhancement layer block, generate a predicted residual for the enhancement layer block based on a residual for the collocated lower-layer block and generate a second-order residual for the enhancement layer block by comparing a calculated residual to the predicted residual. Other embodiments are described and claimed.

Abstract translation: 描述了层间残差预测技术。 在一个实施例中，例如，设备可以包括编码组件，以确定增强层块的预测运动是否与并置的下层块的预测运动一致，确定是否将层间残差预测应用于 增强层块基于增强层块的预测运动是否与所配置的下层块的预测运动一致，并且响应于将层间残差预测应用于增强层块的确定， 基于所配置的下层块的残差生成用于增强层块的预测残差，并通过将计算出的残差与预测残差进行比较来生成增强层块的二阶残差。 描述和要求保护其他实施例。

公开(公告)号：US20150163499A1

公开(公告)日：2015-06-11

申请号：US13996577

申请日：2012-09-28

Applicant: Wenhao Zhang ,  Yi-Jen Chiu ,  Lidong Xu ,  Yu Han ,  Zhipin Deng ,  Xiaoxia Cai

Inventor： Wenhao Zhang ,  Yi-Jen Chiu ,  Lidong Xu ,  Yu Han ,  Zhipin Deng ,  Xiaoxia Cai

IPC: H04N19/187 ,  H04N19/50 ,  H04N19/147 ,  H04N19/117 ,  H04N19/176 ,  H04N19/103

CPC classification number: H04N19/187 ,  H04N19/103 ,  H04N19/117 ,  H04N19/147 ,  H04N19/176 ,  H04N19/30 ,  H04N19/463 ,  H04N19/50 ,  H04N19/59 ,  H04N19/61

Abstract: Systems, devices and methods are described including performing scalable video coding using inter-layer residual prediction, inter-layer residual prediction in an enhancement layer coding unit, prediction unit, or transform unit may use residual data obtained from a base layer or from a lower enhancement layer. The residual may be subjected to upsample filtering and/or refinement filtering. The upsample or refinement filter coefficients may be predetermined or may be adoptively determined.

Abstract translation: 描述了使用层间残差预测执行可分级视频编码，增强层编码单元中的层间残差预测，预测单元或变换单元的系统，设备和方法可以使用从基本层或从下层获得的残差数据 增强层。 残余物可以进行上采样过滤和/或细化过滤。 上采样或细化滤波器系数可以是预定的或可以被过度确定。

公开(公告)号：US20140219347A1

公开(公告)日：2014-08-07

申请号：US14244411

申请日：2014-04-03

Applicant: Lidong Xu ,  Yi-Jen Chiu ,  Yu Han ,  Wenhao Zhang

Inventor： Lidong Xu ,  Yi-Jen Chiu ,  Yu Han ,  Wenhao Zhang

IPC: H04N19/61

CPC classification number: H04N19/105 ,  H04N19/117 ,  H04N19/159 ,  H04N19/176 ,  H04N19/186 ,  H04N19/61

Abstract: Systems, apparatus and methods are described including determining a prediction residual for a channel of video data; and determining, using the first channel's prediction residual, a prediction residual for a second channel of the video data. Further, a prediction residual for a third channel of the video data may be determined using the second channel's prediction residual.

Abstract translation: 描述了系统，装置和方法，包括确定视频数据的信道的预测残差; 以及使用所述第一信道的预测残差来确定所述视频数据的第二信道的预测残差。 此外，可以使用第二信道的预测残差来确定视频数据的第三信道的预测残差。

公开(公告)号：US20140086304A1

公开(公告)日：2014-03-27

申请号：US13991592

申请日：2012-09-24

Applicant: Lidong Xu ,  Yi-Jen Chiu ,  Wenhao Zhang ,  Hong Jiang

Inventor： Lidong Xu ,  Yi-Jen Chiu ,  Wenhao Zhang ,  Hong Jiang

IPC: H04N7/26

CPC classification number: H04N19/117 ,  H04N19/136 ,  H04N19/147 ,  H04N19/186 ,  H04N19/46 ,  H04N19/61 ,  H04N19/82

Abstract: Reconstructed picture quality for a video codec system may be improved by categorizing reconstructed pixels into different histogram bins with histogram segmentation and then applying different filters on different bins. Histogram segmentation may be performed by averagely dividing the histogram into M bins or adaptively dividing the histogram into N bins based on the histogram characteristics. Here M and N may be a predefined, fixed, non-negative integer value or an adaptively generated value at encoder side and may be sent to decoder through the coded bitstream.

Abstract translation: 通过将重建的像素分类为具有直方图分割的不同的直方图箱，然后在不同的箱上应用不同的过滤器，可以改进用于视频编解码器系统的重构图像质量。 直方图分割可以通过将直方图平均地划分成M个箱或者基于直方图特征将直方图自适应地划分成N个箱来执行。 这里M和N可以是编码器侧的预定义的，固定的，非负整数值或自适应产生的值，并且可以通过编码比特流发送到解码器。

公开(公告)号：US20110002389A1

公开(公告)日：2011-01-06

申请号：US12566823

申请日：2009-09-25

Applicant: Lidong Xu ,  Yi-Jen Chiu ,  Wenhao Zhang

Inventor： Lidong Xu ,  Yi-Jen Chiu ,  Wenhao Zhang

IPC: H04N7/26

CPC classification number: H04N19/577 ,  H04N19/103 ,  H04N19/137 ,  H04N19/139 ,  H04N19/172 ,  H04N19/44 ,  H04N19/513 ,  H04N19/52 ,  H04N19/57 ,  H04N19/573 ,  H04N19/61

Abstract: Methods and systems to apply motion estimation (ME) based on reconstructed reference pictures in a B frame or in a P frame at a video decoder. For a P frame, projective ME may be performed to obtain a motion vector (MV) for a current input block. In a B frame, both projective ME and mirror ME may be performed to obtain an MV for the current input block. The ME process can be performed on sub-partitions of the input block, which may reduce the prediction error without increasing the amount of MV information in the bitstream. Decoder-side ME can be applied for the prediction of existing inter frame coding modes, and traditional ME or the decoder-side ME can be adaptively selected to predict a coding mode based on a rate distribution optimization (RDO) criterion.

Abstract translation: 基于在B帧或视频解码器的P帧中的重建参考图像应用运动估计（ME）的方法和系统。 对于P帧，可以执行投影ME以获得当前输入块的运动矢量（MV）。 在B帧中，可以执行投射ME和镜ME两者以获得当前输入块的MV。 可以在输入块的子分区上执行ME处理，这可以在不增加比特流中的MV信息的量的情况下减少预测误差。 解码器端ME可以应用于现有的帧间编码模式的预测，并且传统的ME或解码器侧的ME可以被自适应地选择以基于速率分布优化（RDO）准则来预测编码模式。

公开(公告)号：US20110002387A1

公开(公告)日：2011-01-06

申请号：US12657168

申请日：2010-01-14

Applicant: Yi-Jen Chiu ,  Lidong Xu ,  Wenhao Zhang

Inventor： Yi-Jen Chiu ,  Lidong Xu ,  Wenhao Zhang

IPC: H04N7/26

CPC classification number: H04N19/57 ,  H04N19/44 ,  H04N19/61

Abstract: Techniques are described that can be used to apply motion estimation (ME) based on reconstructed reference pictures in a B frame or in a P frame at a video decoder. For a P frame, projective ME may be performed to obtain a motion vector (MV) for a current input block. In a B frame, both projective ME and mirror ME may be performed to obtain an MV for the current input block. A metric an be used determining a metric for each pair of MV0 and MV1 that is found in the search path, where the metric is based on a combination of a first, second, and third metrics. The first metric is based on temporal frame correlation, a second metric is based on spatial neighbors of the reference blocks, and a third metric is based on the spatial neighbors of the current block.

Abstract translation: 描述了可以用于基于B帧中的重建参考图像或视频解码器的P帧中的运动估计（ME）来应用的技术。 对于P帧，可以执行投影ME以获得当前输入块的运动矢量（MV）。 在B帧中，可以执行投射ME和镜ME两者以获得当前输入块的MV。 用于确定在搜索路径中找到的每对MV0和MV1的度量的度量，其中度量基于第一，第二和第三度量的组合。 第一度量基于时间帧相关，第二度量基于参考块的空间邻居，并且第三度量基于当前块的空间邻居。

公开(公告)号：US20100254448A1

公开(公告)日：2010-10-07

申请号：US12418804

申请日：2009-04-06

Applicant: Lidong Xu ,  Yi-Jen Chu ,  Wenhao Zhang

Inventor： Lidong Xu ,  Yi-Jen Chu ,  Wenhao Zhang

IPC: H04N7/12

CPC classification number: H04N19/00551 ,  H04N19/117 ,  H04N19/136 ,  H04N19/147 ,  H04N19/157 ,  H04N19/46 ,  H04N19/463 ,  H04N19/61 ,  H04N19/70 ,  H04N19/82 ,  H04N19/86 ,  H04N19/91 ,  H04N19/96

Abstract: An adaptive Wiener filter may be applied to improve coding efficiency because of information lost during quantization of the video encoding process. The Wiener filter may be selectively applied globally to an entire picture or locally to portions of the picture. Histogram segmentation may be used to select pixels for Wiener filtering in some embodiments. The Wiener filter may be adaptively applied to histogram bins, improving coding efficiency in some cases.

Abstract translation: 可以应用自适应维纳滤波器来提高编码效率，因为在视频编码处理的量化期间信息丢失。 Wiener滤波器可以全局地选择性地应用于整个图像，或者局部地应用于图像的一部分。 在一些实施例中，直方图分割可用于选择维纳滤波的像素。 维纳滤波器可以自适应地应用于直方图盒，在一些情况下提高编码效率。

公开(公告)号：US20100008417A1

公开(公告)日：2010-01-14

申请号：US12217805

申请日：2008-07-09

Applicant: Lidong Xu ,  Yi-Jen Chiu

Inventor： Lidong Xu ,  Yi-Jen Chiu

IPC: H04B1/66

CPC classification number: H04N19/82 ,  H04N19/117 ,  H04N19/147 ,  H04N19/17 ,  H04N19/46 ,  H04N19/61

Abstract: Techniques are described that can be used to determine parameters of an adaptive Wiener filter to apply to a video region. The following parameters of the Wiener filter may be adjusted: coefficients, coefficient quantization, filter type, filter size, prediction mode, entropy encoding, and number of filter tables. The parameters associated with the lowest rate distortion cost of the encoder are selected for transmission with the encoded video. If not using adaptive Wiener filtering results in a lowest rate distortion cost, then adaptive Wiener filtering is not used for the video region. If using adaptive Wiener filtering results in a lowest rate distortion cost, then the parameters applied by the adaptive Wiener filtering that result in the lowest rate distortion cost are communicated with the filtered video region.

Abstract translation: 描述了可以用于确定适用于视频区域的自适应维纳滤波器的参数的技术。 可以调整维纳滤波器的以下参数：系数，系数量化，滤波器类型，滤波器大小，预测模式，熵编码和滤波器表数。 选择与编码器的最低速率失真成本相关联的参数以便与编码视频一起传输。 如果不使用自适应维纳滤波导致最低速率失真成本，则视频区域不使用自适应维纳滤波。 如果使用自适应维纳滤波导致最低速率失真成本，则导致最低速率失真成本的自适应维纳滤波所应用的参数与滤波视频区域通信。