公开(公告)号：US07173971B2

公开(公告)日：2007-02-06

申请号：US10299840

申请日：2002-11-20

Applicant: Foued Ben Amara ,  James Au ,  Ali Jerbi ,  Faouzi Kossentini

Inventor： Foued Ben Amara ,  James Au ,  Ali Jerbi ,  Faouzi Kossentini

IPC: H04B1/66

CPC classification number: H04N19/117 ,  H04N19/139 ,  H04N19/176 ,  H04N19/521

Abstract: A system and method is provided to avoid or otherwise reduce luminance and/or chrominance trailing artifacts in block-based hybrid video coders using multiple block sizes and shapes. The proposed trailing artifact avoidance approach has at its core three main components. The first component is a method to identify flat blocks in the source frame that are most susceptible to the appearance of trailing artifacts, and where flatness is determined according to several proposed criteria. The second component is a method to identify bad blocks, which refer to predicted blocks in motion estimation that correspond to flat blocks in the source frame and that contain trailing artifacts. The third component is a method to avoid trailing artifacts when they are detected within a bad block, and where the avoidance is achieved by employing one or more tools from among a proposed set of high fidelity coding tools and/or high performance motion estimation tools.

Abstract translation: 提供了一种系统和方法，以避免或以其他方式减少使用多个块大小和形状的基于块的混合视频编码器中的亮度和/或色度拖尾伪影。 所提出的拖尾假象避免方法在其核心的三个主要组成部分。 第一个组件是一种识别源框架中最容易出现拖尾伪影的平面块的方法，并且根据几个提出的标准来确定平坦度。 第二个组件是一种识别不良块的方法，它指的是运动估计中对应于源帧中的平坦块并包含尾随伪影的预测块。 第三组件是一种在坏块内检测到拖尾伪影的方法，并且通过在提出的一组高保真编码工具和/或高性能运动估计工具中采用一个或多个工具来实现避免。

公开(公告)号：US20050117646A1

公开(公告)日：2005-06-02

申请号：US10722474

申请日：2003-11-28

Applicant: Anthony Joch ,  Faouzi Kossentini

Inventor： Anthony Joch ,  Faouzi Kossentini

IPC: H04N7/12 ,  H04N7/36

CPC classification number: H04N19/51 ,  H04N19/573

Abstract: A method of motion vector prediction for use in differential motion vector coding within a block motion-compensation-based video coder. The video coder employs a generalized multiple reference picture buffer which may contain multiple reference pictures in both the forward and backward temporal direction from the current picture. For the purpose of coding selections of reference pictures within the buffer, the pictures are organized into two, potentially overlapping, lists of reference pictures. The prediction of a motion vector that selects a reference picture using a given reference picture list is not dependent upon any motion vectors that select their reference pictures using the other reference picture list. The values of spatially neighbouring motion vectors that use the same list of reference pictures as the notion vector being predicted are used for prediction, regardless of the relative temporal direction of the current and neighbouring motion vectors.

Abstract translation: 一种运动矢量预测方法，用于基于块运动补偿的视频编码器中的差分运动矢量编码。 视频编码器采用广义多参考图像缓冲器，其可以在当前图像的前后时间方向上包含多个参考图像。 为了对缓冲器内的参考图像的选择进行编码，将图像组织成参考图片的两个可能重叠的列表。 使用给定参考图片列表来选择参考图片的运动矢量的预测不依赖于使用另一参考图片列表选择它们的参考图片的任何运动矢量。 使用与正在预测的概念向量相同的参考图像列表的空间相邻运动矢量的值被用于预测，而不管当前和相邻运动矢量的相对时间方向如何。

公开(公告)号：US06876703B2

公开(公告)日：2005-04-05

申请号：US09842810

申请日：2001-04-27

Applicant: Ismaeil R. Ismaeil ,  Alen Docef ,  Faouzi Kossentini

Inventor： Ismaeil R. Ismaeil ,  Alen Docef ,  Faouzi Kossentini

IPC: H04N7/26 ,  H04N7/12

CPC classification number: H04N19/523 ,  H04N19/156 ,  H04N19/533 ,  H04N19/56

Abstract: A video coding method progressively refines a predicted motion vector to obtain an estimated motion vector. Subsequent steps are omitted if the estimated motion vector matches a current macroblock. Variable matching thresholds can permit dynamic adjustment of image quality and computational cost to optimize encoding performance for available computational resources. The method permits control of desired encoding speed and bit rate by adjusting encoding parameters. Video coders according to the invention may comprise a motion estimator, transform computer and coder each of which operates according to one or more parameters. A speed rate control and/or a bit rate control may adjust the parameters to maintain a desired encoding speed and output bit rate. A coder according to the invention may be implemented in software running on a general purpose computer. The method may be used in block-based video encoders including MPEG-2 and H.263 encoders.

Abstract translation: 视频编码方法逐渐优化预测运动矢量以获得估计运动矢量。 如果估计的运动矢量与当前宏块匹配，则忽略后续步骤。 可变匹配阈值可以允许动态调整图像质量和计算成本，以优化可用计算资源的编码性能。 该方法允许通过调整编码参数来控制所需的编码速度和比特率。 根据本发明的视频编码器可以包括运动估计器，变换计算机和编码器，每个编码器根据一个或多个参数进行操作。 速度控制和/或比特率控制可以调整参数以保持期望的编码速度和输出比特率。 根据本发明的编码器可以在通用计算机上运行的软件中实现。 该方法可以用于基于块的视频编码器，包括MPEG-2和H.263编码器。

公开(公告)号：US20120195367A1

公开(公告)日：2012-08-02

申请号：US13350243

申请日：2012-01-13

Applicant: Faouzi KOSSENTINI ,  Hassen GUERMAZI ,  Nader MAHDI ,  Mohamed Ali Ben AYED ,  Michael HOROWITZ

Inventor： Faouzi KOSSENTINI ,  Hassen GUERMAZI ,  Nader MAHDI ,  Mohamed Ali Ben AYED ,  Michael HOROWITZ

IPC: H04N7/26

CPC classification number: H04N19/82 ,  H04N19/117 ,  H04N19/147 ,  H04N19/46

Abstract: Disclosed are adaptive loop filtering techniques for video encoding and/or decoding. For a video unit, the encoder selects a set of predefined filters or generates a set of new filters, and places into the bitstream information identifying the set of predefined filters, or information defining the set of new filters. The set of filters may be used for loop filtering of at least one of the reconstructed samples of the video unit. At the decoder, a set of filters may be obtained by, decoding an index that identifies a set of predefined filters, or by decoding information related to a set of new filters. The obtained set of filters may be used for loop filtering of at least one decoded and reconstructed sample of the video unit.

Abstract translation: 公开了用于视频编码和/或解码的自适应环路滤波技术。 对于视频单元，编码器选择一组预定义的滤波器或者生成一组新的滤波器，并且将位置信息放入识别预定义滤波器集合的位流信息中，或定义新滤波器集合的信息。 滤波器组可以用于视频单元的至少一个重构样本的环路滤波。 在解码器中，可以通过解码标识一组预定义滤波器的索引，或通过解码与一组新滤波器相关的信息来获得一组滤波器。 所获得的滤波器组可以用于视频单元的至少一个解码和重构样本的环路滤波。

公开(公告)号：US20120134425A1

公开(公告)日：2012-05-31

申请号：US13286828

申请日：2011-11-01

Applicant: Faouzi Kossentini ,  Nader Mahdi ,  Mohamed-Ali Ben Ayed ,  Hassen Guermazi ,  Michael Horowitz

Inventor： Faouzi Kossentini ,  Nader Mahdi ,  Mohamed-Ali Ben Ayed ,  Hassen Guermazi ,  Michael Horowitz

IPC: H04N7/26

CPC classification number: H04N19/523 ,  H04N19/117 ,  H04N19/137 ,  H04N19/186 ,  H04N19/463

Abstract: Disclosed are techniques for adaptive interpolation filtering of luminance and chrominance samples in the context of motion compensation in video encoding or decoding. A two-dimensional interpolation filter of n×m coefficients may be separable, i.e., it may be separated into two one-dimensional filters with m and n coefficients, respectively. The bitstream may include, per video unit and sub-sample position, information indicating whether to use a newly-generated, a cached, or a default filter that may be a separable two-dimensional filter. The information may be structured in a way that takes advantage of the two-dimensional filter being separable. When a newly-generated filter is signalled, the bitstream may contain information pertaining to the characteristics of the newly-generated filter, such as its coefficients. A decoder may fetch this information from the bitstream to create the filters which are applied to samples of the video unit. An encoder may create a bitstream as described.

Abstract translation: 公开了用于在视频编码或解码中的运动补偿的上下文中的亮度和色度样本的自适应插值滤波的技术。 n×m个系数的二维内插滤波器可以是可分离的，即它可以分别分成具有m和n个系数的两个一维滤波器。 比特流可以包括每个视频单元和子样本位置，指示是否使用可能是可分离二维滤波器的新生成的，高速缓存的或默认滤波器的信息。 信息可以以利用二维过滤器可分离的方式构造。 当新产生的滤波器被通知时，比特流可以包含与新生成的滤波器的特性有关的信息，例如其系数。 解码器可以从比特流获取该信息以创建应用于视频单元的采样的滤波器。 编码器可以创建如所描述的比特流。

公开(公告)号：US20090034621A1

公开(公告)日：2009-02-05

申请号：US12172790

申请日：2008-07-14

Applicant: Anthony Joch ,  Faouzi Kossentini

Inventor： Anthony Joch ,  Faouzi Kossentini

IPC: H04N7/26

CPC classification number: H04N19/51 ,  H04N19/573

Abstract: A method of motion vector prediction for use in differential motion vector coding within a block motion-compensation-based video coder. The video coder employs a generalized multiple reference picture buffer which may contain multiple reference pictures in both the forward and backward temporal direction from the current picture. For the purpose of coding selections of reference pictures within the buffer, the pictures are organized into two, potentially overlapping, lists of reference pictures. The prediction of a motion vector that selects a reference picture using a given reference picture list is not dependent upon any motion vectors that select their reference pictures using the other reference picture list. The values of spatially neighbouring motion vectors that use the same list of reference pictures as the motion vector being predicted are used for prediction, regardless of the relative temporal direction of the current and neighbouring motion vectors.

Abstract translation: 一种运动矢量预测方法，用于基于块运动补偿的视频编码器中的差分运动矢量编码。 视频编码器采用广义多参考图像缓冲器，其可以在当前图像的前后时间方向上包含多个参考图像。 为了对缓冲器内的参考图像的选择进行编码，将图像组织成参考图片的两个可能重叠的列表。 使用给定参考图片列表来选择参考图片的运动矢量的预测不依赖于使用另一参考图片列表选择它们的参考图片的任何运动矢量。 使用与所预测的运动矢量相同的参考图像列表的空间相邻运动矢量的值被用于预测，而不管当前和相邻运动矢量的相对时间方向如何。

公开(公告)号：US07400681B2

公开(公告)日：2008-07-15

申请号：US10722474

申请日：2003-11-28

Applicant: Anthony Joch ,  Faouzi Kossentini

Inventor： Anthony Joch ,  Faouzi Kossentini

IPC: H04N7/18

CPC classification number: H04N19/51 ,  H04N19/573

Abstract: A method of motion vector prediction for use in differential motion vector coding within a block motion-compensation-based video coder. The video coder employs a generalized multiple reference picture buffer which may contain multiple reference pictures in both the forward and backward temporal direction from the current picture. For the purpose of coding selections of reference pictures within the buffer, the pictures are organized into two, potentially overlapping, lists of reference pictures. The prediction of a motion vector that selects a reference picture using a given reference picture list is not dependent upon any motion vectors that select their reference pictures using the other reference picture list. The values of spatially neighbouring motion vectors that use the same list of reference pictures as the notion vector being predicted are used for prediction, regardless of the relative temporal direction of the current and neighbouring motion vectors.

Abstract translation: 一种运动矢量预测方法，用于基于块运动补偿的视频编码器中的差分运动矢量编码。 视频编码器采用广义多参考图像缓冲器，其可以在当前图像的前后时间方向上包含多个参考图像。 为了对缓冲器内的参考图像的选择进行编码，将图像组织成参考图片的两个可能重叠的列表。 使用给定参考图片列表来选择参考图片的运动矢量的预测不依赖于使用另一参考图片列表选择它们的参考图片的任何运动矢量。 使用与正在预测的概念向量相同的参考图像列表的空间相邻运动矢量的值被用于预测，而不管当前和相邻运动矢量的相对时间方向如何。

公开(公告)号：US20230010681A1

公开(公告)日：2023-01-12

申请号：US17948204

申请日：2022-09-19

Applicant: Faouzi KOSSENTINI ,  Colton CHEUNG ,  Chanpreet MANN ,  Chekib NOUIRA

Inventor： Faouzi KOSSENTINI ,  Colton CHEUNG ,  Chanpreet MANN ,  Chekib NOUIRA

IPC: H04N19/127 ,  H04N19/124 ,  H04N19/136 ,  H04N19/42

Abstract: This disclosure describes systems, methods, and devices related to bit-rate-based hybrid encoding. A device may generate a list of encodes based on pairs of resolution and quantization parameters (QP) pairs associated with one or more video segments received from a source. The device may generate an estimated bit rate associated with the one or more video segments based on an analysis of the one or more video segments. The device may compare the estimated bit rate to a threshold. The device may switch between a software encoder and a hardware encoder based on the comparison of the estimated bit rate to the threshold. The device may encode each of the one or more video segments for transmission using the hardware encoder or the software encoder.

公开(公告)号：US5890102A

公开(公告)日：1999-03-30

申请号：US736191

申请日：1996-10-24

Applicant: Faouzi Kossentini ,  Mark J.T. Smith

Inventor： Faouzi Kossentini ,  Mark J.T. Smith

IPC: G06T9/00 ,  H04N7/26 ,  H04N7/28 ,  H04N7/12

CPC classification number: H04N19/94 ,  H04N19/147 ,  H04N19/186 ,  H04N19/10 ,  H04N19/115 ,  H04N19/13 ,  H04N19/146 ,  H04N19/61 ,  H04N19/63

Abstract: A subband coder with jointly optimized multistage residual quantizers and entropy coders for image coding which allows the subband coder to exploit both linear and non-linear dependencies that may exist within and across the subbands. Both inter- and intra-band dependencies are simultaneously exploited via jointly optimizing the subband coders and entropy coders in an entropy constrained optimization framework involving rate, distortion and complexity. The multistage quantization structure and the effectiveness of the statistical modeling algorithm results in an attractive balance among reproduction quality, rate and complexity.

Abstract translation: 具有共同优化的多级残余量化器和用于图像编码的熵编码器的子带编码器，其允许子带编码器利用可能存在于子带内和跨子带的线性和非线性依赖性。 通过在涉及速率，失真和复杂度的熵约束优化框架中共同优化子带编码器和熵编码器来同时利用带内和带内依赖性。 多级量化结构和统计建模算法的有效性导致了再现质量，速度和复杂度之间的有吸引力的平衡。

公开(公告)号：US20230027742A1

公开(公告)日：2023-01-26

申请号：US17955443

申请日：2022-09-28

Applicant: Faouzi KOSSENTINI ,  Chekib NOUIRA

Inventor： Faouzi KOSSENTINI ,  Chekib NOUIRA

IPC: H04N19/124 ,  H04N19/154 ,  H04N19/146

Abstract: This disclosure describes systems, methods, and devices related to complexity aware encoding. A device may generate a list of encodes based on pairs of resolution and quantization parameters (QP) pairs associated with one or more video segments received from a source. The device may generate an estimated bit rate associated with the one or more video segments based on an analysis of the one or more video segments. The device may determine distortion values associated with the one or more video segments. The device may apply a weighting mechanism to the distortion values using the estimated bit rate. The device may select a subset of encodes based on the weighting mechanism. The device may perform the subset of encodes on the one or more video segments for transmission.