公开(公告)号：US09066108B2

公开(公告)日：2015-06-23

申请号：US13452364

申请日：2012-04-20

申请人： Michael Tok ,  Alexander Glantz ,  Andreas Krutz ,  Thomas Sikora

发明人： Michael Tok ,  Alexander Glantz ,  Andreas Krutz ,  Thomas Sikora

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  G06K9/00 ,  H04N19/54 ,  H04N19/52 ,  H04N19/61

CPC分类号： H04N19/54 ,  H04N19/52 ,  H04N19/61

摘要： Parametric Motion Vector Prediction (PMVP) methodologies and components and systems for performing those methodologies are provided to more effectively and efficiently encode video content that includes complex motion such as zoom or rotation. By substituting the PMVP for a collocated MVP used in HEVC in order to reduce the amount of bit rate increase required when including the PMVP analysis in the bit stream. Further, compression of the motion vectors is provided in a three stage approach based on transformation, quantization and difference coding.

摘要翻译： 提供了用于执行这些方法的参数运动矢量预测（PMVP）方法和组件和系统，以更有效和高效地编码包括复杂运动（例如缩放或旋转）的视频内容。 通过将PMVP替换为在HEVC中使用的并置MVP，以便在将PMVP分析包括在比特流中时所需的比特率增加量减少。 此外，基于变换，量化和差分编码的三阶段方法提供运动矢量的压缩。

公开(公告)号：US20130016784A1

公开(公告)日：2013-01-17

申请号：US13182900

申请日：2011-07-14

申请人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

发明人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

IPC分类号： G06K9/00 ,  H04N7/32

CPC分类号： G06T7/20 ,  G06T2207/10016 ,  G06T2207/20182 ,  G06T2207/30241

摘要： The present invention inter alia relates to a method for processing the pixel value of at least one image pixel contained in a current frame of a video sequence, said method comprising the steps of constructing an individual motion trajectory comprising motion-shifted versions of the at least one image pixel over a plurality of preceding and/or subsequent frames, and processing the pixel value based on the individual motion trajectory, wherein said step of constructing said individual motion trajectory comprises the steps of: choosing the at least one image pixel of the current frame as a start pixel of the individual motion trajectory, and adding motion-shifted versions of the at least one image pixel of preceding and/or subsequent frames to the individual motion trajectory; wherein for each of the plurality of preceding and/or subsequent frames, at least two motion-shifted versions of the at least one image pixel are determined, wherein, for each of the plurality of preceding and/or subsequent frames, one of said at least two motion-shifted versions of the at least one image pixel is selected and wherein the selected motion-shifted version is added to the individual motion trajectory.

摘要翻译： 本发明尤其涉及一种用于处理包含在视频序列的当前帧中的至少一个图像像素的像素值的方法，所述方法包括以下步骤：构建单独的运动轨迹，该运动轨迹包括至少一个运动偏移版本 在多个先前和/或后续帧上的一个图像像素，并且基于各个运动轨迹来处理像素值，其中构建所述单个运动轨迹的所述步骤包括以下步骤：选择当前的至少一个图像像素 帧作为所述单独运动轨迹的开始像素，以及将前一帧和/或后续帧的至少一个图像像素的运动移位版本添加到所述单独运动轨迹; 其中对于所述多个先前和/或后续帧中的每一个，确定所述至少一个图像像素的至少两个运动移位版本，其中，对于所述多个先前帧和/或后续帧中的每一个，所述至少一个 选择至少一个图像像素的至少两个移动版本，并且其中所选择的运动移位版本被添加到各个运动轨迹。

公开(公告)号：US08958478B2

公开(公告)日：2015-02-17

申请号：US12960431

申请日：2010-12-03

申请人： Marko Esche ,  Andreas Krutz ,  Alexander Glantz ,  Thomas Sikora

发明人： Marko Esche ,  Andreas Krutz ,  Alexander Glantz ,  Thomas Sikora

IPC分类号： H04N5/14 ,  H04N19/82 ,  H04N19/117 ,  H04N19/137 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182 ,  H04N19/189

CPC分类号： H04N7/26382 ,  H04N19/117 ,  H04N19/137 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182 ,  H04N19/46 ,  H04N19/82

摘要： Method and device for processing pixels contained in a video sequence including processing the pixel amplitude of at least one Image pixel contained in a current frame of a video sequence. The method includes the steps of constructing an individual motion trajectory including motion-shifted versions of the image pixel over a plurality of neighboring frames, and processing the pixel amplitude based on the individual motion trajectory. The step of the constructing the individual motion trajectory includes the steps of choosing at least one image pixel of the current frame as a start pixel of the individual motion trajectory, and adding motion-shifted versions of the image pixel of preceding find/or subsequent frames to the individual motion trajectory.

摘要翻译： 用于处理包含在视频序列中的像素的方法和装置，包括处理包含在视频序列的当前帧中的至少一个Image像素的像素幅度。 该方法包括以下步骤：构建包括多个相邻帧上的图像像素的运动移动版本的单独运动轨迹，以及基于各个运动轨迹来处理像素幅度。 构建单个运动轨迹的步骤包括以下步骤：选择当前帧的至少一个图像像素作为单个运动轨迹的开始像素，并且添加先前查找/或后续帧的图像像素的运动移位版本 到个人运动轨迹。

公开(公告)号：US20120294362A1

公开(公告)日：2012-11-22

申请号：US13504730

申请日：2010-10-28

申请人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

发明人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

IPC分类号： H04N7/32

CPC分类号： H04N19/573 ,  H04N19/527 ,  H04N19/82 ,  H04N19/86

摘要： The present invention relates inter alia to a method for processing an encoded video sequence, said method comprising the steps of: —reconstructing the encoded video sequence and providing a plurality of neighboring pictures; —transforming each of said neighboring pictures or at least a coherent region of each neighboring picture into the coordinate system of a reference picture based on a motion model, and thereby generating a picture stack comprising transformed pictures; —combining the pixel amplitudes of corresponding pixels of said transformed pictures using a weighting function, to form a processed pixel amplitude for at least one image pixel of the reference picture; and —generating a processed picture based on said at least one processed pixel amplitude of said image pixel.

摘要翻译： 本发明尤其涉及一种用于处理编码视频序列的方法，所述方法包括以下步骤： - 重构所编码的视频序列并提供多个相邻图像; 基于运动模型将每个相邻图像或每个相邻图像的至少一个相干区域转换成参考图像的坐标系，从而生成包括变换图像的图像堆栈; - 使用加权函数组合所述变换图像的相应像素的像素幅度，以形成用于参考图像的至少一个图像像素的经处理的像素幅度; 以及 - 基于所述图像像素的所述至少一个处理的像素幅度生成经处理的图像。

公开(公告)号：US20120140826A1

公开(公告)日：2012-06-07

申请号：US12960431

申请日：2010-12-03

申请人： Marco ESCHE ,  Andreas Krutz ,  Alexander Glantz ,  Thomas Sikora

发明人： Marco ESCHE ,  Andreas Krutz ,  Alexander Glantz ,  Thomas Sikora

IPC分类号： H04N5/14 ,  H04N7/32

CPC分类号： H04N7/26382 ,  H04N19/117 ,  H04N19/137 ,  H04N19/139 ,  H04N19/176 ,  H04N19/182 ,  H04N19/46 ,  H04N19/82

摘要： An embodiment of the present invention relates to a method for processing the pixel amplitude of at least one image pixel contained in a current frame of a video sequence, said method comprising the steps of constructing an individual motion trajectory comprising motion-shifted versions of the at least one image pixel over a plurality of neighboring frames, and processing the pixel amplitude based on the individual motion trajectory; wherein said step of constructing said individual motion trajectory comprises the steps of: choosing the at least one image pixel of the current frame as a start pixel of the individual motion trajectory, and adding motion-shifted versions of the at least one image pixel of preceding and/or subsequent frames to the individual motion trajectory, wherein for each motion-shifted version to be added, it is determined whether a difference value, which indicates the change of the pixel amplitude of the respective motion-shifted version between consecutive frames, is smaller than an amplitude threshold value, which is individually assigned to the current frame or a frame portion of the current frame comprising said at least one image pixel, and wherein said step of adding further motion-shifted versions is stopped if said difference value exceeds said amplitude threshold value.

摘要翻译： 本发明的实施例涉及一种用于处理包含在视频序列的当前帧中的至少一个图像像素的像素幅度的方法，所述方法包括以下步骤：构建单独的运动轨迹，该运动轨迹包括运动位移版本的at 在多个相邻帧上的至少一个图像像素，并且基于所述各个运动轨迹来处理所述像素幅度; 其中构建所述单独运动轨迹的所述步骤包括以下步骤：选择所述当前帧的所述至少一个图像像素作为所述单独运动轨迹的起始像素，以及将所述至少一个图像像素的运动移位版本 和/或随后的帧到每个运动轨迹，其中对于要添加的每个运动移位版本，确定指示连续帧之间的相应移动版本的像素幅度的变化的差值是否是 小于幅度阈值，其被单独分配给当前帧或包括所述至少一个图像像素的当前帧的帧部分，并且其中如果所述差值超过所述至少一个图像像素，则停止添加另外的运动移位版本的步骤 振幅阈值。

公开(公告)号：US09445119B2

公开(公告)日：2016-09-13

申请号：US13504730

申请日：2010-10-28

申请人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

发明人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

IPC分类号： H04B1/66 ,  H04N7/12 ,  H04N11/02 ,  H04N11/04 ,  H04N19/573 ,  H04N19/82 ,  H04N19/527 ,  H04N19/86

CPC分类号： H04N19/573 ,  H04N19/527 ,  H04N19/82 ,  H04N19/86

摘要： The present invention relates inter alia to a method for processing an encoded video sequence, said method comprising the steps of: —reconstructing the encoded video sequence and providing a plurality of neighboring pictures; —transforming each of said neighboring pictures or at least a coherent region of each neighboring picture into the coordinate system of a reference picture based on a motion model, and thereby generating a picture stack comprising transformed pictures; —combining the pixel amplitudes of corresponding pixels of said transformed pictures using a weighting function, to form a processed pixel amplitude for at least one image pixel of the reference picture; and —generating a processed picture based on said at least one processed pixel amplitude of said image pixel.

摘要翻译： 本发明尤其涉及一种用于处理编码视频序列的方法，所述方法包括以下步骤： - 重构所编码的视频序列并提供多个相邻图像; 基于运动模型将每个相邻图像或每个相邻图像的至少一个相干区域转换成参考图像的坐标系，从而生成包括变换图像的图像堆栈; - 使用加权函数组合所述变换图像的相应像素的像素幅度，以形成用于参考图像的至少一个图像像素的经处理的像素幅度; 以及 - 基于所述图像像素的所述至少一个处理的像素幅度生成经处理的图像。

公开(公告)号：US09159139B2

公开(公告)日：2015-10-13

申请号：US13182900

申请日：2011-07-14

申请人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

发明人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

IPC分类号： G06T7/20

CPC分类号： G06T7/20 ,  G06T2207/10016 ,  G06T2207/20182 ,  G06T2207/30241

摘要： Processing the pixel value of at least one image pixel contained in a current frame of a video sequence includes constructing an individual motion trajectory including motion-shifted versions of the at least one image pixel over a plurality of preceding and/or subsequent frames, and processing the pixel value based on the individual motion trajectory. Constructing the individual motion trajectory includes choosing the at least one image pixel of the current frame as a start pixel of the individual motion trajectory, and adding motion-shifted versions of the at least one image pixel of preceding and/or subsequent frames to the individual motion trajectory. For each of the plurality of preceding and/or subsequent frames, at least two motion-shifted versions of the at least one image pixel are determined, and one of the at least two motion-shifted versions of the at least one image pixel is selected and added to the individual motion trajectory.

摘要翻译： 处理包含在视频序列的当前帧中的至少一个图像像素的像素值包括在多个先前和/或后续帧上构建包括至少一个图像像素的运动移位版本的单独运动轨迹，并且处理 基于各个运动轨迹的像素值。 构建个体运动轨迹包括选择当前帧的至少一个图像像素作为单个运动轨迹的起始像素，以及将先前和/或后续帧的至少一个图像像素的运动移位版本添加到个体 运动轨迹。 对于多个先前和/或后续帧中的每一个，确定至少一个图像像素的至少两个运动移动版本，并且选择至少一个图像像素的至少两个移动版本中的一个 并添加到单个运动轨迹。

公开(公告)号：US08743962B2

公开(公告)日：2014-06-03

申请号：US13038239

申请日：2011-03-01

申请人： Andreas Krutz ,  Alexander Glantz ,  Thomas Sikora

发明人： Andreas Krutz ,  Alexander Glantz ,  Thomas Sikora

IPC分类号： H04N7/12 ,  H04N11/02 ,  H04N11/04

CPC分类号： H04N19/537 ,  H04N19/46 ,  H04N19/513 ,  H04N19/56

摘要： An embodiment of the invention relates to a method for providing a compressed video bitstream related to consecutive pictures of a video sequence, wherein the pictures are defined by pixels, said method comprising the steps of: (a) applying at least one higher-order motion model to a motion vector field and generating at least one higher-order motion parameter set for said motion vector field, wherein said motion vector field comprises a plurality of first motion vectors, each first motion vector being assigned to a pixel block and describing the local displacement of the pixel block from the preceding picture to the consecutive picture, and wherein each pixel block comprises a plurality of pixels; (b) calculating a second motion vector for each pixel block based on the higher-order motion parameter set; (c) calculating the deviation between the first motion vector and the second motion vector for each pixel block; and (d) generating a video bitstream comprising the higher-order motion parameter set, and for each pixel block an information which indicates or is based on the deviation calculated in step (c).

摘要翻译： 本发明的实施例涉及一种用于提供与视频序列的连续图像相关的压缩视频比特流的方法，其中图像由像素定义，所述方法包括以下步骤：（a）应用至少一个高阶运动 模型到运动矢量场并且为所述运动矢量场生成至少一个高阶运动参数集合，其中所述运动矢量场包括多个第一运动矢量，每个第一运动矢量分配给像素块并描述局部 将像素块从前一图像移位到连续图像，并且其中每个像素块包括多个像素; （b）基于所述高阶运动参数集计算每个像素块的第二运动矢量; （c）计算每个像素块的第一运动矢量与第二运动矢量之间的偏差; 以及（d）生成包括所述高阶运动参数集的视频比特流，以及针对每个像素块，指示或者基于步骤（c）中计算出的偏差的信息。

公开(公告)号：US09363534B2

公开(公告)日：2016-06-07

申请号：US13504739

申请日：2010-10-28

申请人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

发明人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

IPC分类号： H04N19/117 ,  H04N19/182 ,  H04N19/82 ,  H04N19/86 ,  H04N19/597 ,  H04N19/159 ,  H04N19/172 ,  H04N19/46 ,  H04N19/61

CPC分类号： H04N19/521 ,  H04N19/117 ,  H04N19/159 ,  H04N19/172 ,  H04N19/182 ,  H04N19/46 ,  H04N19/597 ,  H04N19/61 ,  H04N19/82 ,  H04N19/86

摘要： An embodiment of the invention relates to a method for processing the pixel amplitude of at least one block image pixel contained in a video sequence, said method comprising the steps of: —constructing an individual motion trajectory comprising motion-shifted versions of said block image pixel over a multiplicity of neighboring frames; and—combining the pixel amplitudes of the motion-shifted versions of said block image pixel along the individual motion trajectory using a weighting function, to form a processed pixel amplitude of said image pixel.

摘要翻译： 本发明的实施例涉及一种用于处理包含在视频序列中的至少一个块图像像素的像素幅度的方法，所述方法包括以下步骤： - 构建包括所述块图像像素的运动移位版本的单独运动轨迹 在多个相邻帧上; 以及使用加权函数来组合所述块图像像素的运动移位版本的像素幅度，以形成所述图像像素的经处理的像素幅度。

公开(公告)号：US20120269272A1

公开(公告)日：2012-10-25

申请号：US13504739

申请日：2010-10-28

申请人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

发明人： Thomas Sikora ,  Andreas Krutz ,  Alexander Glantz

IPC分类号： H04N7/32

CPC分类号： H04N19/521 ,  H04N19/117 ,  H04N19/159 ,  H04N19/172 ,  H04N19/182 ,  H04N19/46 ,  H04N19/597 ,  H04N19/61 ,  H04N19/82 ,  H04N19/86

摘要： An embodiment of the invention relates to a method for processing the pixel amplitude of at least one block image pixel contained in a video sequence, said method comprising the steps of: —constructing an individual motion trajectory comprising motion-shifted versions of said block image pixel over a multiplicity of neighboring frames; and—combining the pixel amplitudes of the motion-shifted versions of said block image pixel along the individual motion trajectory using a weighting function, to form a processed pixel amplitude of said image pixel.

摘要翻译： 本发明的实施例涉及一种用于处理包含在视频序列中的至少一个块图像像素的像素幅度的方法，所述方法包括以下步骤： - 构建包括所述块图像像素的运动移位版本的单独运动轨迹 在多个相邻帧上; 以及使用加权函数来组合所述块图像像素的运动移位版本的像素幅度，以形成所述图像像素的经处理的像素幅度。