公开(公告)号：US08649558B2

公开(公告)日：2014-02-11

申请号：US13149609

申请日：2011-05-31

申请人： Michael Gleicher ,  Feng Liu ,  Yuzhen Niu

发明人： Michael Gleicher ,  Feng Liu ,  Yuzhen Niu

IPC分类号： G06K9/00

CPC分类号： G06T3/0093

摘要： Video data is processed with region-based warping. In accordance with various example embodiments, video data having a plurality of source video frames is processed as follows, for each source video frame. Pixels representing the source video frame and at least one temporally-adjacent video frame are used to generate a motion history map, based upon frame-to-frame movement of at least one region in the source video frame and temporally-adjacent video frames. At least one salient region is identified in the source video frame based upon the motion history map and static image saliency data. Weighting data is determined for warping pixels corresponding to background regions of the source video frame differently than pixels corresponding to the at least one salient region in the source video frame. Using the weighting data, the pixels representing the source video frame are warped to generate pixels representing a warped video frame.

摘要翻译： 视频数据采用基于区域的翘曲进行处理。 根据各种示例实施例，对于每个源视频帧，如下处理具有多个源视频帧的视频数据。 表示源视频帧和至少一个时间相邻视频帧的像素被用于基于源视频帧和时间相邻视频帧中的至少一个区域的帧到帧移动来生成运动历史图。 基于运动历史图和静态图像显着性数据，在源视频帧中识别出至少一个显着区域。 确定与源视频帧的背景区域对应的翘曲像素的加权数据，不同于与源视频帧中的至少一个显着区域对应的像素。 使用加权数据，表示源视频帧的像素被扭曲以产生表示翘曲视频帧的像素。

公开(公告)号：US20120307155A1

公开(公告)日：2012-12-06

申请号：US13149609

申请日：2011-05-31

申请人： Michael Gleicher ,  Feng Liu ,  Yuzhen Niu

发明人： Michael Gleicher ,  Feng Liu ,  Yuzhen Niu

IPC分类号： H04N9/74

CPC分类号： G06T3/0093

摘要： Video data is processed with region-based warping. In accordance with various example embodiments, video data having a plurality of source video frames is processed as follows, for each source video frame. Pixels representing the source video frame and at least one temporally-adjacent video frame are used to generate a motion history map, based upon frame-to-frame movement of at least one region in the source video frame and temporally-adjacent video frames. At least one salient region is identified in the source video frame based upon the motion history map and static image saliency data. Weighting data is determined for warping pixels corresponding to background regions of the source video frame differently than pixels corresponding to the at least one salient region in the source video frame. Using the weighting data, the pixels representing the source video frame are warped to generate pixels representing a warped video frame.

摘要翻译： 视频数据采用基于区域的翘曲进行处理。 根据各种示例实施例，对于每个源视频帧，如下处理具有多个源视频帧的视频数据。 表示源视频帧和至少一个时间相邻视频帧的像素被用于基于源视频帧和时间相邻视频帧中的至少一个区域的帧到帧移动来生成运动历史图。 基于运动历史图和静态图像显着性数据，在源视频帧中识别出至少一个显着区域。 确定与源视频帧的背景区域对应的翘曲像素的加权数据，不同于与源视频帧中的至少一个显着区域对应的像素。 使用加权数据，表示源视频帧的像素被扭曲以产生表示翘曲视频帧的像素。