Visual saliency estimation for images and video
    1.
    发明授权
    Visual saliency estimation for images and video 有权
    图像和视频的视觉显着性估计

    公开(公告)号:US09025880B2

    公开(公告)日:2015-05-05

    申请号:US13598084

    申请日:2012-08-29

    IPC分类号: G06K9/46 H04N19/117

    摘要: Methods and apparatus for visual saliency estimation for images and video are described. In an embodiment, a process includes decomposing, by a processor, an image into elements, wherein each element includes at least one pixel. The processor then calculates a first image measure indicative of each element's uniqueness in the image on a per element basis, and a second image measure indicative of each element's spatial distribution in the image on a per element basis. A per element saliency measure is provided by combining the first image measure and the second image measure, or by utilizing the first image measure, or by utilizing the second image measure.

    摘要翻译: 描述了用于图像和视频的视觉显着性估计的方法和装置。 在一个实施例中,过程包括由处理器将图像分解为元素,其中每个元素包括至少一个像素。 然后,处理器计算指示每个元素基于每个元素的每个元素在图像中的唯一性的第一图像测量,以及基于每个元素的图像中的每个元素的空间分布的第二图像测量。 通过组合第一图像测量和第二图像测量,或通过利用第一图像测量,或通过利用第二图像测量来提供每个元素显着性度量。

    Method and system for shift-map image editing
    3.
    发明授权
    Method and system for shift-map image editing 有权
    移位图图像编辑的方法和系统

    公开(公告)号:US08249394B2

    公开(公告)日:2012-08-21

    申请号:US12723248

    申请日:2010-03-12

    IPC分类号: G06K9/32 G06K9/36 G09G5/00

    CPC分类号: G06T11/60

    摘要: Natural looking output images are computed from input images based on given user constraints. Pixels in the output images are assigned a shift such that the respective output pixel value is derived from the value of the input pixel whose location is related to that of the output pixel by the shift, at least one shift being non-zero. The shift is determined by an optimization process adapted to minimize a cost function that includes a data term on the shifts of single pixels and a smoothness term on the shifts of pixel pairs. The output image is computed by applying the optimized shift-map between the input and output pixels. The data term can include shift constraints that limit the location in the output images of selected input pixels, and saliency constraints, indicating a preference that selected pixels in the input images will or will not appear in the output image.

    摘要翻译: 基于给定的用户约束,从输入图像计算自然观察输出图像。 输出图像中的像素被赋予移位,使得相应的输出像素值是通过偏移从位置与输出像素的位置相关的输入像素的值导出的,至少一个移位不为零。 移位由适于最小化成本函数的优化过程确定,该成本函数包括单个像素的偏移上的数据项和像素对的偏移上的平滑项。 通过在输入和输出像素之间应用优化的移位图来计算输出图像。 数据项可以包括限制所选输入像素的输出图像中的位置的偏移约束和显着约束,指示输入图像中的选定像素将会或不会出现在输出图像中的偏好。

    METHOD AND SYSTEM FOR SHIFT-MAP IMAGE EDITING
    4.
    发明申请
    METHOD AND SYSTEM FOR SHIFT-MAP IMAGE EDITING 有权
    用于移位图像编辑的方法和系统

    公开(公告)号:US20100232729A1

    公开(公告)日:2010-09-16

    申请号:US12723248

    申请日:2010-03-12

    IPC分类号: G06K9/36 G06K9/32

    CPC分类号: G06T11/60

    摘要: Natural looking output images are computed from input images based on given user constraints. Pixels in the output images are assigned a shift such that the respective output pixel value is derived from the value of the input pixel whose location is related to that of the output pixel by the shift, at least one shift being non-zero. The shift is determined by an optimization process adapted to minimize a cost function that includes a data term on the shifts of single pixels and a smoothness term on the shifts of pixel pairs. The output image is computed by applying the optimized shift-map between the input and output pixels. The data term can include shift constraints that limit the location in the output images of selected input pixels, and saliency constraints, indicating a preference that selected pixels in the input images will or will not appear in the output image.

    摘要翻译: 基于给定的用户约束,从输入图像计算自然观察输出图像。 输出图像中的像素被赋予移位,使得相应的输出像素值是通过偏移从位置与输出像素的位置相关的输入像素的值导出的,至少一个移位不为零。 移位由适于最小化成本函数的优化过程确定,该成本函数包括单个像素的偏移上的数据项和像素对的偏移上的平滑项。 通过在输入和输出像素之间应用优化的移位图来计算输出图像。 数据项可以包括限制所选输入像素的输出图像中的位置的偏移约束和显着约束,指示输入图像中的选定像素将会或不会出现在输出图像中的偏好。

    System and method for facilitating the adjustment of disparity in a stereoscopic panoramic image pair
    5.
    发明授权
    System and method for facilitating the adjustment of disparity in a stereoscopic panoramic image pair 有权
    用于促进立体全景图像对中的视差调整的系统和方法

    公开(公告)号:US06831677B2

    公开(公告)日:2004-12-14

    申请号:US09792638

    申请日:2001-02-24

    IPC分类号: H04N700

    摘要: A system for generating a stereoscopic panoramic image pair having left and right panoramic mosaic images for use in facilitating stereoscopic viewing of a panoramic scene, the system comprising a panoramic image generator and a strip separation value generation module. The panoramic image generator is configured to mosaic together respective left and right image strips from respective ones of a plurality of images to form the respective left and right panoramic images. The panoramic image generator is configured to use strip separation values for the respective images to determine the separation of the respective left and right image strips in generating the respective left and right panoramic images. The strip separation value generation module is configured to generate, for respective ones of said images, the strip separation values so as to provide at least one selected disparity for objects in the panoramic scene.

    摘要翻译: 一种用于产生具有用于促进全景场景的立体观看的左和右全景马赛克图像的立体全景图像对的系统,所述系统包括全景图像生成器和条带分离值生成模块。 全景图像生成器被配置为将来自多个图像中的相应的左图像条和右图像条拼接在一起以形成相应的左和右全景图像。 全景图像生成器被配置为对各个图像使用条带分离值来确定在生成相应的左和右全景图像时相应的左和右图像条的分离。 条带分离值生成模块被配置为针对相应的所述图像生成条带分离值,以便为全景场景中的对象提供至少一个选择的视差。

    Online registration of dynamic scenes using video extrapolation
    9.
    发明申请
    Online registration of dynamic scenes using video extrapolation 审中-公开
    使用视频外推的动态场景的在线注册

    公开(公告)号:US20060215934A1

    公开(公告)日:2006-09-28

    申请号:US11378635

    申请日:2006-03-20

    IPC分类号: G06K9/32

    CPC分类号: G06T7/269

    摘要: A computer-implemented method and system determines camera movement of a new frame relative to a sequence of frames of images containing at least one dynamic object and for which relative camera movement is assumed. From changes in color values of sets of pixels in different frames of the sequence for which respective locations of all pixels in each set are adjusted so as to neutralize the effect of camera movement between the respective frames in the sequence containing the pixels, corresponding color values of the pixels in the new frame are predicted and used to determine camera movement as a relative movement of the new frame and the predicted frame. An embodiment of the invention maintains an aligned space-time volume of frames for which camera movement is neutralized and adds each new frame to the aligned space-time volume after neutralizing camera movement in the new frame.

    摘要翻译: 计算机实现的方法和系统相对于包含至少一个动态对象的图像的帧序列来确定新帧的相机移动,并且假定相对相机移动。 从序列的不同帧中的像素集合的颜色值的变化被调整到每一组中的所有像素的相应位置,以便中和在包含像素的序列中的相应帧之间的相机运动的影响,相应的颜色值 预测新帧中的像素,并用于确定相机移动作为新帧和预测帧的相对移动。 本发明的一个实施例保持对准的空间 - 时间体积的帧,相机移动被中和,并且在中和新帧中的相机运动之后将每个新帧添加到对齐的时空体积。

    Method and system for video indexing and video synopsis
    10.
    发明授权
    Method and system for video indexing and video synopsis 有权
    视频索引和视频摘要的方法和系统

    公开(公告)号:US08311277B2

    公开(公告)日:2012-11-13

    申请号:US12522843

    申请日:2007-12-09

    IPC分类号: G06K9/00

    摘要: In a system and method for generating a synopsis video from a source video, at least three different source objects are selected according to one or more defined constraints, each source object being a connected subset of image points from at least three different frames of the source video. One or more synopsis objects are sampled from each selected source object by temporal sampling using image points derived from specified time periods. For each synopsis object a respective time for starting its display in the synopsis video is determined, and for each synopsis object and each frame a respective color transformation for displaying the synopsis object may be determined. The synopsis video is displayed by displaying selected synopsis objects at their respective time and color transformation, such that in the synopsis video at least three points that each derive from different respective times in the source video are displayed simultaneously.

    摘要翻译: 在用于从源视频生成概要视频的系统和方法中,根据一个或多个限定的约束选择至少三个不同的源对象,每个源对象是来自源的至少三个不同帧的图像点的连接子集 视频。 通过使用从指定时间段导出的图像点进行时间采样,从每个选定的源对象中采样一个或多个概要对象。 对于每个概要对象,确定在概要视频中开始其显示的相应时间,并且对于每个概要对象和每个帧,可以确定用于显示概要对象的相应颜色变换。 通过在其各自的时间和颜色变换中显示所选概要对象来显示概要视频,使得在概要视频中,源视频中的不同相应时间中的至少三个点被同时显示。