公开(公告)号：US08200648B2

公开(公告)日：2012-06-12

申请号：US12376787

申请日：2007-08-07

申请人： Oren Boiman ,  Michal Irani

发明人： Oren Boiman ,  Michal Irani

IPC分类号： G06F17/30

CPC分类号： G10L17/00 ,  G06F17/30787 ,  G06F17/30799 ,  G06F17/30843 ,  G06K9/4671 ,  G10L15/00 ,  G10L25/00

摘要： A method includes finding regions of a reference signal which provide at least one of: local evidence scores and a global evidence score. The local evidence scores indicate local similarity of the regions of the reference signal to regions of a query signal and the global evidence score defines the extent of a global similarity of the query signal to the reference signal. A media exploring device is also included which includes an importance encoder and a media explorer. The importance encoder generates importance scores of at least portions of digital media as a function of at least one of local evidence scores and global evidence scores. The media explorer enables exploring through the digital media according to (i) the importance scores, (ii) data associations/links induced by the evidence scores between different portions of the digital media. The device may also include a media player to play the digital media with adaptive speeds as a function of the importance scores. The device may also include a labeling/annotation module which inherits labels/annotations/markings according to the abovementioned data associations.

摘要翻译： 一种方法包括找到参考信号的区域，其提供以下中的至少一个：局部证据得分和全局证据得分。 局部证据分数表示参考信号区域与查询信号区域的局部相似度，全局证据分数定义了查询信号与参考信号的全局相似度的程度。 还包括媒体探索设备，包括重要性编码器和媒体资源管理器。 重要性编码器产生数字媒体的至少一部分的重要度分数作为至少一个局部证据分数和全局证据得分的函数。 媒体探索者可以根据（i）重要性分数，（ii）由数字媒体不同部分之间的证据分数引起的数据关联/链接，通过数字媒体进行探索。 该设备还可以包括媒体播放器，以与重要性分数相关的自适应速度播放数字媒体。 该设备还可以包括标签/注释模块，其根据上述数据关联继承标签/注释/标记。

公开(公告)号：US20120086850A1

公开(公告)日：2012-04-12

申请号：US13138894

申请日：2010-04-20

申请人： Michal Irani ,  Daniel Glasner ,  Oded Shahar ,  Shai Bagon

发明人： Michal Irani ,  Daniel Glasner ,  Oded Shahar ,  Shai Bagon

IPC分类号： H04N7/01 ,  G06K9/00 ,  G06K9/32

CPC分类号： G06T3/4053 ,  G06T3/40 ,  G09G2340/0407

摘要： A method implementable on a computing device includes exploiting data redundancy to combine high frequency information from at least two different scales of an input signal to generate a super resolution version of said input signal. An alternative method includes exploiting recurrence of data from an input signal in at least two different scales of at least one reference signal to extract and to combine high frequency information from a plurality of scales of said at least one reference signal to generate a super resolution version of said input signal. An alternative method includes generating a super resolution version of a single input video sequence in at least the temporal dimension by exploiting data recurrence within the input video sequence or with respect to an external database of example video sequences. A signal may be an image, a video sequence, an audio signal, etc.

摘要翻译： 可在计算设备上实现的方法包括利用数据冗余来组合来自输入信号的至少两个不同尺度的高频信息以产生所述输入信号的超分辨率版本。 一种替代方法包括利用来自至少两个不同尺度的至少一个参考信号的来自输入信号的数据的再现以提取和组合来自所述至少一个参考信号的多个尺度的高频信息以产生超分辨率版本 的所述输入信号。 一种替代方法包括通过利用输入视频序列内的数据重复或相对于示例视频序列的外部数据库，至少在时间维度上生成单个输入视频序列的超分辨率版本。 信号可以是图像，视频序列，音频信号等

公开(公告)号：US20100104158A1

公开(公告)日：2010-04-29

申请号：US12519522

申请日：2007-12-20

申请人： Eli Shechtman ,  Michal Irani

发明人： Eli Shechtman ,  Michal Irani

IPC分类号： G06K9/46

CPC分类号： G06K9/46

摘要： A method includes matching at least portions of first, second signals using local self-similarity descriptors of the signals. The matching includes computing a local self-similarity descriptor for each one of at least a portion of points in the first signal, forming a query ensemble of the descriptors for the first signal and seeking an ensemble of descriptors of the second signal which matches the query ensemble of descriptors. This matching can be used for image categorization, object classification, object recognition, image segmentation, image alignment, video categorization, action recognition, action classification, video segmentation, video alignment, signal alignment, multi-sensor signal alignment, multi-sensor signal matching, optical character recognition, image and video synthesis, correspondence estimation, signal registration and change detection. It may also be used to synthesize a new signal with elements similar to those of a guiding signal synthesized from portions of the reference signal. Apparatus is also included.

摘要翻译： 一种方法包括使用信号的局部自相似性描述符来匹配第一，第二信号的至少一部分。 所述匹配包括为所述第一信号中的至少一部分点中的每一个计算一个局部自相似性描述符，形成所述第一信号的所述描述符的查询集合，并且寻找与所述查询匹配的所述第二信号的描述符的整体 描述符集合 该匹配可用于图像分类，对象分类，对象识别，图像分割，图像对齐，视频分类，动作识别，动作分类，视频分割，视频对齐，信号对齐，多传感器信号对齐，多传感器信号匹配 ，光学字符识别，图像和视频合成，对应估计，信号配准和变化检测。 它也可以用于合成具有与参考信号的部分合成的引导信号类似的元件的新信号。 还包括装置。

公开(公告)号：US07428019B2

公开(公告)日：2008-09-23

申请号：US10498345

申请日：2002-12-26

申请人： Michal Irani ,  Yaron Caspi ,  Eli Shechtman

发明人： Michal Irani ,  Yaron Caspi ,  Eli Shechtman

IPC分类号： H04N5/262 ,  H04N5/225

CPC分类号： G06T3/4069 ,  H04N5/217 ,  H04N5/225 ,  H04N5/77 ,  H04N7/01 ,  H04N7/0125 ,  H04N7/12

摘要： A system and method for increasing space or time resolution of an image sequence by combination of a plurality input sources with different space-time resolutions such that the single output displays increased accuracy and clarity without the calculation of motion vectors. This system of enhancement may be used on any optical recording device, including but not limited to digital video, analog video, still pictures of any format and so forth. The present invention includes support for example for such features as single frame resolution increase, combination of a number of still pictures, the option to calibrate spatial or temporal enhancement or any combination thereof, increased video resolution by using high-resolution still cameras as enhancement additions and may optionally be implemented using a camera synchronization method.

摘要翻译： 通过组合具有不同空间 - 时间分辨率的多个输入源来增加图像序列的空间或时间分辨率的系统和方法，使得单个输出在不计算运动矢量的情况下显示增加的精度和清晰度。 该增强系统可以用于任何光学记录装置，包括但不限于数字视频，模拟视频，任何格式的静止图像等。 本发明包括例如对于诸如单帧分辨率增加，多个静止图像的组合，校准空间或时间增强的选项或其任何组合的特征的支持，通过使用高分辨率静态相机作为增强添加来增加视频分辨率 并且可以可选地使用相机同步方法来实现。

公开(公告)号：US20120281923A1

公开(公告)日：2012-11-08

申请号：US13461796

申请日：2012-05-02

申请人： Michal Irani ,  Maria Zontak

发明人： Michal Irani ,  Maria Zontak

IPC分类号： G06K9/68

CPC分类号： G06K9/3241 ,  G06K9/6223

摘要： A method of image processing is disclosed, the method implementable on an electronic device, the method comprising: calculating for an image patch within an image at least one patch-dependent content information; based on said at least one patch-dependent content information, determining a patch-dependent search region; searching said patch-dependent search region for one or more image patches that are similar to said image patch; and processing said image patch based on said similar image patches found in said patch-dependent search region.

摘要翻译： 公开了一种图像处理方法，该方法可在电子设备上实现，该方法包括：针对图像内的图像补丁计算至少一个补丁相关内容信息; 基于所述至少一个依赖于片段的内容信息，确定与片段相关的搜索区域; 搜索与所述图像补丁类似的一个或多个图像补丁的所述补丁依赖搜索区域; 以及基于在所述补丁相关搜索区域中发现的所述相似图像补丁来处理所述图像补丁。

公开(公告)号：US06393163B1

公开(公告)日：2002-05-21

申请号：US09453749

申请日：1999-12-02

申请人： Peter J. Burt ,  Michal Irani ,  Stephen Charles Hsu ,  Padmanabhan Anandan ,  Michael W. Hansen

发明人： Peter J. Burt ,  Michal Irani ,  Stephen Charles Hsu ,  Padmanabhan Anandan ,  Michael W. Hansen

IPC分类号： G06K936

CPC分类号： G06K9/32 ,  G06K2009/2045 ,  G06T3/4038 ,  G06T11/00 ,  H04N5/781 ,  H04N5/85 ,  H04N9/8047 ,  H04N19/20 ,  H04N19/23 ,  H04N19/30 ,  H04N19/503 ,  H04N19/61 ,  H04N19/63

摘要： A system for automatically generating a mosaic from a plurality of input images. The system sequentially executes an image alignment process, an editing process, and a combining process such that, from a sequence of images, the system automatically produces a seamless mosaic for various applications. Illustrative applications for the mosaic include: (1) a mosaic based display system including an image printing system, (2) a surveillance system and (3) a mosaic based compression system. The mosaic based display system permits a system user to display, manipulate and alter a mosaic. The mosaic based compression system exploits the temporal and spatial redundancy in image sequences and efficiently compresses the image information. The compression system can be used for compressing image information for storage in a storage device or can be used for compressing image information for transmission through a band-limited transmission channel. The surveillance system combines the mosaic construction system, the compression system and the display system into a comprehensive system for remote motion detection.

摘要翻译： 一种用于从多个输入图像自动生成马赛克的系统。 系统依次执行图像对准处理，编辑处理和组合处理，使得从图像序列中，系统自动产生用于各种应用的无缝镶嵌。 马赛克的说明性应用包括：（1）基于马赛克的显示系统，包括图像打印系统，（2）监视系统和（3）基于马赛克的压缩系统。 基于马赛克的显示系统允许系统用户显示，操纵和改变马赛克。 基于马赛克的压缩系统利用图像序列中的时间和空间冗余，并有效地压缩图像信息。 压缩系统可以用于压缩存储在存储设备中的图像信息，或者可以用于压缩图像信息以通过带限传输信道进行传输。 监控系统将马赛克施工系统，压缩系统和显示系统结合成一个综合的远程运动检测系统。

公开(公告)号：US06198852B1

公开(公告)日：2001-03-06

申请号：US09088543

申请日：1998-06-01

申请人： Padmananbhan Anandan ,  Michal Irani ,  Daphna Weinshall

发明人： Padmananbhan Anandan ,  Michal Irani ,  Daphna Weinshall

IPC分类号： G06K936

CPC分类号： G06K9/209 ,  G06T7/97 ,  G06T2207/20088 ,  G06T2207/20228

摘要： The invention is embodied in a process for synthesizing a new image representing a new viewpoint of a scene from at least two existing images of the scene taken from different respective viewspoints. The process begins by choosing a planar surface visible in the at least two of the existing images and transforming the at least two existing images relative to one another so as to bring the planar surface into perspective alignment in the at least two existing images, and then choosing a reference frame and computing parallax vectors between the two images of the projection of common scene points on the reference frame. Preferably, the reference frame comprises an image plane of a first one of the existing images. Preferably, the reference frame is co-planar with the planar surface. In this case, the transforming of the existing images is achieved by performing a projective transform on a second one of the existing images to bring its image of the planar surface into perspective alignment with the image of the planar surface in the first existing image. Preferably, the image parameter of the new view comprises information sufficient, together with the parallax vectors, to deduce: (a) a trifocal ratio in the reference frame and (b) one epipole between the new viewpoint and one of the first and second viewpoints.

摘要翻译： 本发明体现在从不同的各个视点拍摄的场景的至少两个现有图像中合成表示场景的新视点的新图像的处理。 该过程开始于在至少两个现有图像中选择可见的平面表面，并相对于彼此变换至少两个现有图像，以便使平面在至少两个现有图像中进行透视对准，然后 选择参考帧并计算参考帧上的共同场景点的投影的两个图像之间的视差矢量。优选地，参考帧包括第一个现有图像的图像平面。 优选地，参考框架与平面表面共面。 在这种情况下，现有图像的变换是通过在第二个现有图像上进行投射变换来实现的，以使其平面的图像与第一个现有图像中的平面的图像进行透视对齐。 ，新视图的图像参数包括与视差矢量一起足够的信息，以推断：（a）参考帧中的三焦比和（b）新视点与第一视点和第二视点中的一个之间的一个epipole。

公开(公告)号：US06192145B1

公开(公告)日：2001-02-20

申请号：US08798857

申请日：1997-02-11

申请人： Padmanabhan Anandan ,  Michal Irani

发明人： Padmanabhan Anandan ,  Michal Irani

IPC分类号： G06K900

CPC分类号： G06T7/246 ,  G06K9/209 ,  G06K2209/40 ,  G06T7/579 ,  G06T7/593 ,  G06T15/10 ,  G06T2207/10012 ,  H04N13/221 ,  H04N13/239 ,  H04N2013/0081

摘要： A method and apparatus for processing a geometric relationship between the image motion of pairs of points over multiple image frames representing a three-dimensional scene. This relationship is based on the parallax motion of points with respect to an arbitrary planar surface, and does not involve epipolar geometry. A constraint is derived over two frames for any pair of points, relating their projective structure (with respect to the plane) based only on their image coordinates and their parallax displacements. Similarly, a 3D-rigidity constraint between pairs of points over multiple frames is derived. Also disclosed are applications of these parallax-based constraints to solving three important problems in 3D scene analysis: (i) the recovery of 3D scene structure, (ii) the detection of moving objects in the presence of camera induced motion, and (iii) the synthesis of new camera views based on a given set of views. Moreover, this approach can handle difficult situations for 3D scene analysis, e.g., where there is only a small set of parallax vectors, and in the presence of independently moving objects.

摘要翻译： 一种用于处理表示三维场景的多个图像帧上的点对的图像运动之间的几何关系的方法和装置。 该关系基于相对于任意平面的点的视差运动，并且不涉及对极几何形状。 对于任何一对点，两个框架之间导出一个约束，这些点仅基于它们的图像坐标及其视差位移而相关于其投影结构（相对于平面）。 类似地，导出在多个帧上的点对之间的3D刚度约束。 还公开了这些基于视差的约束的应用来解决3D场景分析中的三个重要问题：（i）3D场景结构的恢复，（ii）在存在摄像机诱发运动的情况下检测移动物体，以及（iii） 基于给定的视图集合新的摄像机视图。 此外，这种方法可以处理3D场景分析的困难情况，例如，其中仅存在一小组视差矢量，并且在存在独立运动的对象的情况下。

公开(公告)号：US07596281B2

公开(公告)日：2009-09-29

申请号：US10433526

申请日：2001-12-04

申请人： Michal Irani ,  Yaron Caspi

发明人： Michal Irani ,  Yaron Caspi

IPC分类号： G06K9/36 ,  G06K9/32

CPC分类号： G06T7/20 ,  G06T7/38 ,  G06T2207/10016 ,  G06T2207/30232

摘要： A method and system for computing at least one of spatial and temporal relationships between at least first and second sequences of representations having respective first and second temporal progressions and including employing the first and second temporal progressions to obtain at least one of the spatial and temporal relationships.

摘要翻译： 一种用于计算具有相应的第一和第二时间进展的至少第一和第二表示序列之间的空间和时间关系中的至少一个的方法和系统，并且包括采用第一和第二时间进度来获得空间和时间关系中的至少一个 。

公开(公告)号：US6049619A

公开(公告)日：2000-04-11

申请号：US797911

申请日：1997-02-10

申请人： Padmanabhan Anandan ,  Michal Irani

发明人： Padmanabhan Anandan ,  Michal Irani

IPC分类号： G06T7/20 ,  H04N13/00 ,  G06K9/00

CPC分类号： G06K9/32 ,  G06K9/209 ,  G06T7/20 ,  G06T7/2086 ,  G06T2207/10021 ,  H04N13/0221 ,  H04N2013/0085

摘要： A method and apparatus for detecting moving objects in both two-dimensional and three-dimensional scenes. The method repetitively applies a two-dimensional transformation to a plurality of images representing a scene to identify misaligned regions within the images. Any residual motion represented by the misaligned regions that may be classified as a moving object within the scene is further processed by a three-dimensional technique that removes parallax motion from the residual motion. The result is motion contained in an epipolar flow field which is only due to a moving object within the scene.

摘要翻译： 一种在二维和三维场景中检测移动物体的方法和装置。 该方法重复地将二维变换应用于表示场景的多个图像，以识别图像内的不对准区域。 由可以被分类为场景内的移动物体的不对准区域表示的任何残余运动通过从残余运动中去除视差运动的三维技术进一步处理。 结果是运动包含在一个对极流场中，这是由场景内的移动物体引起的。