公开(公告)号：US07596281B2

公开(公告)日：2009-09-29

申请号：US10433526

申请日：2001-12-04

申请人： Michal Irani ,  Yaron Caspi

发明人： Michal Irani ,  Yaron Caspi

IPC分类号： G06K9/36 ,  G06K9/32

CPC分类号： G06T7/20 ,  G06T7/38 ,  G06T2207/10016 ,  G06T2207/30232

摘要： A method and system for computing at least one of spatial and temporal relationships between at least first and second sequences of representations having respective first and second temporal progressions and including employing the first and second temporal progressions to obtain at least one of the spatial and temporal relationships.

摘要翻译： 一种用于计算具有相应的第一和第二时间进展的至少第一和第二表示序列之间的空间和时间关系中的至少一个的方法和系统，并且包括采用第一和第二时间进度来获得空间和时间关系中的至少一个 。

公开(公告)号：US07428019B2

公开(公告)日：2008-09-23

申请号：US10498345

申请日：2002-12-26

申请人： Michal Irani ,  Yaron Caspi ,  Eli Shechtman

发明人： Michal Irani ,  Yaron Caspi ,  Eli Shechtman

IPC分类号： H04N5/262 ,  H04N5/225

CPC分类号： G06T3/4069 ,  H04N5/217 ,  H04N5/225 ,  H04N5/77 ,  H04N7/01 ,  H04N7/0125 ,  H04N7/12

摘要： A system and method for increasing space or time resolution of an image sequence by combination of a plurality input sources with different space-time resolutions such that the single output displays increased accuracy and clarity without the calculation of motion vectors. This system of enhancement may be used on any optical recording device, including but not limited to digital video, analog video, still pictures of any format and so forth. The present invention includes support for example for such features as single frame resolution increase, combination of a number of still pictures, the option to calibrate spatial or temporal enhancement or any combination thereof, increased video resolution by using high-resolution still cameras as enhancement additions and may optionally be implemented using a camera synchronization method.

摘要翻译： 通过组合具有不同空间 - 时间分辨率的多个输入源来增加图像序列的空间或时间分辨率的系统和方法，使得单个输出在不计算运动矢量的情况下显示增加的精度和清晰度。 该增强系统可以用于任何光学记录装置，包括但不限于数字视频，模拟视频，任何格式的静止图像等。 本发明包括例如对于诸如单帧分辨率增加，多个静止图像的组合，校准空间或时间增强的选项或其任何组合的特征的支持，通过使用高分辨率静态相机作为增强添加来增加视频分辨率 并且可以可选地使用相机同步方法来实现。

公开(公告)号：US07428345B2

公开(公告)日：2008-09-23

申请号：US09852891

申请日：2001-05-10

申请人： Yaron Caspi ,  Michal Irani

发明人： Yaron Caspi ,  Michal Irani

IPC分类号： G06K9/32 ,  G09G5/00 ,  H04N7/00

CPC分类号： H04N5/2625 ,  G06T7/20 ,  G06T7/207 ,  G06T2207/30221 ,  G06T2207/30241

摘要： A method and system for aligning in at least one of time and space temporally ordered sequences of images comprising receiving a plurality of sequences of images, each sequence including a multiplicity of images, each plurality of sequences defining a space-time volume, and providing an output indication relating at least one point in a space-time volume corresponding to one of the plurality of sequences to at least one point in a space-time volume corresponding to at least another one of the plurality of sequences.

摘要翻译： 一种方法和系统，用于在时间和空间中的至少一个时间对齐的图像序列中进行对准，包括接收多个图像序列，每个序列包括多个图像，每个序列定义空时体积，并且提供 输出指示将与多个序列中的一个序列相对应的时空容量中的至少一个点与空间时间卷中的至少一个点对应的多个序列中的至少另一个。

公开(公告)号：US08542908B2

公开(公告)日：2013-09-24

申请号：US12598450

申请日：2008-05-11

申请人： Denis Simakov ,  Michal Irani ,  Yaron Caspi ,  Eli Schechtman

发明人： Denis Simakov ,  Michal Irani ,  Yaron Caspi ,  Eli Schechtman

IPC分类号： G06K9/46

CPC分类号： G06K9/00711 ,  G06F17/30843 ,  G06K9/6203 ,  G06T3/0012

摘要： A method for measuring bi-directional similarity between a first signal of a first size and a second signal of a second size includes matching at least some patches of the first signal with patches of the second signal for data completeness, matching at least some patches of the second signal with patches of the first signal for data coherence, calculating the bi-directional similarity measure as a function of the matched patches for coherence and the matched patches for completeness and indicating the similarity between the first signal and the second signal. Another method generates a second signal from a first signal where the second signal is different than the first signal by at least one parameter. The method includes attempting to maximize a bi-directional similarity measure between the second signal and the first signal.

摘要翻译： 一种用于测量第一尺寸的第一信号和第二尺寸的第二信号之间的双向相似度的方法包括：将所述第一信号的至少一些贴片与所述第二信号的贴片匹配以用于数据的完整性， 第二信号具有用于数据相干性的第一信号的补码，计算双向相似性度量作为用于相干性的匹配补丁的函数，以及用于完整性的匹配补丁，并且指示第一信号和第二信号之间的相似性。 另一种方法从第一信号产生第二信号，其中第二信号与第一信号不同于至少一个参数。 该方法包括尝试最大化第二信号和第一信号之间的双向相似性度量。

公开(公告)号：US20100177955A1

公开(公告)日：2010-07-15

申请号：US12598450

申请日：2008-05-11

申请人： Denis Simakov ,  Michal Irani ,  Yaron Caspi ,  Schechtman Eli

发明人： Denis Simakov ,  Michal Irani ,  Yaron Caspi ,  Schechtman Eli

IPC分类号： G06K9/00 ,  G06K9/68

CPC分类号： G06K9/00711 ,  G06F17/30843 ,  G06K9/6203 ,  G06T3/0012

摘要： A method for measuring bi-directional similarity between a first signal of a first size and a second signal of a second size includes matching at least some patches of the first signal with patches of the second signal for data completeness, matching at least some patches of the second signal with patches of the first signal for data coherence, calculating the bi-directional similarity measure as a function of the matched patches for coherence and the matched patches for completeness and indicating the similarity between the first signal and the second signal. Another method generates a second signal from a first signal where the second signal is different than the first signal by at least one parameter. The method includes attempting to maximize a bi-directional similarity measure between the second signal and the first signal.

摘要翻译： 一种用于测量第一尺寸的第一信号和第二尺寸的第二信号之间的双向相似度的方法包括：将所述第一信号的至少一些贴片与所述第二信号的贴片匹配以用于数据的完整性， 第二信号具有用于数据相干性的第一信号的补码，计算双向相似性度量作为用于相干性的匹配补丁的函数，以及用于完整性的匹配补丁，并且指示第一信号和第二信号之间的相似性。 另一种方法从第一信号产生第二信号，其中第二信号与第一信号不同于至少一个参数。 该方法包括尝试最大化第二信号和第一信号之间的双向相似性度量。

公开(公告)号：US6049619A

公开(公告)日：2000-04-11

申请号：US797911

申请日：1997-02-10

申请人： Padmanabhan Anandan ,  Michal Irani

发明人： Padmanabhan Anandan ,  Michal Irani

IPC分类号： G06T7/20 ,  H04N13/00 ,  G06K9/00

CPC分类号： G06K9/32 ,  G06K9/209 ,  G06T7/20 ,  G06T7/2086 ,  G06T2207/10021 ,  H04N13/0221 ,  H04N2013/0085

摘要： A method and apparatus for detecting moving objects in both two-dimensional and three-dimensional scenes. The method repetitively applies a two-dimensional transformation to a plurality of images representing a scene to identify misaligned regions within the images. Any residual motion represented by the misaligned regions that may be classified as a moving object within the scene is further processed by a three-dimensional technique that removes parallax motion from the residual motion. The result is motion contained in an epipolar flow field which is only due to a moving object within the scene.

摘要翻译： 一种在二维和三维场景中检测移动物体的方法和装置。 该方法重复地将二维变换应用于表示场景的多个图像，以识别图像内的不对准区域。 由可以被分类为场景内的移动物体的不对准区域表示的任何残余运动通过从残余运动中去除视差运动的三维技术进一步处理。 结果是运动包含在一个对极流场中，这是由场景内的移动物体引起的。

公开(公告)号：US5963664A

公开(公告)日：1999-10-05

申请号：US493632

申请日：1995-06-22

申请人： Rakesh Kumar ,  Keith James Hanna ,  James R. Bergen ,  Padmanabhan Anandan ,  Michal Irani

发明人： Rakesh Kumar ,  Keith James Hanna ,  James R. Bergen ,  Padmanabhan Anandan ,  Michal Irani

IPC分类号： G06T1/00 ,  G06T7/00 ,  G06T15/20 ,  H04N7/26 ,  H04N13/00 ,  G06K9/60 ,  G06T17/00

CPC分类号： G06T7/0028 ,  G06K9/32 ,  G06T15/20 ,  G06T7/0075 ,  H04N13/0011 ,  H04N19/23 ,  G06K2009/2045 ,  G06T2207/10012 ,  H04N13/0055 ,  H04N13/0239 ,  H04N13/0242 ,  H04N2013/0081 ,  H04N2013/0088

摘要： A system for generating three-dimensional mosaics from a plurality of input images representing an imaged scene. The plurality input images contain at least two images of a single scene, where at least two of the images have overlapping regions. The system combines the images using a parallax-based approach that generates a three-dimensional mosaic comprising an image mosaic representing a panoramic view of the scene and a shape mosaic representing the three dimensional geometry of the scene. Specifically, in one embodiment, the system registers the input images along a parametric surface within the imaged scene and derives translation vectors useful in aligning the images into a two-dimensional image mosaic. Once registered, the system generates a shape mosaic representing objects within the scene.

摘要翻译： 一种用于从表示成像场景的多个输入图像生成三维马赛克的系统。 多个输入图像包含单个场景的至少两个图像，其中至少两个图像具有重叠区域。 该系统使用基于视差的方法组合图像，该方法生成三维马赛克，其包括表示场景的全景的图像马赛克和表示场景的三维几何的形状马赛克。 具体地，在一个实施例中，系统沿着成像场景内的参数表面注册输入图像，并且导出用于将图像对准成二维图像拼接的有用的平移向量。 注册后，系统会生成一个表示场景中对象的形状马赛克。

公开(公告)号：US08200648B2

公开(公告)日：2012-06-12

申请号：US12376787

申请日：2007-08-07

申请人： Oren Boiman ,  Michal Irani

发明人： Oren Boiman ,  Michal Irani

IPC分类号： G06F17/30

CPC分类号： G10L17/00 ,  G06F17/30787 ,  G06F17/30799 ,  G06F17/30843 ,  G06K9/4671 ,  G10L15/00 ,  G10L25/00

摘要： A method includes finding regions of a reference signal which provide at least one of: local evidence scores and a global evidence score. The local evidence scores indicate local similarity of the regions of the reference signal to regions of a query signal and the global evidence score defines the extent of a global similarity of the query signal to the reference signal. A media exploring device is also included which includes an importance encoder and a media explorer. The importance encoder generates importance scores of at least portions of digital media as a function of at least one of local evidence scores and global evidence scores. The media explorer enables exploring through the digital media according to (i) the importance scores, (ii) data associations/links induced by the evidence scores between different portions of the digital media. The device may also include a media player to play the digital media with adaptive speeds as a function of the importance scores. The device may also include a labeling/annotation module which inherits labels/annotations/markings according to the abovementioned data associations.

摘要翻译： 一种方法包括找到参考信号的区域，其提供以下中的至少一个：局部证据得分和全局证据得分。 局部证据分数表示参考信号区域与查询信号区域的局部相似度，全局证据分数定义了查询信号与参考信号的全局相似度的程度。 还包括媒体探索设备，包括重要性编码器和媒体资源管理器。 重要性编码器产生数字媒体的至少一部分的重要度分数作为至少一个局部证据分数和全局证据得分的函数。 媒体探索者可以根据（i）重要性分数，（ii）由数字媒体不同部分之间的证据分数引起的数据关联/链接，通过数字媒体进行探索。 该设备还可以包括媒体播放器，以与重要性分数相关的自适应速度播放数字媒体。 该设备还可以包括标签/注释模块，其根据上述数据关联继承标签/注释/标记。

公开(公告)号：US20120086850A1

公开(公告)日：2012-04-12

申请号：US13138894

申请日：2010-04-20

申请人： Michal Irani ,  Daniel Glasner ,  Oded Shahar ,  Shai Bagon

发明人： Michal Irani ,  Daniel Glasner ,  Oded Shahar ,  Shai Bagon

IPC分类号： H04N7/01 ,  G06K9/00 ,  G06K9/32

CPC分类号： G06T3/4053 ,  G06T3/40 ,  G09G2340/0407

摘要： A method implementable on a computing device includes exploiting data redundancy to combine high frequency information from at least two different scales of an input signal to generate a super resolution version of said input signal. An alternative method includes exploiting recurrence of data from an input signal in at least two different scales of at least one reference signal to extract and to combine high frequency information from a plurality of scales of said at least one reference signal to generate a super resolution version of said input signal. An alternative method includes generating a super resolution version of a single input video sequence in at least the temporal dimension by exploiting data recurrence within the input video sequence or with respect to an external database of example video sequences. A signal may be an image, a video sequence, an audio signal, etc.

摘要翻译： 可在计算设备上实现的方法包括利用数据冗余来组合来自输入信号的至少两个不同尺度的高频信息以产生所述输入信号的超分辨率版本。 一种替代方法包括利用来自至少两个不同尺度的至少一个参考信号的来自输入信号的数据的再现以提取和组合来自所述至少一个参考信号的多个尺度的高频信息以产生超分辨率版本 的所述输入信号。 一种替代方法包括通过利用输入视频序列内的数据重复或相对于示例视频序列的外部数据库，至少在时间维度上生成单个输入视频序列的超分辨率版本。 信号可以是图像，视频序列，音频信号等

公开(公告)号：US20100104158A1

公开(公告)日：2010-04-29

申请号：US12519522

申请日：2007-12-20

申请人： Eli Shechtman ,  Michal Irani

发明人： Eli Shechtman ,  Michal Irani

IPC分类号： G06K9/46

CPC分类号： G06K9/46

摘要： A method includes matching at least portions of first, second signals using local self-similarity descriptors of the signals. The matching includes computing a local self-similarity descriptor for each one of at least a portion of points in the first signal, forming a query ensemble of the descriptors for the first signal and seeking an ensemble of descriptors of the second signal which matches the query ensemble of descriptors. This matching can be used for image categorization, object classification, object recognition, image segmentation, image alignment, video categorization, action recognition, action classification, video segmentation, video alignment, signal alignment, multi-sensor signal alignment, multi-sensor signal matching, optical character recognition, image and video synthesis, correspondence estimation, signal registration and change detection. It may also be used to synthesize a new signal with elements similar to those of a guiding signal synthesized from portions of the reference signal. Apparatus is also included.

摘要翻译： 一种方法包括使用信号的局部自相似性描述符来匹配第一，第二信号的至少一部分。 所述匹配包括为所述第一信号中的至少一部分点中的每一个计算一个局部自相似性描述符，形成所述第一信号的所述描述符的查询集合，并且寻找与所述查询匹配的所述第二信号的描述符的整体 描述符集合 该匹配可用于图像分类，对象分类，对象识别，图像分割，图像对齐，视频分类，动作识别，动作分类，视频分割，视频对齐，信号对齐，多传感器信号对齐，多传感器信号匹配 ，光学字符识别，图像和视频合成，对应估计，信号配准和变化检测。 它也可以用于合成具有与参考信号的部分合成的引导信号类似的元件的新信号。 还包括装置。