公开(公告)号：US08218963B2

公开(公告)日：2012-07-10

申请号：US12936228

申请日：2009-02-04

申请人： Rolf Adelsberger ,  Markus Gross ,  Marc Levoy ,  Remo Ziegler

发明人： Rolf Adelsberger ,  Markus Gross ,  Marc Levoy ,  Remo Ziegler

IPC分类号： G03B15/03

CPC分类号： G03B15/03 ,  G06F3/042 ,  G06F2203/04109 ,  G06F2203/04808

摘要： Using photographic flash for candid shots often results in an unevenly lit scene, in which objects in the back appear dark. A spatially adaptive photographic flash (100) is disclosed, in which the intensity of illumination (21, 23) varies depending on the depth and reflectivity (30, 101) of features in the scene. Adaption to changes in depth are used in a single-shot method. Adaption to changes in reflectivity are used in a multishot method. The single-shot method requires only a depth image (30), whereas the multi-shot method requires at least one color image (40) in addition to the depth data (30).

摘要翻译： 使用摄影闪光灯进行坦白的拍摄通常会导致不均匀照明的场景，后者中的物体看起来很暗。 公开了一种空间自适应照相闪光灯（100），其中照明强度（21,23）根据场景中的特征的深度和反射率（30,101）而变化。 适用于深度变化的单次方法使用。 适用于反射率的变化在多重方法中使用。 单次拍摄方法仅需要深度图像（30），而多拍摄方法除了深度数据（30）之外还需要至少一个彩色图像（40）。

公开(公告)号：US20110123183A1

公开(公告)日：2011-05-26

申请号：US12936228

申请日：2009-02-04

申请人： Rolf Adelsberger ,  Markus Gross ,  Marc Levoy ,  Remo Ziegler

发明人： Rolf Adelsberger ,  Markus Gross ,  Marc Levoy ,  Remo Ziegler

IPC分类号： G03B15/03

CPC分类号： G03B15/03 ,  G06F3/042 ,  G06F2203/04109 ,  G06F2203/04808

摘要： Using photographic flash for candid shots often results in an unevenly lit scene, in which objects in the back appear dark. A spatially adaptive photographic flash (100) is disclosed, in which the intensity of illumination (21, 23) varies depending on the depth and reflectivity (30, 101) of features in the scene. Adaption to changes in depth are used in a single-shot method. Adaption to changes in reflectivity are used in a multishot method. The single-shot method requires only a depth image (30), whereas the multi-shot method requires at least one color image (40) in addition to the depth data (30).

摘要翻译： 使用摄影闪光灯进行坦白的拍摄通常会导致不均匀照明的场景，后者中的物体看起来很暗。 公开了一种空间自适应照相闪光灯（100），其中照明强度（21,23）根据场景中的特征的深度和反射率（30,101）而变化。 适用于深度变化的单次方法使用。 适用于反射率的变化在多重方法中使用。 单次拍摄方法仅需要深度图像（30），而多拍摄方法除了深度数据（30）之外还需要至少一个彩色图像（40）。

公开(公告)号：US08200020B1

公开(公告)日：2012-06-12

申请号：US13305389

申请日：2011-11-28

申请人： Ryan Geiss ,  Marc Levoy

发明人： Ryan Geiss ,  Marc Levoy

IPC分类号： G06K9/46

CPC分类号： G06K9/6202 ,  G06K9/00979 ,  G06K9/4642

摘要： A computing device may select a source tile from a source image. From the source tile, the computing device may select a first rectangular feature and a second rectangular feature. Based on the first and second rectangular features, the computing device may calculate a source feature vector. The computing device may also select a search area of a target image, and a target tile within the within the search area. Based on the target tile, the computing device may calculate a target feature vector. The computing device may determine that a difference between the source feature vector and the target feature vector is below an error threshold, and based on this determination, further determine a mapping between the source image and the target image. The computing device may then apply the mapping to the source image to produce a transformed source image.

摘要翻译： 计算设备可以从源图像中选择源平铺。 从源平铺块，计算设备可以选择第一矩形特征和第二矩形特征。 基于第一和第二矩形特征，计算设备可以计算源特征向量。 计算设备还可以选择目标图像的搜索区域和搜索区域内的目标瓦片。 基于目标图块，计算设备可以计算目标特征向量。 计算设备可以确定源特征向量和目标特征向量之间的差异低于误差阈值，并且基于该确定，进一步确定源图像和目标图像之间的映射。 然后，计算设备可以将映射应用于源图像以产生经变换的源图像。

公开(公告)号：US20090309990A1

公开(公告)日：2009-12-17

申请号：US12137073

申请日：2008-06-11

申请人： Marc Levoy ,  Natasha Gelfand ,  Wei-Chao Chen ,  Kari Antero Pulli

发明人： Marc Levoy ,  Natasha Gelfand ,  Wei-Chao Chen ,  Kari Antero Pulli

IPC分类号： H04N5/228

CPC分类号： H04N5/23293 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23232 ,  H04N5/235 ,  H04N5/2355 ,  H04N5/765 ,  H04N5/772 ,  H04N5/775 ,  H04N9/8047

摘要： An apparatus for presenting burst images is provided. The apparatus may include a processor that may be configured to receive a plurality of burst images. Each burst image may differ from the other burst images based on a variable parameter, such as, but not limited to, exposure, focus, and/or time, or to the state of a target, such as the varying facial expression of a person. The processor may also be configured to provide for a presentation of a sample burst image. In this regard, the sample burst image may be one of the plurality of burst images. The processor may be further configured to receive a selected location within the presentation of the sample burst image and provide for a presentation of a plurality of burst image fragments associated with each of the plurality of burst images. In this regard, the burst image fragments may be portions of each of the burst images, where the areas of each burst image may be determined based on the selected location. Associated methods and computer program products may also be provided.

摘要翻译： 提供一种用于呈现突发图像的装置。 该装置可以包括可被配置为接收多个突发图像的处理器。 每个突发图像可以基于可变参数（例如但不限于曝光，焦点和/或时间）或目标的状态（例如人的变化的面部表情）与其他突发图像不同 。 处理器还可以被配置为提供样本突发图像的呈现。 在这点上，采样脉冲串图像可以是多个脉冲串图像之一。 处理器可以被进一步配置为在采样突发图像的呈现内接收所选择的位置，并提供与多个突发图像中的每一个相关联的多个突发图像片段的呈现。 在这方面，突发图像片段可以是每个突发图像的部分，其中可以基于所选择的位置来确定每个突发图像的区域。 还可以提供相关方法和计算机程序产品。

公开(公告)号：US6097394A

公开(公告)日：2000-08-01

申请号：US848569

申请日：1997-04-28

申请人： Marc Levoy ,  Pat Hanrahan

发明人： Marc Levoy ,  Pat Hanrahan

IPC分类号： G02B27/22 ,  G06T17/00 ,  G06T15/00

CPC分类号： G06T17/00 ,  G02B27/2271 ,  H04N13/0232

摘要： Described is a simple and robust method and system for generating new views from arbitrary camera positions without depth information or feature matching, simply by combining and resampling the available images. This technique interprets input images as two-dimensional slices of a four dimensional function--the light field. This function completely characterizes the flow of light through unobstructed space in a static scene with fixed illumination. A sampled representation for light fields allows for both efficient creation and display of inward and outward looking views. Light fields may be created from large arrays of both rendered and digitized image. The latter are acquired with a video camera mounted on a computer-controlled gantry. Once a light field has been created, new views may be constructed in real time by extracting slices in appropriate directions. Also described is a compression system that is able to compress generated light fields by more than a factor of 100:1 with very little loss of fidelity. Issues of antialiasing during creation and resampling during slice extraction are also addressed.

摘要翻译： 描述了一种简单而可靠的方法和系统，用于通过组合和重新采样可用图像来生成来自任意摄像机位置的新视图，无需深度信息或特征匹配。 该技术将输入图像解释为四维功能的二维切片 - 光场。 该功能通过固定照明的静态场景中的无障碍空间完全表征光的流动。 用于光场的采样表示允许有效地创建和显示向内和向外观看的视图。 光场可以由渲染和数字化图像的大阵列创建。 后者采用安装在计算机控制台架上的摄像机进行采集。 一旦创建了光场，就可以通过在适当的方向上提取切片来实时构建新视图。 还描述了一种能够以非常小的保真度损失将生成的光场压缩超过100:1的压缩系统。 在切片提取期间的创建和重采样期间的抗锯齿问题也被解决。

公开(公告)号：US08497920B2

公开(公告)日：2013-07-30

申请号：US12137073

申请日：2008-06-11

申请人： Marc Levoy ,  Natasha Gelfand ,  Wei-Chao Chen ,  Kari Antero Pulli

发明人： Marc Levoy ,  Natasha Gelfand ,  Wei-Chao Chen ,  Kari Antero Pulli

IPC分类号： H04N5/228

CPC分类号： H04N5/23293 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23232 ,  H04N5/235 ,  H04N5/2355 ,  H04N5/765 ,  H04N5/772 ,  H04N5/775 ,  H04N9/8047

摘要： An apparatus for presenting burst images is provided. The apparatus may include a processor that may be configured to receive a plurality of burst images. Each burst image may differ from the other burst images based on a variable parameter, such as, but not limited to, exposure, focus, and/or time, or to the state of a target, such as the varying facial expression of a person. The processor may also be configured to provide for a presentation of a sample burst image. In this regard, the sample burst image may be one of the plurality of burst images. The processor may be further configured to receive a selected location within the presentation of the sample burst image and provide for a presentation of a plurality of burst image fragments associated with each of the plurality of burst images. In this regard, the burst image fragments may be portions of each of the burst images, where the areas of each burst image may be determined based on the selected location. Associated methods and computer program products may also be provided.

摘要翻译： 提供一种用于呈现突发图像的装置。 该装置可以包括可被配置为接收多个突发图像的处理器。 每个突发图像可以基于可变参数（例如但不限于曝光，焦点和/或时间）或目标的状态（例如人的变化的面部表情）与其他突发图像不同 。 处理器还可以被配置为提供样本突发图像的呈现。 在这点上，采样脉冲串图像可以是多个脉冲串图像之一。 处理器可以被进一步配置为在采样突发图像的呈现内接收所选择的位置，并提供与多个突发图像中的每一个相关联的多个突发图像片段的呈现。 在这方面，突发图像片段可以是每个突发图像的部分，其中可以基于所选择的位置来确定每个突发图像的区域。 还可以提供相关方法和计算机程序产品。

公开(公告)号：US07586655B1

公开(公告)日：2009-09-08

申请号：US10611666

申请日：2003-06-30

申请人： Christopher R. Uhlik ,  Joseph K. O'Sullivan ,  Marc Levoy

发明人： Christopher R. Uhlik ,  Joseph K. O'Sullivan ,  Marc Levoy

IPC分类号： H04N1/04

CPC分类号： H04N1/195 ,  H04N1/00127 ,  H04N1/00323 ,  H04N1/19594 ,  H04N1/2036 ,  H04N2201/0434 ,  H04N2201/0458

摘要： Systems and methods for acquiring and using three-dimensional imaging data to improve the process of scanning bound documents are disclosed. The system includes a camera for capturing an image of documents such as books, and a second camera for gathering data regarding the first camera's field of view. Signal processing logic analyzes the data gathered by the second camera and uses it to determine whether the imaging camera's view was obstructed. If it is determined that the imaging camera's view was obstructed, then remedial action can be taken, such as removing the obstruction, recapturing the image, and/or flagging the image for further processing. The second camera may include a laser range finder, a scanning laser range finder, an ultrasonic range finder, a device that utilizes auto-focus range finding technology, a binocular camera array, and/or a trinocular camera array.

摘要翻译： 公开了用于获取和使用三维成像数据以改进扫描绑定文档的过程的系统和方法。 该系统包括用于捕获诸如书籍的文档的图像的相机，以及用于收集关于第一相机的视野的数据的第二相机。 信号处理逻辑分析由第二相机收集的数据，并用它来确定成像相机的视图是否被阻挡。 如果确定成像相机的视图被阻挡，则可以采取补救措施，例如去除障碍物，重新捕获图像和/或标记图像以进行进一步处理。 第二照相机可以包括激光测距仪，扫描激光测距仪，超声波测距仪，利用自动对焦测距技术的设备，双目相机阵列和/或三目相机阵列。

公开(公告)号：US20070030342A1

公开(公告)日：2007-02-08

申请号：US11187699

申请日：2005-07-21

申请人： Bennett Wilburn ,  Neel Joshi ,  Marc Levoy ,  Mark Horowitz

发明人： Bennett Wilburn ,  Neel Joshi ,  Marc Levoy ,  Mark Horowitz

IPC分类号： H04N13/02

CPC分类号： H04N5/247 ,  H04N5/3532 ,  H04N5/357

摘要： This invention relates to an apparatus and a method for video capture of a three-dimensional region of interest in a scene using an array of video cameras. The video cameras of the array are positioned for viewing the three-dimensional region of interest in the scene from their respective viewpoints. A triggering mechanism is provided for staggering the capture of a set of frames by the video cameras of the array. The apparatus has a processing unit for combining and operating on the set of frames captured by the array of cameras to generate a new visual output, such as high-speed video or spatio-temporal structure and motion models, that has a synthetic viewpoint of the three-dimensional region of interest. The processing involves spatio-temporal interpolation for determining the synthetic viewpoint space-time trajectory. In some embodiments, the apparatus computes a multibaseline spatio-temporal optical flow.

摘要翻译： 本发明涉及使用摄像机阵列在场景中对三维感兴趣区域进行视频采集的装置和方法。 阵列的摄像机被定位成从它们各自的视点观看场景中的感兴趣的三维区域。 提供了一种触发机制，用于通过阵列的摄像机交错捕获一组帧。 该装置具有处理单元，用于组合并操作由相机阵列捕获的一组帧，以产生新的视觉输出，例如高速视频或时空结构和运动模型，其具有合成视点 感兴趣的三维区域。 该处理涉及用于确定合成视点时空轨迹的时空插值。 在一些实施例中，该装置计算多基线时空光流。

公开(公告)号：US08411962B1

公开(公告)日：2013-04-02

申请号：US13458334

申请日：2012-04-27

申请人： Ryan Geiss ,  Marc Levoy

发明人： Ryan Geiss ,  Marc Levoy

IPC分类号： G06K9/46

CPC分类号： G06K9/6202 ,  G06K9/00979 ,  G06K9/4642

摘要： A computing device may select a source tile from a source image. From the source tile, the computing device may select a first rectangular feature and a second rectangular feature. Based on the first and second rectangular features, the computing device may calculate a source feature vector. The computing device may also select a search area of a target image, and a target tile within the within the search area. Based on the target tile, the computing device may calculate a target feature vector. The computing device may determine that a difference between the source feature vector and the target feature vector is below an error threshold, and based on this determination, further determine a mapping between the source image and the target image. The computing device may then apply the mapping to the source image to produce a transformed source image.

摘要翻译： 计算设备可以从源图像中选择源平铺。 从源平铺块，计算设备可以选择第一矩形特征和第二矩形特征。 基于第一和第二矩形特征，计算设备可以计算源特征向量。 计算设备还可以选择目标图像的搜索区域和搜索区域内的目标瓦片。 基于目标图块，计算设备可以计算目标特征向量。 计算设备可以确定源特征向量和目标特征向量之间的差异低于误差阈值，并且基于该确定，进一步确定源图像和目标图像之间的映射。 然后，计算设备可以将映射应用于源图像以产生经变换的源图像。

公开(公告)号：US08174739B2

公开(公告)日：2012-05-08

申请号：US12503041

申请日：2009-07-14

申请人： Robert A. Proudfoot ,  Marc Levoy

发明人： Robert A. Proudfoot ,  Marc Levoy

IPC分类号： H04N1/04

CPC分类号： H04N1/02815 ,  H04N1/00013 ,  H04N1/00031 ,  H04N1/00063 ,  H04N1/00087 ,  H04N1/0282 ,  H04N1/02895 ,  H04N1/195 ,  H04N1/19594 ,  H04N2201/0434

摘要： Systems and methods using polarized filtering for glare removal to improve the process of scanning documents, particularly bound documents with glossy content, are disclosed. The system may generally include a lighting source for illuminating a document, a lighting source polarizer attached to the lighting source to polarize light therefrom, a camera for capturing images of the document, and a camera polarizer attached to the camera. The camera polarizer and the lighting source polarizer may be positioned relative to each other so as to facilitate blocking light reflections causing glare off of the document resulting from the lighting source and arriving at the camera. The system may include multiple lighting sources, some or all of which may have a lighting source polarizer attached thereto.

摘要翻译： 公开了使用偏振滤波进行眩光去除以改善扫描文档的过程的系统和方法，特别是具有光泽内容的绑定文档。 该系统通常可以包括用于照亮文件的照明源，附接到照明源的照明源偏振器以使光偏振，用于拍摄文档的图像的相机以及附着到相机的相机偏振器。 相机偏振器和照明源偏振器可以相对于彼此定位，以便于阻挡光反射，从而导致由照明源产生的文档的眩光并到达相机。 该系统可以包括多个光源，其中的一些或全部可以具有附接到其上的照明源偏振片。