Capturing and Processing of Images Including Occlusions Captured by Heterogeneous Camera Arrays
    1.
    发明申请
    Capturing and Processing of Images Including Occlusions Captured by Heterogeneous Camera Arrays 审中-公开
    捕获和处理包含由异构相机阵列捕获的遮挡的图像

    公开(公告)号:US20160269664A1

    公开(公告)日:2016-09-15

    申请号:US15043997

    申请日:2016-02-15

    Inventor: Jacques Duparre

    Abstract: Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. Lens stack arrays in accordance with many embodiments of the invention include lens elements formed on substrates separated by spacers, where the lens elements, substrates and spacers are configured to form a plurality of optical channels, at least one aperture located within each optical channel, at least one spectral filter located within each optical channel, where each spectral filter is configured to pass a specific spectral band of light, and light blocking materials located within the lens stack array to optically isolate the optical channels.

    Abstract translation: 公开了一种用于实现阵列相机的系统和方法,其被配置为执行超分辨率处理以使用可用于阵列相机中的多个捕获图像和透镜组阵列来生成更高分辨率的超分辨率图像。 根据本发明的许多实施例的透镜组排列包括形成在由衬垫分隔的衬底上的透镜元件,其中透镜元件,衬底和衬垫被配置成形成多个光通道,位于每个光通道内的至少一个孔, 位于每个光通道内的至少一个光谱滤波器,其中每个光谱滤波器被配置成通过特定的光谱带,以及位于透镜堆叠阵列内的光阻挡材料以光学隔离光通道。

    Thin form factor computational array cameras and modular array cameras

    公开(公告)号:US09338332B2

    公开(公告)日:2016-05-10

    申请号:US14188521

    申请日:2014-02-24

    Abstract: Systems and methods in accordance with embodiments of the invention implement one-dimensional array cameras, as well as modular array cameras using sub-array modules. In one embodiment, a 1×N array camera module includes: a 1×N arrangement of focal planes, where N is greater than or equal to 2, each focal plane includes a plurality of rows of pixels that also form a plurality of columns of pixels, and each focal plane not including pixels from another focal plane; and a 1×N arrangement of lens stacks, the arrangement of lens stacks being disposed relative to the arrangement of focal planes so as to form a 1×N arrangement of cameras, each configured to independently capture an image of a scene, where each lens stack has a field of view that is shifted with respect to that of each other lens stack so that each shift includes a sub-pixel shifted view of the scene.

    Optical arrangements for use with an array camera
    3.
    发明授权
    Optical arrangements for use with an array camera 有权
    用于阵列相机的光学布置

    公开(公告)号:US09128228B2

    公开(公告)日:2015-09-08

    申请号:US14281534

    申请日:2014-05-19

    Inventor: Jacques Duparre

    Abstract: A variety of optical arrangements and methods of modifying or enhancing the optical characteristics and functionality of these optical arrangements are provided. The optical arrangements being specifically designed to operate with camera arrays that incorporate an imaging device that is formed of a plurality of imagers that each include a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers.

    Abstract translation: 提供了各种光学布置和修改或增强这些光学装置的光学特性和功能的方法。 光学装置被专门设计成与包括由多个成像器形成的成像装置的相机阵列一起操作,每个成像器各自包括多个像素。 多个成像器包括具有第一成像特性的第一成像器和具有第二成像特性的第二成像器。 处理由多个成像器生成的图像以获得与由成像器捕获的图像相比的增强图像。

    Systems and methods for detecting defective camera arrays and optic arrays
    5.
    发明授权
    Systems and methods for detecting defective camera arrays and optic arrays 有权
    用于检测有缺陷的相机阵列和光学阵列的系统和方法

    公开(公告)号:US09100635B2

    公开(公告)日:2015-08-04

    申请号:US13931724

    申请日:2013-06-28

    CPC classification number: H04N17/002 H04N5/2171 H04N5/2254 H04N5/367

    Abstract: Systems and methods for detecting defective camera arrays, optic arrays and/or sensors are described. One embodiment includes capturing image data using a camera array; dividing the captured images into a plurality of corresponding image regions; identifying the presence of localized defects in any of the cameras by evaluating the image regions in the captured images; and detecting a defective camera array using the image processing system when the number of localized defects in a specific set of image regions exceeds a predetermined threshold, where the specific set of image regions is formed by: a common corresponding image region from at least a subset of the captured images; and any additional image region in a given image that contains at least one pixel located within a predetermined maximum parallax shift distance along an epipolar line from a pixel within said common corresponding image region within the given image.

    Abstract translation: 描述用于检测有缺陷的相机阵列,光学阵列和/或传感器的系统和方法。 一个实施例包括使用相机阵列捕获图像数据; 将捕获的图像划分为多个对应的图像区域; 通过评估所捕获的图像中的图像区域来识别任何相机中的局部缺陷的存在; 以及当所述特定图像区域集合中的局部缺陷的数量超过预定阈值时,使用所述图像处理系统检测缺陷相机阵列,其中所述特定图像区域集合由以下形成:来自至少一个子集的公共对应图像区域 的拍摄图像; 以及给定图像中包含沿给定图像内的所述公共对应图像区域内的像素沿着核线的位于预定最大视差移位距离内的至少一个像素的任何附加图像区域。

    THIN FORM FACTOR COMPUTATIONAL ARRAY CAMERAS AND MODULAR ARRAY CAMERAS
    8.
    发明申请
    THIN FORM FACTOR COMPUTATIONAL ARRAY CAMERAS AND MODULAR ARRAY CAMERAS 有权
    薄型因子计算阵列相机和模块阵列相机

    公开(公告)号:US20140240529A1

    公开(公告)日:2014-08-28

    申请号:US14188524

    申请日:2014-02-24

    Abstract: Systems and methods in accordance with embodiments of the invention implement modular array cameras using sub-array modules. In one embodiment, an X×Y sub-array module includes: an X×Y arrangement of focal planes, where X and Y are each greater than or equal to 1; and an X×Y arrangement of lens stacks, the X×Y arrangement of lens stacks being disposed relative to the X×Y arrangement of focal planes so as to form an X×Y arrangement of cameras, where each lens stack has a field of view that is shifted with respect to the field-of-views of each other lens stack so that each shift includes a sub-pixel shifted view of the scene; and image data output circuitry that is configured to output image data from the X×Y sub-array module that can be aggregated with image data from other sub-array modules so that an image of the scene can be constructed.

    Abstract translation: 根据本发明的实施例的系统和方法使用子阵列模块实现模块化阵列相机。 在一个实施例中,X×Y子阵列模块包括:X×Y焦平面布置,其中X和Y各自大于或等于1; 和X×Y布置的透镜组,透镜组的X×Y布置相对于焦平面的X×Y布置设置,以形成相机的X×Y布置,其中每个透镜叠层具有 相对于彼此的透镜叠层的视场偏移的视图,使得每个偏移包括场景的子像素偏移视图; 以及图像数据输出电路,其被配置为从X×Y子阵列模块输出可以与来自其他子阵列模块的图像数据聚合的图像数据,从而可以构建场景的图像。

    SYSTEMS AND METHODS FOR DETECTING DEFECTIVE CAMERA ARRAYS AND OPTIC ARRAYS
    9.
    发明申请
    SYSTEMS AND METHODS FOR DETECTING DEFECTIVE CAMERA ARRAYS AND OPTIC ARRAYS 有权
    用于检测有缺陷的相机阵列和光学阵列的系统和方法

    公开(公告)号:US20140002675A1

    公开(公告)日:2014-01-02

    申请号:US13931724

    申请日:2013-06-28

    CPC classification number: H04N17/002 H04N5/2171 H04N5/2254 H04N5/367

    Abstract: Systems and methods for detecting defective camera arrays, optic arrays and/or sensors are described. One embodiment includes capturing image data using a camera array; dividing the captured images into a plurality of corresponding image regions; identifying the presence of localized defects in any of the cameras by evaluating the image regions in the captured images; and detecting a defective camera array using the image processing system when the number of localized defects in a specific set of image regions exceeds a predetermined threshold, where the specific set of image regions is formed by: a common corresponding image region from at least a subset of the captured images; and any additional image region in a given image that contains at least one pixel located within a predetermined maximum parallax shift distance along an epipolar line from a pixel within said common corresponding image region within the given image.

    Abstract translation: 描述用于检测有缺陷的相机阵列,光学阵列和/或传感器的系统和方法。 一个实施例包括使用相机阵列捕获图像数据; 将捕获的图像划分为多个对应的图像区域; 通过评估所捕获的图像中的图像区域来识别任何相机中的局部缺陷的存在; 以及当所述特定图像区域集合中的局部缺陷的数量超过预定阈值时,使用所述图像处理系统检测缺陷相机阵列,其中所述特定图像区域集合由以下形成:来自至少一个子集的公共对应图像区域 的拍摄图像; 以及给定图像中包含沿给定图像内的所述公共对应图像区域内的像素沿着核线的位于预定最大视差移位距离内的至少一个像素的任何附加图像区域。

    Systems and Methods for Manufacturing Camera Modules Using Active Alignment of Lens Stack Arrays and Sensors
    10.
    发明申请
    Systems and Methods for Manufacturing Camera Modules Using Active Alignment of Lens Stack Arrays and Sensors 有权
    使用镜头堆栈阵列和传感器的主动对准制造相机模块的系统和方法

    公开(公告)号:US20160266284A1

    公开(公告)日:2016-09-15

    申请号:US15004759

    申请日:2016-01-22

    Abstract: Systems and methods in accordance with embodiments of the invention actively align a lens stack array with an array of focal planes to construct an array camera module. In one embodiment, a method for actively aligning a lens stack array with a sensor that has a focal plane array includes: aligning the lens stack array relative to the sensor in an initial position; varying the spatial relationship between the lens stack array and the sensor; capturing images of a known target that has a region of interest using a plurality of active focal planes at different spatial relationships; scoring the images based on the extent to which the region of interest is focused in the images; selecting a spatial relationship between the lens stack array and the sensor based on a comparison of the scores; and forming an array camera subassembly based on the selected spatial relationship.

    Abstract translation: 根据本发明的实施例的系统和方法主动地将透镜堆叠阵列与焦平面阵列对准以构成阵列相机模块。 在一个实施例中,用于主动对准透镜堆叠阵列与具有焦平面阵列的传感器的方法包括:使镜片堆叠阵列相对于传感器在初始位置对准; 改变透镜叠层阵列与传感器之间的空间关系; 使用具有不同空间关系的多个活动焦平面捕获具有感兴趣区域的已知目标的图像; 根据感兴趣区域集中在图像中的程度对图像进行评分; 基于得分的比较来选择透镜组阵列与传感器之间的空间关系; 以及基于所选择的空间关系形成阵列相机子组件。

Patent Agency Ranking