公开(公告)号：US08130293B2

公开(公告)日：2012-03-06

申请号：US12307789

申请日：2008-05-14

申请人： Katsuhiro Kanamori ,  Satoshi Sato

发明人： Katsuhiro Kanamori ,  Satoshi Sato

IPC分类号： H04N9/083 ,  H04N5/228

CPC分类号： H04N9/045 ,  H04N2209/046

摘要： An image processing apparatus according to the present invention includes: a color and polarization obtaining section 101 including a single-chip color image capture device that has a color mosaic filter 201 and a patterned polarizer 202 in which a number of polarizer units, having polarization transmission planes defining mutually different angles, are provided for multiple pixels of the same color (G) in the color mosaic filter 201; a polarization information processing section 103 for approximating, as a sinusoidal function, a relation between the intensities of light rays that have been transmitted through the polarizer units for the G pixels and the angles of the polarization transmission planes of the polarizer units; and a color mosaic interpolation section 103 for generating a color intensity image by performing color intensity interpolation and getting a color intensity that cannot be obtained at a pixel of interest.

摘要翻译： 根据本发明的图像处理装置包括：颜色和偏振获取部分101，包括具有彩色马赛克滤光器201和图案偏振器202的单片彩色图像捕获装置，其中多个具有偏振透射的偏振器单元 为颜色马赛克滤镜201中的相同颜色（G）的多个像素提供限定相互不同角度的平面; 极化信息处理部103，用于近似作为正弦函数的已经通过用于G像素的偏振器单元的透射光的强度与偏振器单元的偏振透射面的角度之间的关系; 以及颜色马赛克内插部分103，用于通过执行颜色强度插值和获得在感兴趣的像素处不能获得的颜色强度来产生颜色强度图像。

公开(公告)号：US07961222B2

公开(公告)日：2011-06-14

申请号：US12294368

申请日：2008-03-13

申请人： Hideto Motomura ,  Katsuhiro Kanamori ,  Satoshi Sato

发明人： Hideto Motomura ,  Katsuhiro Kanamori ,  Satoshi Sato

IPC分类号： H04N5/228

CPC分类号： G03B5/00 ,  H04N5/23248 ,  H04N5/23254 ,  H04N5/2327

摘要： To provide an image capturing apparatus that detects a camera movement accurately and corrects image blurring appropriately. An image capturing apparatus (200) includes: an image sensor unit (103) that captures and outputs an input image (105); an output unit (121) that outputs an image of a framing area (160) of the input image (105); a motion vector calculation unit (106) and a stationary object detection unit (201) that detect motion vectors in an outer-frame area (161) of the input image (105) and derive detection accuracy; an outer-frame area adjustment unit (205) that adjusts the outer-frame area (161) in size so that the detection accuracy meets an outer-frame area change threshold (tr); and a camera movement calculation unit (113) and a framing area modification unit (115) that move the framing area (160) according to motion vectors in the adjusted outer-frame area (161), irrespective of motion vectors in the other area.

摘要翻译： 提供一种正确检测相机移动并适当地校正图像模糊的图像捕获装置。 一种图像捕获设备（200）包括：捕获并输出输入图像（105）的图像传感器单元（103）。 输出单元（121），其输出所述输入图像（105）的成帧区域（160）的图像; 检测输入图像（105）的外框区域（161）中的运动矢量并导出检测精度的运动矢量计算单元（106）和静止物体检测单元（201） 调整外框区域（161）的外框区域调整单元（205），使得检测精度满足外框区域变更阈值（tr）; 以及相机移动计算单元（113）和成帧区域修改单元（115），其根据其他区域中的运动矢量，根据调整后的外框区域（161）中的运动向量移动成帧区域（160）。

公开(公告)号：US07893971B2

公开(公告)日：2011-02-22

申请号：US12630884

申请日：2009-12-04

申请人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

发明人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

IPC分类号： H04N9/68

CPC分类号： G06T3/4053

摘要： An imaging device condition determination section determines whether a condition of an imaging device is suitable for obtaining light source information. When it is determined to be suitable, a light source image obtaining section obtains a light source image by the imaging device. A first imaging device information obtaining section obtains first imaging device information representing the condition of the imaging device at a point in time when the light source image is obtained. A second imaging device information obtaining section obtains second imaging device information representing the condition of the imaging device at a time of actual image capturing. A light source information estimating section estimates light source information at the time of image capturing by using the light source image and the first and second imaging device information.

摘要翻译： 成像装置条件确定部分确定成像装置的条件是否适于获得光源信息。 当确定为合适时，光源图像获取部分通过成像装置获得光源图像。 第一成像设备信息获取部分获得表示获得光源图像的时间点的成像设备的状态的第一成像设备信息。 第二成像设备信息获取部分获取表示实际图像捕获时的成像设备的状态的第二成像设备信息。 光源信息估计部通过使用光源图像和第一和第二成像装置信息来估计图像拍摄时的光源信息。

公开(公告)号：US20100303344A1

公开(公告)日：2010-12-02

申请号：US12672940

申请日：2009-05-15

申请人： Satoshi Sato ,  Katsuhiro Kanamori

发明人： Satoshi Sato ,  Katsuhiro Kanamori

IPC分类号： G06K9/00

CPC分类号： H04N9/045 ,  G06T7/11 ,  G06T2207/10024

摘要： An image processing apparatus captures an object's image and separates the object's image into multiple components. The apparatus includes: a light projecting section 101 for projecting light emitted from a light source toward the object; a color and polarization obtaining section 102 for getting a color polarized image of the object; a polarization information processing section 104 for generating color and polarization information based on an association between the intensity of the light that has been transmitted through a polarizer with three or more polarization principal axis directions and the polarization principal axis directions for each of unit pixels that form the color polarized image; a light source color information collecting section 105 for collecting color information of the light source; and an image component separating section 106 for separating the color image into multiple components based on the polarization information and the color information of the light source.

摘要翻译： 图像处理装置捕获对象的图像并将对象的图像分离成多个分量。 该装置包括：用于将从光源发射的光投射到物体的光投射部101; 用于获得对象的彩色偏振图像的颜色和偏振获得部分102; 偏振信息处理部分104，用于基于形成有三个或更多个偏振主轴方向的偏振器透射的光的强度与形成的每个单位像素的偏振主轴方向之间的关联来产生颜色和偏振信息 彩色偏光图像; 用于收集光源的颜色信息的光源颜色信息收集部分105; 以及用于基于偏振信息和光源的颜色信息将彩色图像分离成多个分量的图像分量分离部分106。

公开(公告)号：US20100253820A1

公开(公告)日：2010-10-07

申请号：US12744423

申请日：2008-11-28

申请人： Katsuhiro Kanamori ,  Satoshi Sato

发明人： Katsuhiro Kanamori ,  Satoshi Sato

IPC分类号： H04N5/335

CPC分类号： H01L27/14621 ,  H04N9/045 ,  H04N2209/046

摘要： An image processing apparatus according to the present invention includes a single-chip color image capture element that has a color mosaic filter 201 and a patterned polarizer 202 in which a number of polarizer units, having polarization transmission planes defining at least three different angles, are provided for multiple pixels of the same color (G) in the color mosaic filter 201. This apparatus includes not only a color and polarization obtaining section 101 including such a single-chip color image capture element but also a polarization information processing section 103 for approximating, as a sinusoidal function, a relation between the intensities of light rays that have been transmitted through the polarizer units for the G pixels and the angles of the polarization transmission planes of the polarizer units and a color mosaic interpolation section 102 for generating a color intensity image by performing a color intensity interpolation and getting a color intensity that cannot be obtained at a pixel of interest.

摘要翻译： 根据本发明的图像处理装置包括具有彩色马赛克滤光器201和图案化偏振器202的单芯片彩色图像捕获元件，其中具有限定至少三个不同角度的偏振透射平面的多个偏振器单元是 提供了颜色马赛克滤波器201中相同颜色（G）的多个像素。该装置不仅包括包括这样的单芯片彩色图像捕获元件的颜色和偏振获取部分101，而且包括用于近似的偏振信息处理部分103 作为正弦函数，已经透射通过用于G像素的偏振器单元的光线的强度与偏振器单元的偏振透射平面的角度之间的关系和用于产生颜色强度的颜色马赛克内插部分102 通过执行颜色强度插值并获得不能的颜色强度的图像 在感兴趣的像素处获得。

公开(公告)号：US07688363B2

公开(公告)日：2010-03-30

申请号：US12080230

申请日：2008-03-31

申请人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

发明人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

IPC分类号： H04N5/262 ,  G06K9/32

CPC分类号： G06T3/4053

摘要： An albedo estimating section produces an albedo image of an object from an original image captured by an image-capturing section by using light source information estimated by a light source information estimating section and shape information of the object obtained by a shape information obtaining section. An albedo super-resolution section performs super-resolution of the albedo image according to a conversion rule obtained from an albedo DB. A super-resolution section produces a high-resolution image obtained by performing super-resolution of the original image by using the super-resolution albedo image, the light source information and the shape information.

摘要翻译： 反照率估计部分通过使用由光源信息估计部分估计的光源信息和由形状信息获取部分获得的对象的形状信息，从由图像拍摄部分拍摄的原始图像产生对象的反照率图像。 反照率超分辨率部分根据从反照率DB获得的转换规则执行反照率图像的超分辨率。 超分辨率部分通过使用超分辨率反照率图像，光源信息和形状信息来产生通过执行原始图像的超分辨率而获得的高分辨率图像。

公开(公告)号：US07609892B2

公开(公告)日：2009-10-27

申请号：US11922013

申请日：2006-07-12

申请人： Satoshi Sato ,  Kunio Nobori ,  Katsuhiro Kanamori

发明人： Satoshi Sato ,  Kunio Nobori ,  Katsuhiro Kanamori

IPC分类号： G06K9/00 ,  G06K9/34

CPC分类号： H04N5/235 ,  G06T5/007 ,  G06T7/11 ,  G06T7/174 ,  G06T7/42 ,  G06T2207/10152 ,  G06T2207/20056

摘要： The process captures a plurality of images under a light source whose luminance varies over time, such as a fluorescent lamp, under such an imaging condition that a plurality of images that are different from one another in terms of light source conditions can be captured (S11). The process detects a temporal luminance variation from the plurality of captured images (S12), estimates a shadow area by using the temporal luminance variation (S13), and performs an image process such as a process of synthesizing a linearized image or an image segmentation based on optical characteristics (S14).

摘要翻译： 在能够捕获在光源条件方面彼此不同的多个图像的成像条件下，该处理捕获亮度随时间变化的光源（例如荧光灯）下的多个图像（S11 ）。 该过程检测来自多个拍摄图像的时间亮度变化（S12），通过使用时间亮度变化来估计阴影区域（S13），并且执行诸如合成线性化图像或图像分割的处理的图像处理 关于光学特性（S14）。

公开(公告)号：US20090135183A1

公开(公告)日：2009-05-28

申请号：US12361707

申请日：2009-01-29

申请人： Satoshi Sato ,  Katsuhiro Kanamori ,  Natsuki Saito ,  Mikiya Nakata

发明人： Satoshi Sato ,  Katsuhiro Kanamori ,  Natsuki Saito ,  Mikiya Nakata

IPC分类号： G06T15/60

CPC分类号： G01B11/002 ,  G01S15/02 ,  G06T7/11 ,  G06T7/514 ,  G06T7/70 ,  G06T15/50 ,  G06T15/60 ,  H04N5/232 ,  H04N5/2351

摘要： The normal vector information generating device generates normal vector information on the surface of an object, and includes: an image information obtaining unit obtaining information about an image of the object, the information including luminance information about luminance of light from the object and polarization information about polarization of the light; a shadow area extracting unit extracting an attached shadow area and a cast shadow area from the image based on the luminance information and the polarization information, the attached shadow area appearing on the surface of the object depending on an angle of incidence light, and the cast shadow area appearing on the surface of a material body when the light is blocked by the object; and a normal vector information generating unit generating normal vector information identifying a normal vector on the surface of the object in the attached shadow area using the polarization information.

摘要翻译： 法线矢量信息生成装置在物体的表面上生成法线矢量信息，包括：图像信息获取单元获取关于对象的图像的信息，包括关于来自物体的光的亮度的亮度信息的信息和关于 光的极化; 阴影区域提取单元基于亮度信息和偏振信息从图像提取附加的阴影区域和投影区域，根据入射光出现在物体的表面上的附加阴影区域，以及投射 当物体被物体遮挡时，物体表面出现阴影区域; 以及法线信息生成单元，使用偏振信息生成用于识别所附加的阴影区域中的物体的表面上的法线矢量的法线矢量信息。

公开(公告)号：US20090028424A1

公开(公告)日：2009-01-29

申请号：US11922013

申请日：2006-07-12

申请人： Satoshi Sato ,  Kunio Nobori ,  Katsuhiro Kanamori

发明人： Satoshi Sato ,  Kunio Nobori ,  Katsuhiro Kanamori

IPC分类号： G06K9/00 ,  G06K9/34

CPC分类号： H04N5/235 ,  G06T5/007 ,  G06T7/11 ,  G06T7/174 ,  G06T7/42 ,  G06T2207/10152 ,  G06T2207/20056

摘要： The process captures a plurality of images under a light source whose luminance varies over time, such as a fluorescent lamp, under such an imaging condition that a plurality of images that are different from one another in terms of light source conditions can be captured (S11). The process detects a temporal luminance variation from the plurality of captured images (S12), estimates a shadow area by using the temporal luminance variation (S13), and performs an image process such as a process of synthesizing a linearized image or an image segmentation based on optical characteristics (S14).

摘要翻译： 在能够捕获在光源条件方面彼此不同的多个图像的成像条件下，该处理捕获亮度随时间变化的光源（例如荧光灯）下的多个图像（S11 ）。 该过程检测来自多个拍摄图像的时间亮度变化（S12），通过使用时间亮度变化来估计阴影区域（S13），并且执行诸如合成线性化图像或图像分割的处理的图像处理 关于光学特性（S14）。

公开(公告)号：US20080231729A1

公开(公告)日：2008-09-25

申请号：US12080228

申请日：2008-03-31

申请人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

发明人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

IPC分类号： H04N5/235

CPC分类号： G06T3/4053

摘要： An imaging device condition determination section determines whether a condition of an imaging device is suitable for obtaining light source information. When it is determined to be suitable, a light source image obtaining section obtains a light source image by the imaging device. A first imaging device information obtaining section obtains first imaging device information representing the condition of the imaging device at a point in time when the light source image is obtained. A second imaging device information obtaining section obtains second imaging device information representing the condition of the imaging device at a time of actual image capturing. A light source information estimating section estimates light source information at the time of image capturing by using the light source image and the first and second imaging device information.

摘要翻译： 成像装置条件确定部分确定成像装置的条件是否适于获得光源信息。 当确定为合适时，光源图像获取部分通过成像装置获得光源图像。 第一成像设备信息获取部分获得表示获得光源图像的时间点的成像设备的状态的第一成像设备信息。 第二成像设备信息获取部分获取表示实际图像捕获时的成像设备的状态的第二成像设备信息。 光源信息估计部通过使用光源图像和第一和第二成像装置信息来估计图像拍摄时的光源信息。