公开(公告)号：US08390696B2

公开(公告)日：2013-03-05

申请号：US12935321

申请日：2009-12-18

申请人： Ayako Komoto ,  Katsuhiro Kanamori ,  Satoshi Sato

发明人： Ayako Komoto ,  Katsuhiro Kanamori ,  Satoshi Sato

IPC分类号： H04N5/228

CPC分类号： H04N5/2251 ,  H04N5/2628 ,  H04N9/045

摘要： A polarization camera that can capture polarization images and a color image at the same time is used. Specifically, a clear sky polarization image, which provides information about the polarization of a part of the sky, is captured by a clear sky polarization image capturing section 100. And by reference to the information provided by a sun position determining section 1301 that determines the sun's position at the time of shooting, a camera direction estimating section 101 determines in what direction and in what area of the whole sky the clear sky polarization image is located as a polarization pattern. Finally, information about what direction or orientation on the globe the camera (image capture device) is now facing is output. In this manner, the direction of the camera and the relative position of the camera with respect to the sun can be known without providing a sensor separately and without capturing the whole sky or the sun.

摘要翻译： 使用可以同时捕获偏振图像和彩色图像的偏振照相机。 具体而言，由晴空偏振图像拍摄部100拍摄提供关于天空的一部分的偏振的信息的晴空偏振图像。参照由太阳位置确定部1301提供的信息，该太阳位置确定部1301确定 太阳在拍摄时的位置，照相机方向估计部101确定清晰天空偏振图像位于什么方向和整个天空的哪个区域作为偏振图案。 最后，输出有关相机（图像捕获设备）现在正在面向的全球方向或方向的信息。 以这种方式，相机相对于太阳的照相机的方向和相对位置可以是已知的，而不需要分别提供传感器而不捕获整个天空或太阳。

公开(公告)号：US20110050854A1

公开(公告)日：2011-03-03

申请号：US12935304

申请日：2009-12-16

申请人： Katsuhiro Kanamori ,  Ayako Komoto ,  Satoshi Sato

发明人： Katsuhiro Kanamori ,  Ayako Komoto ,  Satoshi Sato

IPC分类号： H04N13/02

CPC分类号： G06T7/55 ,  G06T2207/10024 ,  H04N13/25 ,  H04N13/261

摘要： The present invention provides an apparatus that includes a color and polarization image capturing section 201, a whole sky polarization map getting section 202, a weather determining section 203, a fine-weather sky part separating section 204, a cloudy-weather normal estimating section 207, and a pseudo 3D image generating section 208. The apparatus obtains polarization information outdoors with the polarization state of the sky taken into account, and estimates surface normal information at an object's surface on a two-dimensional image, thereby generating a surface normal image. Using that normal image, the apparatus divides the object into multiple ranges, extracts three-dimensional information and generates a viewpoint changed image, thereby generating a pseudo 3D image.

摘要翻译： 本发明提供一种装置，其包括彩色和偏振图像拍摄部分201，全天空偏振地图获取部分202，天气确定部分203，晴天天气部分分离部分204，多云天气正常估计部分207 以及伪3D图像生成部208.该装置在考虑了天空的偏振状态的情况下在室外获取偏振信息，并且估计二维图像上物体表面的表面法线信息，从而生成表面法线图像。 使用该正常图像，设备将对象分成多个范围，提取三维信息并生成视点改变图像，从而生成伪3D图像。

公开(公告)号：US08654179B2

公开(公告)日：2014-02-18

申请号：US12935304

申请日：2009-12-16

申请人： Katsuhiro Kanamori ,  Ayako Komoto ,  Satoshi Sato

发明人： Katsuhiro Kanamori ,  Ayako Komoto ,  Satoshi Sato

IPC分类号： H04N13/02

CPC分类号： G06T7/55 ,  G06T2207/10024 ,  H04N13/25 ,  H04N13/261

摘要： The present invention provides an apparatus that includes a color and polarization image capturing section 201, a whole sky polarization map getting section 202, a weather determining section 203, a fine-weather sky part separating section 204, a cloudy-weather normal estimating section 207, and a pseudo 3D image generating section 208. The apparatus obtains polarization information outdoors with the polarization state of the sky taken into account, and estimates surface normal information at an object's surface on a two-dimensional image, thereby generating a surface normal image. Using that normal image, the apparatus divides the object into multiple ranges, extracts three-dimensional information and generates a viewpoint changed image, thereby generating a pseudo 3D image.

摘要翻译： 本发明提供一种装置，其包括彩色和偏振图像拍摄部分201，全天空偏振地图获取部分202，天气确定部分203，晴天天气部分分离部分204，多云天气正常估计部分207 以及伪3D图像生成部208.该装置在考虑了天空的偏振状态的情况下在室外获取偏振信息，并且估计二维图像上物体表面的表面法线信息，从而生成表面法线图像。 使用该正常图像，设备将对象分成多个范围，提取三维信息并生成视点改变图像，从而生成伪3D图像。

公开(公告)号：US20110018990A1

公开(公告)日：2011-01-27

申请号：US12935321

申请日：2009-12-18

申请人： Ayako Komoto ,  Katsuhiro Kanamori ,  Satoshi Sato

发明人： Ayako Komoto ,  Katsuhiro Kanamori ,  Satoshi Sato

IPC分类号： H04N7/18 ,  H04N9/68 ,  H04N5/76 ,  H04N5/225

CPC分类号： H04N5/2251 ,  H04N5/2628 ,  H04N9/045

摘要： A polarization camera that can capture polarization images and a color image at the same time is used. Specifically, a clear sky polarization image, which provides information about the polarization of a part of the sky, is captured by a clear sky polarization image capturing section 100. And by reference to the information provided by a sun position determining section 1301 that determines the sun's position at the time of shooting, a camera direction estimating section 101 determines in what direction and in what area of the whole sky the clear sky polarization image is located as a polarization pattern. Finally, information about what direction or orientation on the globe the camera (image capture device) is now facing is output. In this manner, the direction of the camera and the relative position of the camera with respect to the sun can be known without providing a sensor separately and without capturing the whole sky or the sun.

摘要翻译： 使用可以同时捕获偏振图像和彩色图像的偏振照相机。 具体而言，由晴空偏振图像拍摄部100拍摄提供关于天空的一部分的偏振的信息的晴空偏振图像。参照由太阳位置确定部1301提供的信息，该太阳位置确定部1301确定 太阳在拍摄时的位置，照相机方向估计部101确定清晰天空偏振图像位于什么方向和整个天空的哪个区域作为偏振图案。 最后，输出有关相机（图像捕获设备）现在正在面向的全球方向或方向的信息。 以这种方式，相机相对于太阳的照相机的方向和相对位置可以是已知的，而不需要分别提供传感器而不捕获整个天空或太阳。

公开(公告)号：US07948514B2

公开(公告)日：2011-05-24

申请号：US12672637

申请日：2009-06-01

申请人： Satoshi Sato ,  Katsuhiro Kanamori

发明人： Satoshi Sato ,  Katsuhiro Kanamori

IPC分类号： H04N13/02 ,  G01J4/00

CPC分类号： G03B35/26 ,  H04N13/239

摘要： High-precision normal information on the surface of a subject is generated by capturing an image of the subject. A normal information generating device captures the image of the subject and thereby passively generates normal information on the surface of the subject. The normal information generating device includes: a stereo polarization image capturing section for receiving a plurality of polarized light beams of different polarization directions at different viewpoint positions and obtaining a plurality of polarization images of different viewpoint positions; and a normal information generating section for estimating a normal direction vector of the subject based on the plurality of polarization images of different viewpoint positions.

摘要翻译： 通过拍摄对象的图像来生成被摄体表面上的高精度正常信息。 普通信息生成装置捕获被检体的图像，从而被动地在被检体的表面上生成正常信息。 普通信息生成装置包括：立体偏振图像拍摄部，其在不同的视点位置接收不同偏振方向的多个偏振光束，得到不同视点位置的多个偏振图像; 以及正常信息生成部，其基于不同视点位置的多个偏振图像来估计被摄体的法线方向矢量。

公开(公告)号：US20100027879A1

公开(公告)日：2010-02-04

申请号：US12557555

申请日：2009-09-11

申请人： Satoshi Sato ,  Kunio Nobori ,  Katsuhiro Kanamori

发明人： Satoshi Sato ,  Kunio Nobori ,  Katsuhiro Kanamori

IPC分类号： G06K9/00

CPC分类号： H04N5/235 ,  G06T5/007 ,  G06T7/11 ,  G06T7/174 ,  G06T7/42 ,  G06T2207/10152 ,  G06T2207/20056

摘要： The process captures a plurality of images under a light source whose luminance varies over time, such as a fluorescent lamp, under such an imaging condition that a plurality of images that are different from one another in terms of light source conditions can be captured (S11). The process detects a temporal luminance variation from the plurality of captured images (S12), estimates a shadow area by using the temporal luminance variation (S13), and performs an image process such as a process of synthesizing a linearized image or an image segmentation based on optical characteristics (S14).

摘要翻译： 在能够捕获在光源条件方面彼此不同的多个图像的成像条件下，该处理捕获亮度随时间变化的光源（例如荧光灯）下的多个图像（S11 ）。 该过程检测来自多个拍摄图像的时间亮度变化（S12），通过使用时间亮度变化来估计阴影区域（S13），并且执行诸如合成线性化图像或图像分割的处理的图像处理 关于光学特性（S14）。

公开(公告)号：US20090290039A1

公开(公告)日：2009-11-26

申请号：US12307609

申请日：2008-05-01

申请人： Katsuhiro Kanamori ,  Satoshi Sato ,  Hiroaki Okayama

发明人： Katsuhiro Kanamori ,  Satoshi Sato ,  Hiroaki Okayama

IPC分类号： H04N5/228 ,  G06K9/00

CPC分类号： H04N9/045 ,  H04N2209/045

摘要： An image processing apparatus according to the present invention includes: a color and polarization obtaining section 101 including a single-chip color image capture element with a color mosaic filter and a patterned polarizer in which a number of polarizer units, of which the polarization transmission planes define mutually different angles, are arranged adjacent to each other within each single color pixel; a color information processing section 102 for getting average color intensity information by averaging the intensities of the light rays that have been transmitted through the polarizer units within each said single color pixel; and a polarization information processing section 103 for approximating, as a sinusoidal function, a relation between the intensity of light rays that have been transmitted through the polarizer units within each said single color pixel and the angles of the polarization transmission planes of the polarizer units.

摘要翻译： 根据本发明的图像处理装置包括：颜色和偏振获取部分101，其包括具有彩色马赛克滤光片的单片彩色图像捕获元件和图案化偏振器，其中多个偏振器单元，其偏振透射平面 限定相互不同的角度，在每个单个彩色像素内彼此相邻布置; 颜色信息处理部分102，用于通过对已经透过每个所述单色像素内的偏振器单元的光线的强度进行平均来获得平均颜色强度信息; 以及极化信息处理部分103，用于近似通过每个所述单色像素内的偏振器单元透射的光线的强度与偏振器单元的偏振透射平面的角度之间的关系作为正弦函数。

公开(公告)号：US20080186390A1

公开(公告)日：2008-08-07

申请号：US12080230

申请日：2008-03-31

申请人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

发明人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

IPC分类号： H04N5/228

CPC分类号： G06T3/4053

摘要： An albedo estimating section produces an albedo image of an object from an original image captured by an image-capturing section by using light source information estimated by a light source information estimating section and shape information of the object obtained by a shape information obtaining section. An albedo super-resolution section performs super-resolution of the albedo image according to a conversion rule obtained from an albedo DB. A super-resolution section produces a high-resolution image obtained by performing super-resolution of the original image by using the super-resolution albedo image, the light source information and the shape information.

摘要翻译： 反照率估计部分通过使用由光源信息估计部分估计的光源信息和由形状信息获取部分获得的对象的形状信息，从由图像拍摄部分拍摄的原始图像产生对象的反照率图像。 反照率超分辨率部分根据从反照率DB获得的转换规则执行反照率图像的超分辨率。 超分辨率部分通过使用超分辨率反照率图像，光源信息和形状信息来产生通过执行原始图像的超分辨率而获得的高分辨率图像。

公开(公告)号：US08131116B2

公开(公告)日：2012-03-06

申请号：US12085698

申请日：2007-08-24

申请人： Hideto Motomura ,  Katsuhiro Kanamori ,  Satoshi Sato

发明人： Hideto Motomura ,  Katsuhiro Kanamori ,  Satoshi Sato

IPC分类号： G06K9/32

CPC分类号： H04N5/235 ,  G06T3/4007 ,  H04N5/2256 ,  H04N5/232 ,  H04N5/23232 ,  H04N5/23245

摘要： The resolution of an image of an object is increased. The illumination equation parameters of the object are estimated, and a resolution-increasing process is performed on the estimated illumination equation parameters. Then, the resolution-increased illumination equation parameters are synthesized together to produce a high-resolution image. If there is a pixel for which the estimation precision of the estimated illumination equation parameters does not satisfy a predetermined precision, the illumination equation parameters are estimated again while feeding back the resolution-increased illumination equation parameters.

摘要翻译： 对象的图像的分辨率增加。 估计对象的照度方程参数，并对估计的照明方程参数进行分辨率增加处理。 然后，分辨率增加的照度方程参数被合成以产生高分辨率图像。 如果存在估计照度方程参数的估计精度不满足预定精度的像素，则在反馈分辨率增加的照度方程参数的同时再次估计照明方程参数。

公开(公告)号：US08025408B2

公开(公告)日：2011-09-27

申请号：US12672940

申请日：2009-05-15

申请人： Satoshi Sato ,  Katsuhiro Kanamori

发明人： Satoshi Sato ,  Katsuhiro Kanamori

IPC分类号： G06K9/00

CPC分类号： H04N9/045 ,  G06T7/11 ,  G06T2207/10024

摘要： An image processing apparatus captures an object's image and separates the object's image into multiple components. The apparatus includes: a light projecting section 101 for projecting light emitted from a light source toward the object; a color and polarization obtaining section 102 for getting a color polarized image of the object; a polarization information processing section 104 for generating color and polarization information based on an association between the intensity of the light that has been transmitted through a polarizer with three or more polarization principal axis directions and the polarization principal axis directions for each of unit pixels that form the color polarized image; a light source color information collecting section 105 for collecting color information of the light source; and an image component separating section 106 for separating the color image into multiple components based on the polarization information and the color information of the light source.

摘要翻译： 图像处理装置捕获对象的图像并将对象的图像分离成多个分量。 该装置包括：用于将从光源发射的光投射到物体的光投射部101; 用于获得对象的彩色偏振图像的颜色和偏振获得部分102; 偏振信息处理部分104，用于基于形成有三个或更多个偏振主轴方向的偏振器透射的光的强度与形成的每个单位像素的偏振主轴方向之间的关联来产生颜色和偏振信息 彩色偏光图像; 用于收集光源的颜色信息的光源颜色信息收集部分105; 以及用于基于偏振信息和光源的颜色信息将彩色图像分离成多个分量的图像分量分离部分106。