公开(公告)号：US07961222B2

公开(公告)日：2011-06-14

申请号：US12294368

申请日：2008-03-13

申请人： Hideto Motomura ,  Katsuhiro Kanamori ,  Satoshi Sato

发明人： Hideto Motomura ,  Katsuhiro Kanamori ,  Satoshi Sato

IPC分类号： H04N5/228

CPC分类号： G03B5/00 ,  H04N5/23248 ,  H04N5/23254 ,  H04N5/2327

摘要： To provide an image capturing apparatus that detects a camera movement accurately and corrects image blurring appropriately. An image capturing apparatus (200) includes: an image sensor unit (103) that captures and outputs an input image (105); an output unit (121) that outputs an image of a framing area (160) of the input image (105); a motion vector calculation unit (106) and a stationary object detection unit (201) that detect motion vectors in an outer-frame area (161) of the input image (105) and derive detection accuracy; an outer-frame area adjustment unit (205) that adjusts the outer-frame area (161) in size so that the detection accuracy meets an outer-frame area change threshold (tr); and a camera movement calculation unit (113) and a framing area modification unit (115) that move the framing area (160) according to motion vectors in the adjusted outer-frame area (161), irrespective of motion vectors in the other area.

摘要翻译： 提供一种正确检测相机移动并适当地校正图像模糊的图像捕获装置。 一种图像捕获设备（200）包括：捕获并输出输入图像（105）的图像传感器单元（103）。 输出单元（121），其输出所述输入图像（105）的成帧区域（160）的图像; 检测输入图像（105）的外框区域（161）中的运动矢量并导出检测精度的运动矢量计算单元（106）和静止物体检测单元（201） 调整外框区域（161）的外框区域调整单元（205），使得检测精度满足外框区域变更阈值（tr）; 以及相机移动计算单元（113）和成帧区域修改单元（115），其根据其他区域中的运动矢量，根据调整后的外框区域（161）中的运动向量移动成帧区域（160）。

公开(公告)号：US07924315B2

公开(公告)日：2011-04-12

申请号：US11807716

申请日：2007-05-30

申请人： Katsuhiro Kanamori ,  Hideto Motomura ,  Hiroyoshi Komobuchi

发明人： Katsuhiro Kanamori ,  Hideto Motomura ,  Hiroyoshi Komobuchi

IPC分类号： G06K9/40 ,  G06K9/00 ,  G06K9/32

CPC分类号： H04N5/232 ,  G06T3/40 ,  H04N5/2628 ,  H04N7/0135

摘要： In a learning process, first, images having different resolutions are obtained from a target region of the subject (S101). Further, the subject characteristic of the target region is obtained (S102). Then, the resolution conversion rules are learned from the images having different resolutions, and those are recorded to a storage device along with the subject characteristics (S103). When converting the resolutions, the resolution conversion rules learned for the corresponding subject characteristics are applied to each region of the original image so as to convert the resolutions of the original image.

摘要翻译： 在学习处理中，首先从对象的目标区域获得具有不同分辨率的图像（S101）。 此外，获得目标区域的对象特征（S102）。 然后，从具有不同分辨率的图像中学习分辨率转换规则，并将它们与主题特征一起记录到存储装置（S103）。 当转换分辨率时，将针对相应对象特征学习的分辨率转换规则应用于原始图像的每个区域，以便转换原始图像的分辨率。

公开(公告)号：US07893971B2

公开(公告)日：2011-02-22

申请号：US12630884

申请日：2009-12-04

申请人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

发明人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

IPC分类号： H04N9/68

CPC分类号： G06T3/4053

摘要： An imaging device condition determination section determines whether a condition of an imaging device is suitable for obtaining light source information. When it is determined to be suitable, a light source image obtaining section obtains a light source image by the imaging device. A first imaging device information obtaining section obtains first imaging device information representing the condition of the imaging device at a point in time when the light source image is obtained. A second imaging device information obtaining section obtains second imaging device information representing the condition of the imaging device at a time of actual image capturing. A light source information estimating section estimates light source information at the time of image capturing by using the light source image and the first and second imaging device information.

摘要翻译： 成像装置条件确定部分确定成像装置的条件是否适于获得光源信息。 当确定为合适时，光源图像获取部分通过成像装置获得光源图像。 第一成像设备信息获取部分获得表示获得光源图像的时间点的成像设备的状态的第一成像设备信息。 第二成像设备信息获取部分获取表示实际图像捕获时的成像设备的状态的第二成像设备信息。 光源信息估计部通过使用光源图像和第一和第二成像装置信息来估计图像拍摄时的光源信息。

公开(公告)号：US20110018990A1

公开(公告)日：2011-01-27

申请号：US12935321

申请日：2009-12-18

申请人： Ayako Komoto ,  Katsuhiro Kanamori ,  Satoshi Sato

发明人： Ayako Komoto ,  Katsuhiro Kanamori ,  Satoshi Sato

IPC分类号： H04N7/18 ,  H04N9/68 ,  H04N5/76 ,  H04N5/225

CPC分类号： H04N5/2251 ,  H04N5/2628 ,  H04N9/045

摘要： A polarization camera that can capture polarization images and a color image at the same time is used. Specifically, a clear sky polarization image, which provides information about the polarization of a part of the sky, is captured by a clear sky polarization image capturing section 100. And by reference to the information provided by a sun position determining section 1301 that determines the sun's position at the time of shooting, a camera direction estimating section 101 determines in what direction and in what area of the whole sky the clear sky polarization image is located as a polarization pattern. Finally, information about what direction or orientation on the globe the camera (image capture device) is now facing is output. In this manner, the direction of the camera and the relative position of the camera with respect to the sun can be known without providing a sensor separately and without capturing the whole sky or the sun.

摘要翻译： 使用可以同时捕获偏振图像和彩色图像的偏振照相机。 具体而言，由晴空偏振图像拍摄部100拍摄提供关于天空的一部分的偏振的信息的晴空偏振图像。参照由太阳位置确定部1301提供的信息，该太阳位置确定部1301确定 太阳在拍摄时的位置，照相机方向估计部101确定清晰天空偏振图像位于什么方向和整个天空的哪个区域作为偏振图案。 最后，输出有关相机（图像捕获设备）现在正在面向的全球方向或方向的信息。 以这种方式，相机相对于太阳的照相机的方向和相对位置可以是已知的，而不需要分别提供传感器而不捕获整个天空或太阳。

公开(公告)号：US07847825B2

公开(公告)日：2010-12-07

申请号：US11240357

申请日：2005-10-03

申请人： Katsuji Aoki ,  Katsuhiro Kanamori

发明人： Katsuji Aoki ,  Katsuhiro Kanamori

IPC分类号： H04N5/232 ,  H04N5/222

CPC分类号： H04N5/235

摘要： An image capturing apparatus (107-1) which captures an image of an object moving in a space where a light source (109) is placed, the light source emitting light whose intensity varies in a predetermined cycle, the imaging capturing apparatus includes: an imaging device (102-1) for capturing the image of the object and the light from the light source (109); a signal processing unit (103-1) for generating, from a signal outputted from the imaging device (102-1), an image signal that includes a picture sequence synchronized with an imaging apparatus drive signal obtained from the outside; and a phase difference detection unit (105-1), a phase different adjustment unit (106-1), and a drive signal generation unit (104-1), for generating a signal that is synchronized with the intensity variations of the light from the light source (109) which is captured by the imaging device (102-1), and outputting, as the imaging-apparatus drive signal, the generated signal into the signal processing unit (103-1).

摘要翻译： 一种摄像装置，其拍摄在放置有光源（109）的空间中移动的物体的图像，所述光源发光，其强度以规定的周期变化，所述摄像装置包括： 用于捕获物体的图像和来自光源（109）的光的成像装置（102-1）; 信号处理单元（103-1），用于根据从成像设备（102-1）输出的信号产生包括与从外部获得的成像设备驱动信号同步的图像序列的图像信号; 以及相位差检测单元（105-1），相位不同调整单元（106-1）和驱动信号生成单元（104-1）），用于产生与来自 由成像装置（102-1）捕获的光源（109），并将生成的信号作为成像装置驱动信号输出到信号处理单元（103-1）中。

公开(公告)号：US20100303344A1

公开(公告)日：2010-12-02

申请号：US12672940

申请日：2009-05-15

申请人： Satoshi Sato ,  Katsuhiro Kanamori

发明人： Satoshi Sato ,  Katsuhiro Kanamori

IPC分类号： G06K9/00

CPC分类号： H04N9/045 ,  G06T7/11 ,  G06T2207/10024

摘要： An image processing apparatus captures an object's image and separates the object's image into multiple components. The apparatus includes: a light projecting section 101 for projecting light emitted from a light source toward the object; a color and polarization obtaining section 102 for getting a color polarized image of the object; a polarization information processing section 104 for generating color and polarization information based on an association between the intensity of the light that has been transmitted through a polarizer with three or more polarization principal axis directions and the polarization principal axis directions for each of unit pixels that form the color polarized image; a light source color information collecting section 105 for collecting color information of the light source; and an image component separating section 106 for separating the color image into multiple components based on the polarization information and the color information of the light source.

摘要翻译： 图像处理装置捕获对象的图像并将对象的图像分离成多个分量。 该装置包括：用于将从光源发射的光投射到物体的光投射部101; 用于获得对象的彩色偏振图像的颜色和偏振获得部分102; 偏振信息处理部分104，用于基于形成有三个或更多个偏振主轴方向的偏振器透射的光的强度与形成的每个单位像素的偏振主轴方向之间的关联来产生颜色和偏振信息 彩色偏光图像; 用于收集光源的颜色信息的光源颜色信息收集部分105; 以及用于基于偏振信息和光源的颜色信息将彩色图像分离成多个分量的图像分量分离部分106。

公开(公告)号：US20100253820A1

公开(公告)日：2010-10-07

申请号：US12744423

申请日：2008-11-28

申请人： Katsuhiro Kanamori ,  Satoshi Sato

发明人： Katsuhiro Kanamori ,  Satoshi Sato

IPC分类号： H04N5/335

CPC分类号： H01L27/14621 ,  H04N9/045 ,  H04N2209/046

摘要： An image processing apparatus according to the present invention includes a single-chip color image capture element that has a color mosaic filter 201 and a patterned polarizer 202 in which a number of polarizer units, having polarization transmission planes defining at least three different angles, are provided for multiple pixels of the same color (G) in the color mosaic filter 201. This apparatus includes not only a color and polarization obtaining section 101 including such a single-chip color image capture element but also a polarization information processing section 103 for approximating, as a sinusoidal function, a relation between the intensities of light rays that have been transmitted through the polarizer units for the G pixels and the angles of the polarization transmission planes of the polarizer units and a color mosaic interpolation section 102 for generating a color intensity image by performing a color intensity interpolation and getting a color intensity that cannot be obtained at a pixel of interest.

摘要翻译： 根据本发明的图像处理装置包括具有彩色马赛克滤光器201和图案化偏振器202的单芯片彩色图像捕获元件，其中具有限定至少三个不同角度的偏振透射平面的多个偏振器单元是 提供了颜色马赛克滤波器201中相同颜色（G）的多个像素。该装置不仅包括包括这样的单芯片彩色图像捕获元件的颜色和偏振获取部分101，而且包括用于近似的偏振信息处理部分103 作为正弦函数，已经透射通过用于G像素的偏振器单元的光线的强度与偏振器单元的偏振透射平面的角度之间的关系和用于产生颜色强度的颜色马赛克内插部分102 通过执行颜色强度插值并获得不能的颜色强度的图像 在感兴趣的像素处获得。

公开(公告)号：US07688363B2

公开(公告)日：2010-03-30

申请号：US12080230

申请日：2008-03-31

申请人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

发明人： Satoshi Sato ,  Katsuhiro Kanamori ,  Hideto Motomura

IPC分类号： H04N5/262 ,  G06K9/32

CPC分类号： G06T3/4053

摘要： An albedo estimating section produces an albedo image of an object from an original image captured by an image-capturing section by using light source information estimated by a light source information estimating section and shape information of the object obtained by a shape information obtaining section. An albedo super-resolution section performs super-resolution of the albedo image according to a conversion rule obtained from an albedo DB. A super-resolution section produces a high-resolution image obtained by performing super-resolution of the original image by using the super-resolution albedo image, the light source information and the shape information.

摘要翻译： 反照率估计部分通过使用由光源信息估计部分估计的光源信息和由形状信息获取部分获得的对象的形状信息，从由图像拍摄部分拍摄的原始图像产生对象的反照率图像。 反照率超分辨率部分根据从反照率DB获得的转换规则执行反照率图像的超分辨率。 超分辨率部分通过使用超分辨率反照率图像，光源信息和形状信息来产生通过执行原始图像的超分辨率而获得的高分辨率图像。

公开(公告)号：US20090135183A1

公开(公告)日：2009-05-28

申请号：US12361707

申请日：2009-01-29

申请人： Satoshi Sato ,  Katsuhiro Kanamori ,  Natsuki Saito ,  Mikiya Nakata

发明人： Satoshi Sato ,  Katsuhiro Kanamori ,  Natsuki Saito ,  Mikiya Nakata

IPC分类号： G06T15/60

CPC分类号： G01B11/002 ,  G01S15/02 ,  G06T7/11 ,  G06T7/514 ,  G06T7/70 ,  G06T15/50 ,  G06T15/60 ,  H04N5/232 ,  H04N5/2351

摘要： The normal vector information generating device generates normal vector information on the surface of an object, and includes: an image information obtaining unit obtaining information about an image of the object, the information including luminance information about luminance of light from the object and polarization information about polarization of the light; a shadow area extracting unit extracting an attached shadow area and a cast shadow area from the image based on the luminance information and the polarization information, the attached shadow area appearing on the surface of the object depending on an angle of incidence light, and the cast shadow area appearing on the surface of a material body when the light is blocked by the object; and a normal vector information generating unit generating normal vector information identifying a normal vector on the surface of the object in the attached shadow area using the polarization information.

摘要翻译： 法线矢量信息生成装置在物体的表面上生成法线矢量信息，包括：图像信息获取单元获取关于对象的图像的信息，包括关于来自物体的光的亮度的亮度信息的信息和关于 光的极化; 阴影区域提取单元基于亮度信息和偏振信息从图像提取附加的阴影区域和投影区域，根据入射光出现在物体的表面上的附加阴影区域，以及投射 当物体被物体遮挡时，物体表面出现阴影区域; 以及法线信息生成单元，使用偏振信息生成用于识别所附加的阴影区域中的物体的表面上的法线矢量的法线矢量信息。

公开(公告)号：US20090116819A1

公开(公告)日：2009-05-07

申请号：US12064793

申请日：2006-08-11

申请人： Satoshi Kondo ,  Tadamasa Toma ,  Katsuhiro Kanamori ,  Haruo Yamashita ,  Takeshi Ito ,  JUn Ikeda

发明人： Satoshi Kondo ,  Tadamasa Toma ,  Katsuhiro Kanamori ,  Haruo Yamashita ,  Takeshi Ito ,  JUn Ikeda

IPC分类号： H04N7/26 ,  H04N7/12 ,  G09G5/02

CPC分类号： G11B27/034 ,  G11B2220/2541 ,  H04N5/85 ,  H04N9/7921 ,  H04N9/8042 ,  H04N9/8227 ,  H04N21/238 ,  H04N21/4325

摘要： To provide a multiplexing method which facilitates a reproduction process and reduces unpleasantness felt by a viewer about image quality.The multiplexing method includes: a step of judging whether or not a clip to be coded should be coded as part of a continuous reproduction unit in which bitstreams are structured so as to allow continuous reproduction (S100); a step of determining a color space that is common within the continuous reproduction unit when it is judged that the clip should be coded as part of the continuous reproduction unit (S110); a step of generating bitstreams by coding the clip to be coded according to a determined color space (S112); and a step of packet-multiplexing bitstreams (S118).

摘要翻译： 提供一种便于再现处理并减少观众对图像质量感觉到的不愉快的复用方法。 复用方法包括：判断要编码的片段是否应当被编码为其中构成比特流以便允许连续再现的连续再现单元的一部分（S100）; 当判断剪辑应被编码为连续再现单元的一部分时，确定在连续再现单元中共同的颜色空间的步骤（S110）; 通过根据确定的颜色空间对要编码的剪辑进行编码来生成比特流的步骤（S112）; 和分组复用比特流的步骤（S118）。