公开(公告)号：US20130188026A1

公开(公告)日：2013-07-25

申请号：US13813503

申请日：2012-09-12

申请人： Masao Hiramoto ,  Yasunori Ishii ,  Yusuke Monobe

发明人： Masao Hiramoto ,  Yasunori Ishii ,  Yusuke Monobe

IPC分类号： H04N13/02

CPC分类号： H04N13/236 ,  G01B11/24 ,  G03B35/10 ,  H04N13/218 ,  H04N13/271

摘要： A depth estimating image capture device as an embodiment of this invention includes: an image sensor 2 with photosensitive cells 10 arranged on its image capturing plane; an optical lens arranged to condense light on the plane; a light-transmitting member 1 arranged on the plane; and a signal processing section that processes signals supplied from the cells 10. The member 1 includes a first mirror 1a inside to reflect the light at least partially and a second mirror 1b with the same reflection property as the first mirror 1a on its upper surface. The first mirror 1a has a reflective surface tilted with respect to the upper surface of the member 1. The second mirror 1b has a reflective surface that is parallel to the upper surface. The first and second mirrors 1a and 1b are arranged so that a light beam coming from a point on a subject through the lens is reflected from the first mirror 1a and from the second mirror 1b and irradiates some area on the image capturing plane to make the irradiated area change according to the depth of the point on the subject.

摘要翻译： 作为本发明的实施例的深度估计图像捕获装置包括：具有布置在其图像捕获平面上的感光单元10的图像传感器2; 光学透镜，布置成在平面上冷凝光; 布置在平面上的透光构件1; 以及处理从单元10供给的信号的信号处理部。构件1包括内部以至少部分地反射光的第一反射镜1a和在其上表面具有与第一反射镜1a相同的反射特性的第二反射镜1b。 第一反射镜1a具有相对于构件1的上表面倾斜的反射表面。第二反射镜1b具有平行于上表面的反射表面。 第一和第二反射镜1a和1b被布置成使得来自通过透镜的被摄体上的点的光束从第一反射镜1a和第二反射镜1b反射并照射到图像捕获平面上的某个区域， 照射区域根据被摄体上的点的深度而变化。

公开(公告)号：US09456198B2

公开(公告)日：2016-09-27

申请号：US13813503

申请日：2012-09-12

申请人： Masao Hiramoto ,  Yasunori Ishii ,  Yusuke Monobe

发明人： Masao Hiramoto ,  Yasunori Ishii ,  Yusuke Monobe

IPC分类号： H04N13/02 ,  G01B11/24 ,  G03B35/10

CPC分类号： H04N13/236 ,  G01B11/24 ,  G03B35/10 ,  H04N13/218 ,  H04N13/271

摘要： A depth estimating image capture device includes: an image sensor; an optical lens; a light-transmitting member arranged on the plane; and a signal processing section. The member includes a first mirror inside to reflect the light at least partially and a second mirror with the same reflection property as the first mirror on its upper surface. The first mirror has a reflective surface tilted with respect to the upper surface of the member. The second mirror has a reflective surface that is parallel to the upper surface. The first and second mirrors and are arranged so that a light beam coming from a point on a subject through the lens is reflected from the first mirror and from the second mirror and irradiates some area on an image capturing plane to make the irradiated area change according to the depth of the point on the subject.

摘要翻译： 深度估计图像捕获装置包括：图像传感器; 光学透镜; 布置在所述平面上的透光构件; 和信号处理部。 该构件包括至少部分地反射光的第一反射镜和在其上表面上具有与第一反射镜相同的反射特性的第二反射镜。 第一反射镜具有相对于构件的上表面倾斜的反射表面。 第二反射镜具有平行于上表面的反射表面。 第一和第二反射镜被布置成使得来自通过透镜的被摄体上的点的光束从第一反射镜和第二反射镜反射并且照射到图像捕获平面上的某个区域以使照射区域根据 到主题的深度。

公开(公告)号：US20130063616A1

公开(公告)日：2013-03-14

申请号：US13697624

申请日：2011-05-11

申请人： Yasunori Ishii ,  Yusuke Monobe

发明人： Yasunori Ishii ,  Yusuke Monobe

IPC分类号： H04N5/228

CPC分类号： H04N5/23248 ,  H04N5/23254 ,  H04N5/23267

摘要： This image capture device is configured to generate a restored image by reducing a motion blur that has been induced by a camera shake during shooting. The device includes: an image sensor 10; an optical system 20; and an image processing section 220 which processes an image signal that has been obtained by the image sensor 10. The image processing section 220 includes: a blur kernel determining section which determines a blur kernel that defines the camera-shake-induced motion blur of the image captured; and an image restoration section which generates the restored image. The blur kernel determining section changes the size of the blur kernel by reference to information that affects the degree of the blur of the image such as the zoom power of the optical system 20.

摘要翻译： 该图像拍摄装置被配置为通过减少在拍摄期间由相机抖动引起的运动模糊来生成恢复的图像。 该装置包括：图像传感器10; 光学系统20; 以及处理由图像传感器10获得的图像信号的图像处理部分220.图像处理部分220包括：模糊核心确定部分，其确定限定相机抖动引起的运动模糊的模糊核心 拍摄图像 以及生成恢复图像的图像恢复部。 模糊核心确定部分通过参考影响图像模糊度的信息（例如光学系统20的变焦功率）来改变模糊核心的大小。

公开(公告)号：US08253819B2

公开(公告)日：2012-08-28

申请号：US12865917

申请日：2009-02-06

申请人： Yasunori Ishii ,  Yusuke Monobe ,  Yasunobu Ogura ,  Kazuyuki Imagawa

发明人： Yasunori Ishii ,  Yusuke Monobe ,  Yasunobu Ogura ,  Kazuyuki Imagawa

IPC分类号： H04N5/228 ,  H04N5/225 ,  H04N5/222 ,  H04N5/232 ,  G06K9/00 ,  G06K9/46 ,  G06K9/62

CPC分类号： H04N5/232 ,  G02B7/365 ,  G03B13/36 ,  G06T1/0007 ,  G06T7/248 ,  G06T2207/10016 ,  G06T2207/30201 ,  G06T2207/30232 ,  H04N5/23219

摘要： A tracking processing unit (137) performs a search in a frame using a color feature amount of an object and determines a target area estimated to include the image of the object based on the first evaluation value indicating a degree of matching between a search result and the object. An update detection circuit (139) performs a search in the frame using a shape feature amount of the object, calculates a second evaluation value, and determines an update area for updating a first feature amount based on the second evaluation value indicating a degree of matching between the search result and the object. An update determination circuit (140) determines whether or not to update the first feature amount. A tracking result drawing circuit (144) draws an outer frame of the target area when determined not to update, and draws that of the update area when determined to update.

摘要翻译： 跟踪处理单元（137）使用对象的颜色特征量在帧中执行搜索，并且基于指示搜索结果与搜索对象的匹配程度的第一评估值来确定估计为包括对象的图像的目标区域 物体。 更新检测电路（139）使用对象的形状特征量在帧中进行搜索，计算第二评价值，并且基于表示匹配度的第二评价值，确定用于更新第一特征量的更新区域 在搜索结果和对象之间。 更新确定电路（140）确定是否更新第一特征量。 当确定不更新时，跟踪结果描绘电路（144）绘制目标区域的外框，并且当确定要更新时，绘制更新区域的外框。

公开(公告)号：US20120105655A1

公开(公告)日：2012-05-03

申请号：US13264461

申请日：2011-01-28

申请人： Yasunori Ishii ,  Yusuke Monobe

发明人： Yasunori Ishii ,  Yusuke Monobe

IPC分类号： G06K9/40 ,  H04N5/228

CPC分类号： G06T5/003 ,  G06T2207/20201

摘要： An image processing device extracts, in an image block selection section 226, a plurality of image block pairs from a degraded image and a provisional restored image, each of the image block pairs being formed by two image blocks at identical coordinates in the degraded image and the provisional restored image, and estimates a point spread function (PSF) for each of the image block pairs. From among the estimated PSFs, a PSF which is estimated to be close to a true PSF is selected as a candidate PSF. The estimation of the PSF is carried out on a block-by-block basis, whereby the amount of computation required for the estimation of the PSF can be reduced. Also, the estimation method used is not disturbed by an image block which includes noise, and therefore, a PSF which is close to the true PSF can be estimated.

摘要翻译： 图像处理装置在图像块选择部分226中从劣化图像和临时还原图像中提取多个图像块对，每个图像块对由在劣化图像中相同坐标处的两个图像块形成， 临时还原图像，并估计每个图像块对的点扩散函数（PSF）。 从估计的PSF中，选择估计为接近真实PSF的PSF作为候选PSF。 PSF的估计是在逐块的基础上进行的，由此可以减少估计PSF所需的计算量。 此外，所使用的估计方法不受包括噪声的图像块的干扰，因此可以估计接近真实PSF的PSF。

公开(公告)号：US20120033094A1

公开(公告)日：2012-02-09

申请号：US13260597

申请日：2011-01-25

申请人： Yasunori Ishii ,  Yusuke Monobe

发明人： Yasunori Ishii ,  Yusuke Monobe

IPC分类号： H04N5/225

CPC分类号： H04N1/4092 ,  G02B27/646 ,  G06T5/003 ,  G06T2207/20201 ,  H04N5/2254 ,  H04N5/2258 ,  H04N5/23267

摘要： An image capture device of the present invention includes: a first image capture element 10A and a second image capture element 10B; and an optical system which is capable of forming a first image which is in focus on an image capture plane of the first image capture element 10A and forming a second image which is out of focus on an image capture plane of the second image capture element 10B. An image processing section 220 processes a signal obtained from the first image capture element 10A and a signal obtained from the second image capture element 10B and produces a restored image from an image obtained by the second image capture element 10B, the restored image having reduced camera shake blur and reduced out-of-focus blur.

摘要翻译： 本发明的图像捕获装置包括：第一图像捕获元件10A和第二图像捕获元件10B; 以及能够形成第一图像的光学系统，该第一图像聚焦在第一图像捕获元件10A的图像捕获平面上，并且形成第二图像，该第二图像在第二图像捕获元件10B的图像捕获平面上不对焦 。 图像处理部分220处理从第一图像捕获元件10A获得的信号和从第二图像捕获元件10B获得的信号，并且从由第二图像捕获元件10B获得的图像产生恢复的图像，恢复的图像具有缩小的相机 抖动模糊和减少失焦模糊。

公开(公告)号：US20110033132A1

公开(公告)日：2011-02-10

申请号：US12988890

申请日：2010-02-22

申请人： Yasunori Ishii ,  Yusuke Monobe

发明人： Yasunori Ishii ,  Yusuke Monobe

IPC分类号： G06K9/40

CPC分类号： H04N5/23248 ,  G06T5/003 ,  G06T2207/20201 ,  H04N5/23254 ,  H04N5/23267

摘要： An input image containing multiple kinds of blur is corrected without using multiple images, resulting in a target image with less blur than the input image. An image correction apparatus (100) for correcting an input image to generate a target image with less blur than the input image is provided, which includes: an adaptive region division unit (110) that divides the input image into a plurality of adaptive regions based on pixel values of pixels included in the input image; a PSF interpolation unit (120) that interpolates a point spread function for a pixel located between representative pixels each representing a corresponding one of the adaptive regions, using a PSF representing characteristics of image blur calculated for each of the adaptive regions; and an image correction unit (130) that corrects the input image using the point spread functions available after the interpolation, so as to generate the target image.

摘要翻译： 在不使用多个图像的情况下校正包含多种模糊的输入图像，导致具有比输入图像少的模糊的目标图像。 提供了一种用于校正输入图像以生成比输入图像更少模糊的目标图像的图像校正装置（100），其包括：自适应区域划分单元（110），其将输入图像划分为多个自适应区域 关于包括在输入图像中的像素的像素值; 使用表示针对每个自适应区域计算的图像模糊特性的PSF，内插针对位于代表所述自适应区域中的相应一个自适应区域的代表像素之间的像素的点扩散函数的PSF内插单元（120） 以及图像校正单元（130），其使用在插值之后可用的点扩展函数来校正输入图像，以便生成目标图像。

公开(公告)号：US08576289B2

公开(公告)日：2013-11-05

申请号：US13377038

申请日：2011-03-17

申请人： Yasunori Ishii ,  Yusuke Monobe ,  Yasushi Yagi ,  Yasuhiro Mukaigawa

发明人： Yasunori Ishii ,  Yusuke Monobe ,  Yasushi Yagi ,  Yasuhiro Mukaigawa

IPC分类号： H04N5/228

CPC分类号： H04N5/23258 ,  G06T5/003 ,  H04N5/23267

摘要： Blur correction device (100) includes: a blur information generation unit (203) which generates blur information based on sensor data indicating camera motion; a blur correction unit (204) which corrects blur in a captured image, based on the blur information, to generate a candidate corrected image; an evaluation value calculation unit (205) which calculates an evaluation value indicating a blur correction level for the candidate corrected image; a termination judgment unit (206) which judges whether the blur correction should be terminated, based on a predetermined condition; and a blur information updating unit which updates the blur information, when the blur correction should not be terminated. When the blur information is updated, the blur correction unit (204) corrects the blur, based on the updated blur information, to generate a new candidate corrected image. When the blur correction should be terminated, the termination judgment unit (206) determines the corrected image from the candidate corrected images, based on the evaluation value.

摘要翻译： 模糊校正装置（100）包括：模糊信息生成单元（203），其基于指示相机动作的传感器数据生成模糊信息; 模糊校正单元，其基于所述模糊信息来校正拍摄图像中的模糊，以生成候选校正图像; 评估值计算单元，其计算表示候选校正图像的模糊校正水平的评估值; 基于预定条件判断模糊校正是否应终止的终止判断单元（206）; 以及当模糊校正不应终止时，模糊信息更新单元更新模糊信息。 当模糊信息被更新时，模糊校正单元（204）基于更新的模糊信息来校正模糊，以生成新的候选校正图像。 当模糊校正应该被终止时，终止判断单元206基于评估值从候选校正图像中确定校正图像。

公开(公告)号：US20120086822A1

公开(公告)日：2012-04-12

申请号：US13377038

申请日：2011-03-17

申请人： Yasunori Ishii ,  Yusuke Monobe ,  Yasushi Yagi ,  Yasuhiro Mukaigawa

发明人： Yasunori Ishii ,  Yusuke Monobe ,  Yasushi Yagi ,  Yasuhiro Mukaigawa

IPC分类号： H04N5/225

CPC分类号： H04N5/23258 ,  G06T5/003 ,  H04N5/23267

摘要： Blur correction device (100) includes: a blur information generation unit (203) which generates blur information based on sensor data indicating camera motion; a blur correction unit (204) which corrects blur in a captured image, based on the blur information, to generate a candidate corrected image; an evaluation value calculation unit (205) which calculates an evaluation value indicating a blur correction level for the candidate corrected image; a termination judgment unit (206) which judges whether the blur correction should be terminated, based on a predetermined condition; and a blur information updating unit which updates the blur information, when the blur correction should not be terminated. When the blur information is updated, the blur correction unit (204) corrects the blur, based on the updated blur information, to generate a new candidate corrected image. When the blur correction should be terminated, the termination judgment unit (206) determines the corrected image from the candidate corrected images, based on the evaluation value.

摘要翻译： 模糊校正装置（100）包括：模糊信息生成单元（203），其基于指示相机动作的传感器数据生成模糊信息; 模糊校正单元，其基于所述模糊信息来校正拍摄图像中的模糊，以生成候选校正图像; 评估值计算单元，其计算表示候选校正图像的模糊校正水平的评估值; 基于预定条件判断模糊校正是否应终止的终止判断单元（206）; 以及当模糊校正不应终止时，模糊信息更新单元更新模糊信息。 当模糊信息被更新时，模糊校正单元（204）基于更新的模糊信息来校正模糊，以生成新的候选校正图像。 当模糊校正应该被终止时，终止判断单元206基于评估值从候选校正图像中确定校正图像。

公开(公告)号：US20110001840A1

公开(公告)日：2011-01-06

申请号：US12865917

申请日：2009-02-06

申请人： Yasunori Ishii ,  Yusuke Monobe ,  Yasunobu Ogura ,  Kazuyuki Imagawa

发明人： Yasunori Ishii ,  Yusuke Monobe ,  Yasunobu Ogura ,  Kazuyuki Imagawa

IPC分类号： H04N5/228 ,  H04N5/222 ,  G06T7/00

CPC分类号： H04N5/232 ,  G02B7/365 ,  G03B13/36 ,  G06T1/0007 ,  G06T7/248 ,  G06T2207/10016 ,  G06T2207/30201 ,  G06T2207/30232 ,  H04N5/23219

摘要： A tracking processing unit (137) performs a search in a frame using a color feature amount of an object and determines a target area estimated to include the image of the object based on the first evaluation value indicating a degree of matching between a search result and the object. An update detection circuit (139) performs a search in the frame using a shape feature amount of the object, calculates a second evaluation value, and determines an update area for updating a first feature amount based on the second evaluation value indicating a degree of matching between the search result and the object. An update determination circuit (140) determines whether or not to update the first feature amount. A tracking result drawing circuit (144) draws an outer frame of the target area when determined not to update, and draws that of the update area when determined to update.

摘要翻译： 跟踪处理单元（137）使用对象的颜色特征量在帧中执行搜索，并且基于指示搜索结果与搜索对象的匹配程度的第一评估值来确定估计为包括对象的图像的目标区域 物体。 更新检测电路（139）使用对象的形状特征量在帧中进行搜索，计算第二评价值，并且基于表示匹配度的第二评价值，确定用于更新第一特征量的更新区域 在搜索结果和对象之间。 更新确定电路（140）确定是否更新第一特征量。 当确定不更新时，跟踪结果描绘电路（144）绘制目标区域的外框，并且当确定要更新时，绘制更新区域的外框。