公开(公告)号：US20110135219A1

公开(公告)日：2011-06-09

申请号：US13057046

申请日：2010-05-13

申请人： Khang Nguyen ,  Yusuke Monobe ,  Yusuke TAnji

发明人： Khang Nguyen ,  Yusuke Monobe ,  Yusuke TAnji

IPC分类号： G06K9/40

CPC分类号： H04N5/21 ,  G06T5/50 ,  G06T7/223 ,  G06T2207/20021 ,  G06T2207/20221 ,  H04N5/144 ,  H04N19/577 ,  H04N19/61 ,  H04N19/86

摘要： To provide an image processing apparatus which reduces, using a temporal noise removal scheme, image block distortion or noise and temporal flickering and fluctuation phenomena. The image processing apparatus (1) removing noise in an input image by adding a reference image to the input image includes a motion estimation unit (20) which generates motion information indicating a motion estimated for the input image; a motion compensation unit (30) which generates a after motion compensation second image corresponding to a before motion compensation first image by performing motion compensation using the generated motion information; a flatness degree calculation unit (40) which calculates a flatness degree of the input image; a blending rate calculation unit (53) which calculates addition rates for the input image, first image, and second image, using the calculated flatness degree; and a pixel addition unit (60) which adds the respective images according to the addition rates.

摘要翻译： 提供一种降低使用时间噪声去除方案的图像块失真或噪声以及时间闪烁和波动现象的图像处理装置。 通过向输入图像添加参考图像来去除输入图像中的噪声的图像处理装置（1）包括：运动估计单元（20），生成指示针对输入图像估计的运动的运动信息; 运动补偿单元，通过使用所生成的运动信息进行运动补偿，生成与运动补偿前图像对应的运动补偿后的图像; 平面度计算单元，其计算输入图像的平坦度; 混合率计算单元，使用所计算的平坦度来计算输入图像，第一图像和第二图像的加法率; 以及像素相加单元（60），其根据加法率添加各个图像。

公开(公告)号：US08890995B2

公开(公告)日：2014-11-18

申请号：US13809951

申请日：2012-04-12

申请人： Takeshi Shimamoto ,  Takashi Kawamura ,  Yusuke Monobe

发明人： Takeshi Shimamoto ,  Takashi Kawamura ,  Yusuke Monobe

IPC分类号： G03B13/00 ,  H04N5/232 ,  H04N5/228 ,  G03B17/00 ,  G02B27/00 ,  G03B13/32 ,  G03B7/08 ,  G03B15/00 ,  G02B7/28

CPC分类号： G03B13/32 ,  G02B7/28 ,  G02B27/0075 ,  G03B7/08 ,  G03B15/00 ,  H04N5/23212

摘要： An image pickup device includes an image pickup element; a lens optical system including a focus lens; a driving section for driving one of the image pickup element and the focus lens so as to change a distance between the image pickup element and the focus lens; a displacement control section configured to output an instruction to the driving section to control displacement of the image pickup element or the focus lens which is driven, based on a prescribed displacement pattern; and a synchronization section configured to control the displacement control section based on timing for exposing the image pickup element.

摘要翻译： 图像拾取装置包括图像拾取元件; 包括聚焦透镜的透镜光学系统; 用于驱动图像拾取元件和聚焦透镜中的一个以便改变图像拾取元件和聚焦透镜之间的距离的驱动部分; 位移控制部，被配置为基于规定的位移图案，将指示输出到所述驱动部，以控制被驱动的图像拾取元件或聚焦透镜的位移; 以及同步部，被配置为基于用于曝光所述图像拾取元件的定时来控制所述位移控制部。

公开(公告)号：US08576289B2

公开(公告)日：2013-11-05

申请号：US13377038

申请日：2011-03-17

申请人： Yasunori Ishii ,  Yusuke Monobe ,  Yasushi Yagi ,  Yasuhiro Mukaigawa

发明人： Yasunori Ishii ,  Yusuke Monobe ,  Yasushi Yagi ,  Yasuhiro Mukaigawa

IPC分类号： H04N5/228

CPC分类号： H04N5/23258 ,  G06T5/003 ,  H04N5/23267

摘要： Blur correction device (100) includes: a blur information generation unit (203) which generates blur information based on sensor data indicating camera motion; a blur correction unit (204) which corrects blur in a captured image, based on the blur information, to generate a candidate corrected image; an evaluation value calculation unit (205) which calculates an evaluation value indicating a blur correction level for the candidate corrected image; a termination judgment unit (206) which judges whether the blur correction should be terminated, based on a predetermined condition; and a blur information updating unit which updates the blur information, when the blur correction should not be terminated. When the blur information is updated, the blur correction unit (204) corrects the blur, based on the updated blur information, to generate a new candidate corrected image. When the blur correction should be terminated, the termination judgment unit (206) determines the corrected image from the candidate corrected images, based on the evaluation value.

摘要翻译： 模糊校正装置（100）包括：模糊信息生成单元（203），其基于指示相机动作的传感器数据生成模糊信息; 模糊校正单元，其基于所述模糊信息来校正拍摄图像中的模糊，以生成候选校正图像; 评估值计算单元，其计算表示候选校正图像的模糊校正水平的评估值; 基于预定条件判断模糊校正是否应终止的终止判断单元（206）; 以及当模糊校正不应终止时，模糊信息更新单元更新模糊信息。 当模糊信息被更新时，模糊校正单元（204）基于更新的模糊信息来校正模糊，以生成新的候选校正图像。 当模糊校正应该被终止时，终止判断单元206基于评估值从候选校正图像中确定校正图像。

公开(公告)号：US08547442B2

公开(公告)日：2013-10-01

申请号：US12991208

申请日：2008-06-19

申请人： Pongsak Lasang ,  ChinPhek Ong ,  Sheng Mei Shen ,  Kenji Tamura ,  Yusuke Monobe

发明人： Pongsak Lasang ,  ChinPhek Ong ,  Sheng Mei Shen ,  Kenji Tamura ,  Yusuke Monobe

IPC分类号： H04N5/228

CPC分类号： H04N5/235 ,  H04N5/144 ,  H04N5/217 ,  H04N5/2355

摘要： A method and apparatus for motion blur and ghosting prevention in imaging system is presented. A residue image is computed by performing spatial-temporal filter with a set of absolute image difference of image pairs from input images. A noise adaptive pixel threshold is computed for every pixel based on noise statistics of image sensor. The residue image and the noise adaptive pixel threshold are used to create a motion masking map. The motion masking map is used to represent motion and non-motion pixels in pixels merging. The pixels merging step is performed to generate an output image by considering the motion pixels where the motion pixels are performed separately. The resulting output image having no or less motion blur and ghosting artifacts can be obtained, even the input images having different degree of motion blur between each of the image, while the complexity is low. It is preferred that the current invention is applied in the Bayer raw domain. The benefit is reduced computation and memory because only 1 color component is processed for each pixel. Another benefit is higher signal fidelity because processing in the Bayer raw domain is unaffected by demosaicing artifacts, especially along edges. However, the current invention can also be applied in RGB domain.

摘要翻译： 提出了一种成像系统中运动模糊和重影防止的方法和装置。 通过执行具有来自输入图像的图像对的一组绝对图像差异的空间 - 时间滤波来计算残差图像。 基于图像传感器的噪声统计，为每个像素计算噪声自适应像素阈值。 残差图像和噪声自适应像素阈值用于创建运动掩蔽图。 运动屏蔽图用于表示像素合并中的运动和非运动像素。 执行像素合并步骤，通过考虑分别执行运动像素的运动像素来生成输出图像。 即使在复杂度低的情况下，甚至在每个图像之间具有不同的运动模糊度的输入图像也可以获得没有或更少的运动模糊和重影假象的结果输出图像。 本发明优选应用于拜耳原始领域。 该优点是减少了计算和存储器，因为每个像素只处理1个颜色分量。 另一个好处是更高的信号保真度，因为拜耳原始域中的处理不受去马赛克伪像的影响，特别是沿着边缘。 然而，本发明也可以应用于RGB域。

公开(公告)号：US20130188026A1

公开(公告)日：2013-07-25

申请号：US13813503

申请日：2012-09-12

申请人： Masao Hiramoto ,  Yasunori Ishii ,  Yusuke Monobe

发明人： Masao Hiramoto ,  Yasunori Ishii ,  Yusuke Monobe

IPC分类号： H04N13/02

CPC分类号： H04N13/236 ,  G01B11/24 ,  G03B35/10 ,  H04N13/218 ,  H04N13/271

摘要： A depth estimating image capture device as an embodiment of this invention includes: an image sensor 2 with photosensitive cells 10 arranged on its image capturing plane; an optical lens arranged to condense light on the plane; a light-transmitting member 1 arranged on the plane; and a signal processing section that processes signals supplied from the cells 10. The member 1 includes a first mirror 1a inside to reflect the light at least partially and a second mirror 1b with the same reflection property as the first mirror 1a on its upper surface. The first mirror 1a has a reflective surface tilted with respect to the upper surface of the member 1. The second mirror 1b has a reflective surface that is parallel to the upper surface. The first and second mirrors 1a and 1b are arranged so that a light beam coming from a point on a subject through the lens is reflected from the first mirror 1a and from the second mirror 1b and irradiates some area on the image capturing plane to make the irradiated area change according to the depth of the point on the subject.

摘要翻译： 作为本发明的实施例的深度估计图像捕获装置包括：具有布置在其图像捕获平面上的感光单元10的图像传感器2; 光学透镜，布置成在平面上冷凝光; 布置在平面上的透光构件1; 以及处理从单元10供给的信号的信号处理部。构件1包括内部以至少部分地反射光的第一反射镜1a和在其上表面具有与第一反射镜1a相同的反射特性的第二反射镜1b。 第一反射镜1a具有相对于构件1的上表面倾斜的反射表面。第二反射镜1b具有平行于上表面的反射表面。 第一和第二反射镜1a和1b被布置成使得来自通过透镜的被摄体上的点的光束从第一反射镜1a和第二反射镜1b反射并照射到图像捕获平面上的某个区域， 照射区域根据被摄体上的点的深度而变化。

公开(公告)号：US20130121537A1

公开(公告)日：2013-05-16

申请号：US13812038

申请日：2012-05-24

申请人： Yusuke Monobe ,  Hitoshi Yamada

发明人： Yusuke Monobe ,  Hitoshi Yamada

IPC分类号： G01C11/06

CPC分类号： G01C11/06 ,  G01C3/32 ,  G02B7/38 ,  G06T5/003 ,  G06T5/50 ,  G06T7/20 ,  G06T2207/20201 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/2355

摘要： This image processing apparatus is an image processing apparatus for measuring a subject distance using a plurality of captured images acquired by capturing the same subject in a plurality of imaging states in succession of time, and includes a target motion amount estimation unit that estimates a target motion amount representing an amount of shift in subject position between first and second images among the captured images, the first image being captured in a first imaging state and a second image being captured in a second imaging state different from the first imaging state, a corrected image generation unit that generates a corrected image by performing motion compensation on the second image based on the target motion amount, and an image processing unit that performs image processing such as measuring a subject distance or generating an HDR image, using the first image and the corrected image.

摘要翻译： 该图像处理装置是使用通过在多个成像状态中连续拍摄相同被摄体而获取的多个拍摄图像来测量被摄体距离的图像处理装置，包括：目标运动量估计单元，其估计目标运动 量表示拍摄图像中的第一和第二图像之间的被摄体位置的偏移量，第一图像以第一成像状态捕获，第二图像在与第一成像状态不同的第二成像状态中捕获，校正图像 生成单元，其通过基于目标运动量对第二图像执行运动补偿来生成校正图像;以及图像处理单元，其使用第一图像和校正的图像处理单元来执行诸如测量被摄体距离或生成HDR图像的图像处理， 图片。

公开(公告)号：US20120086822A1

公开(公告)日：2012-04-12

申请号：US13377038

申请日：2011-03-17

申请人： Yasunori Ishii ,  Yusuke Monobe ,  Yasushi Yagi ,  Yasuhiro Mukaigawa

发明人： Yasunori Ishii ,  Yusuke Monobe ,  Yasushi Yagi ,  Yasuhiro Mukaigawa

IPC分类号： H04N5/225

CPC分类号： H04N5/23258 ,  G06T5/003 ,  H04N5/23267

摘要： Blur correction device (100) includes: a blur information generation unit (203) which generates blur information based on sensor data indicating camera motion; a blur correction unit (204) which corrects blur in a captured image, based on the blur information, to generate a candidate corrected image; an evaluation value calculation unit (205) which calculates an evaluation value indicating a blur correction level for the candidate corrected image; a termination judgment unit (206) which judges whether the blur correction should be terminated, based on a predetermined condition; and a blur information updating unit which updates the blur information, when the blur correction should not be terminated. When the blur information is updated, the blur correction unit (204) corrects the blur, based on the updated blur information, to generate a new candidate corrected image. When the blur correction should be terminated, the termination judgment unit (206) determines the corrected image from the candidate corrected images, based on the evaluation value.

摘要翻译： 模糊校正装置（100）包括：模糊信息生成单元（203），其基于指示相机动作的传感器数据生成模糊信息; 模糊校正单元，其基于所述模糊信息来校正拍摄图像中的模糊，以生成候选校正图像; 评估值计算单元，其计算表示候选校正图像的模糊校正水平的评估值; 基于预定条件判断模糊校正是否应终止的终止判断单元（206）; 以及当模糊校正不应终止时，模糊信息更新单元更新模糊信息。 当模糊信息被更新时，模糊校正单元（204）基于更新的模糊信息来校正模糊，以生成新的候选校正图像。 当模糊校正应该被终止时，终止判断单元206基于评估值从候选校正图像中确定校正图像。

公开(公告)号：US08089548B2

公开(公告)日：2012-01-03

申请号：US12663594

申请日：2009-04-09

申请人： Yasunobu Ogura ,  Yusuke Monobe ,  Shinya Kojima ,  Yukiyasu Fukami ,  Keiichi Miyazaki

发明人： Yasunobu Ogura ,  Yusuke Monobe ,  Shinya Kojima ,  Yukiyasu Fukami ,  Keiichi Miyazaki

IPC分类号： H04N5/222

CPC分类号： G06T7/11 ,  G06T7/194 ,  G06T2207/10024 ,  G06T2207/20104 ,  G06T2207/20132

摘要： An image processing device appropriately extracts an entire object from an image even if the object is not completely included in an initial region designated by a user. The image processing device includes: a designation unit designating a position on the image; a setting unit setting a first combination consisting of a first object region candidate and a first background region candidate, and a second combination; a histogram generation unit generating a normalized color histogram of each of the regions; a similarity calculation unit calculating a similarity regarding each of the combinations; and a selection unit configured to select a combination from the first and second combinations so that the selected combination has the similarity lower than the similarity of the non-selected combination.

摘要翻译： 即使对象未完全包含在由用户指定的初始区域中，图像处理设备也适当地从图像中提取整个对象。 图像处理装置包括：指定图像上的位置的指定单元; 设置单元，设置由第一对象区域候选和第一背景区域候选构成的第一组合和第二组合; 直方图生成单元，生成每个区域的归一化颜色直方图; 相似度计算单元，计算与组合中的每一个相似度; 以及选择单元，被配置为从第一和第二组合中选择组合，使得所选择的组合具有低于未选择组合的相似度的相似度。

公开(公告)号：US20110241991A1

公开(公告)日：2011-10-06

申请号：US13133223

申请日：2010-10-05

申请人： Yasunobu Ogura ,  Yusuke Monobe

发明人： Yasunobu Ogura ,  Yusuke Monobe

IPC分类号： G09G5/08

CPC分类号： H04N5/23293 ,  G06K9/00248 ,  G06K9/00315 ,  G06T7/20 ,  G06T2207/20104 ,  G06T2207/30201 ,  H04N5/23216 ,  H04N5/23219

摘要： Provided is a tracking object selection apparatus (1a) which selects a tracking object (103xm). The tracking object selection apparatus (1a) includes a synthesis unit (306) which synthesizes an input image (9Ib) and an image (93) so that the image is disposed at a predetermined position (92P), a display unit (307), and a selection unit (308) which selects, as the tracking object (103xm) in a predetermined process, a detected object (301x) when an operation (104L2) is performed on the image (92) displayed at the predetermined position (92P).

摘要翻译： 提供了一种选择跟踪对象（103xm）的跟踪对象选择装置（1a）。 跟踪对象选择装置（1a）包括合成单元（306），其合成输入图像（9Ib）和图像（93），使得图像被布置在预定位置（92P），显示单元（307）， 以及选择单元（308），其在对所述预定位置（92P）上显示的图像（92）执行操作（104L2）时，选择在预定处理中作为跟踪对象（103xm）的检测对象（301x） 。

公开(公告)号：US20110058050A1

公开(公告)日：2011-03-10

申请号：US12991208

申请日：2008-06-19

申请人： Pongsak Lasang ,  ChinPhek Ong ,  Sheng Mei Shen ,  Kenji Tamura ,  Yusuke Monobe

发明人： Pongsak Lasang ,  ChinPhek Ong ,  Sheng Mei Shen ,  Kenji Tamura ,  Yusuke Monobe

IPC分类号： H04N5/228

CPC分类号： H04N5/235 ,  H04N5/144 ,  H04N5/217 ,  H04N5/2355

摘要： A method and apparatus for motion blur and ghosting prevention in imaging system is presented. A residue image is computed by performing spatial-temporal filter with a set of absolute image difference of image pairs from input images. A noise adaptive pixel threshold is computed for every pixel based on noise statistics of image sensor. The residue image and the noise adaptive pixel threshold are used to create a motion masking map. The motion masking map is used to represent motion and non-motion pixels in pixels merging. The pixels merging step is performed to generate an output image by considering the motion pixels where the motion pixels are performed separately. The resulting output image having no or less motion blur and ghosting artifacts can be obtained, even the input images having different degree of motion blur between each of the image, while the complexity is low. It is preferred that the current invention is applied in the Bayer raw domain. The benefit is reduced computation and memory because only 1 color component is processed for each pixel. Another benefit is higher signal fidelity because processing in the Bayer raw domain is unaffected by demosaicing artifacts, especially along edges. However, the current invention can also be applied in RGB domain.

摘要翻译： 提出了一种成像系统中运动模糊和重影防止的方法和装置。 通过执行具有来自输入图像的图像对的一组绝对图像差异的空间 - 时间滤波来计算残差图像。 基于图像传感器的噪声统计，为每个像素计算噪声自适应像素阈值。 残差图像和噪声自适应像素阈值用于创建运动掩蔽图。 运动屏蔽图用于表示像素合并中的运动和非运动像素。 执行像素合并步骤，通过考虑分别执行运动像素的运动像素来生成输出图像。 即使在复杂度低的情况下，甚至在每个图像之间具有不同的运动模糊度的输入图像也可以获得没有或更少的运动模糊和重影假象的结果输出图像。 本发明优选应用于拜耳原始领域。 该优点是减少了计算和存储器，因为每个像素只处理1个颜色分量。 另一个好处是更高的信号保真度，因为拜耳原始域中的处理不受去马赛克伪像的影响，特别是沿着边缘。 然而，本发明也可以应用于RGB域。