公开(公告)号：US08547442B2

公开(公告)日：2013-10-01

申请号：US12991208

申请日：2008-06-19

申请人： Pongsak Lasang ,  ChinPhek Ong ,  Sheng Mei Shen ,  Kenji Tamura ,  Yusuke Monobe

发明人： Pongsak Lasang ,  ChinPhek Ong ,  Sheng Mei Shen ,  Kenji Tamura ,  Yusuke Monobe

IPC分类号： H04N5/228

CPC分类号： H04N5/235 ,  H04N5/144 ,  H04N5/217 ,  H04N5/2355

摘要： A method and apparatus for motion blur and ghosting prevention in imaging system is presented. A residue image is computed by performing spatial-temporal filter with a set of absolute image difference of image pairs from input images. A noise adaptive pixel threshold is computed for every pixel based on noise statistics of image sensor. The residue image and the noise adaptive pixel threshold are used to create a motion masking map. The motion masking map is used to represent motion and non-motion pixels in pixels merging. The pixels merging step is performed to generate an output image by considering the motion pixels where the motion pixels are performed separately. The resulting output image having no or less motion blur and ghosting artifacts can be obtained, even the input images having different degree of motion blur between each of the image, while the complexity is low. It is preferred that the current invention is applied in the Bayer raw domain. The benefit is reduced computation and memory because only 1 color component is processed for each pixel. Another benefit is higher signal fidelity because processing in the Bayer raw domain is unaffected by demosaicing artifacts, especially along edges. However, the current invention can also be applied in RGB domain.

摘要翻译： 提出了一种成像系统中运动模糊和重影防止的方法和装置。 通过执行具有来自输入图像的图像对的一组绝对图像差异的空间 - 时间滤波来计算残差图像。 基于图像传感器的噪声统计，为每个像素计算噪声自适应像素阈值。 残差图像和噪声自适应像素阈值用于创建运动掩蔽图。 运动屏蔽图用于表示像素合并中的运动和非运动像素。 执行像素合并步骤，通过考虑分别执行运动像素的运动像素来生成输出图像。 即使在复杂度低的情况下，甚至在每个图像之间具有不同的运动模糊度的输入图像也可以获得没有或更少的运动模糊和重影假象的结果输出图像。 本发明优选应用于拜耳原始领域。 该优点是减少了计算和存储器，因为每个像素只处理1个颜色分量。 另一个好处是更高的信号保真度，因为拜耳原始域中的处理不受去马赛克伪像的影响，特别是沿着边缘。 然而，本发明也可以应用于RGB域。

公开(公告)号：US20110058050A1

公开(公告)日：2011-03-10

申请号：US12991208

申请日：2008-06-19

申请人： Pongsak Lasang ,  ChinPhek Ong ,  Sheng Mei Shen ,  Kenji Tamura ,  Yusuke Monobe

发明人： Pongsak Lasang ,  ChinPhek Ong ,  Sheng Mei Shen ,  Kenji Tamura ,  Yusuke Monobe

IPC分类号： H04N5/228

CPC分类号： H04N5/235 ,  H04N5/144 ,  H04N5/217 ,  H04N5/2355

摘要： A method and apparatus for motion blur and ghosting prevention in imaging system is presented. A residue image is computed by performing spatial-temporal filter with a set of absolute image difference of image pairs from input images. A noise adaptive pixel threshold is computed for every pixel based on noise statistics of image sensor. The residue image and the noise adaptive pixel threshold are used to create a motion masking map. The motion masking map is used to represent motion and non-motion pixels in pixels merging. The pixels merging step is performed to generate an output image by considering the motion pixels where the motion pixels are performed separately. The resulting output image having no or less motion blur and ghosting artifacts can be obtained, even the input images having different degree of motion blur between each of the image, while the complexity is low. It is preferred that the current invention is applied in the Bayer raw domain. The benefit is reduced computation and memory because only 1 color component is processed for each pixel. Another benefit is higher signal fidelity because processing in the Bayer raw domain is unaffected by demosaicing artifacts, especially along edges. However, the current invention can also be applied in RGB domain.

摘要翻译： 提出了一种成像系统中运动模糊和重影防止的方法和装置。 通过执行具有来自输入图像的图像对的一组绝对图像差异的空间 - 时间滤波来计算残差图像。 基于图像传感器的噪声统计，为每个像素计算噪声自适应像素阈值。 残差图像和噪声自适应像素阈值用于创建运动掩蔽图。 运动屏蔽图用于表示像素合并中的运动和非运动像素。 执行像素合并步骤，通过考虑分别执行运动像素的运动像素来生成输出图像。 即使在复杂度低的情况下，甚至在每个图像之间具有不同的运动模糊度的输入图像也可以获得没有或更少的运动模糊和重影假象的结果输出图像。 本发明优选应用于拜耳原始领域。 该优点是减少了计算和存储器，因为每个像素只处理1个颜色分量。 另一个好处是更高的信号保真度，因为拜耳原始域中的处理不受去马赛克伪像的影响，特别是沿着边缘。 然而，本发明也可以应用于RGB域。

公开(公告)号：US09014462B2

公开(公告)日：2015-04-21

申请号：US13520654

申请日：2011-11-09

申请人： Hitoshi Yamada ,  Thanaphat Thummanuntawat ,  Pongsak Lasang ,  Sheng Mei Shen

发明人： Hitoshi Yamada ,  Thanaphat Thummanuntawat ,  Pongsak Lasang ,  Sheng Mei Shen

IPC分类号： G06K9/00 ,  G06T7/00

CPC分类号： G06K9/00362 ,  G06T7/11 ,  G06T7/187 ,  G06T7/194 ,  G06T7/50 ,  G06T2207/10024 ,  G06T2207/20104 ,  G06T2207/30196 ,  G06T2207/30201 ,  H04N13/128 ,  H04N13/261

摘要： A depth information generating device includes a region extracting unit that detects a human face in at least one two-dimensional image, and based on the detected face, extracts a human figure region indicating a human figure within a region of the at least one two-dimensional image; and a depth map generating unit that gives a depth value different from a depth value of a region other than the human figure region to the human figure region to generate a depth map that separates the human figure region from the region other than the human figure region.

摘要翻译： 深度信息生成装置包括区域提取单元，其检测至少一个二维图像中的人脸，并且基于检测到的面部，提取在至少一个二维图像的区域内指示人物的人物图形区域， 三维图像; 以及深度图生成单元，其给出与人体图形区域以外的区域的深度值不同的深度值，以生成将人体图像区域与人体图像区域以外的区域分开的深度图 。

公开(公告)号：US20120274634A1

公开(公告)日：2012-11-01

申请号：US13520654

申请日：2011-11-09

申请人： Hitoshi Yamada ,  Thanaphat Thummanuntawat ,  Pongsak Lasang ,  Sheng Mei Shen

发明人： Hitoshi Yamada ,  Thanaphat Thummanuntawat ,  Pongsak Lasang ,  Sheng Mei Shen

IPC分类号： G06T15/00

CPC分类号： G06K9/00362 ,  G06T7/11 ,  G06T7/187 ,  G06T7/194 ,  G06T7/50 ,  G06T2207/10024 ,  G06T2207/20104 ,  G06T2207/30196 ,  G06T2207/30201 ,  H04N13/128 ,  H04N13/261

摘要： A depth information generating device according to the present invention includes a region extracting unit that detects a human face in at least one two-dimensional image, and based on the detected face, extracts a human figure region indicating a human figure within a region of the at least one two-dimensional image; and a depth map generating unit that gives a depth value different from a depth value of a region other than the human figure region to the human figure region to generate a depth map that separates the human figure region from the region other than the human figure region. Thereby, a depth map for displaying a 3D pop-out from which a viewer feels no unnaturalness can be generated.

摘要翻译： 根据本发明的深度信息产生装置包括：区域提取单元，其检测至少一个二维图像中的人脸，并且基于检测到的脸部，在该区域内提取指示人物图像的人物区域 至少一个二维图像; 以及深度图生成单元，其给出与人体图形区域以外的区域的深度值不同的深度值，以生成将人体图像区域与人体图像区域以外的区域分开的深度图 。 因此，可以生成用于显示观看者不感到不自然的3D弹出窗口的深度图。

公开(公告)号：US20130106848A1

公开(公告)日：2013-05-02

申请号：US13808388

申请日：2012-05-07

申请人： Khang Nguyen ,  Pongsak Lasang ,  Kyaw Kyaw Win ,  Sheng Mei Shen

发明人： Khang Nguyen ,  Pongsak Lasang ,  Kyaw Kyaw Win ,  Sheng Mei Shen

IPC分类号： G06T15/00

CPC分类号： G06T15/205 ,  G06T5/005 ,  G06T2207/10028 ,  H04N13/111

摘要： An image generation apparatus includes: a pixel-shifted image generation unit which generates a first pixel-shifted image resulting from a process of shifting, based on an input image and a depth map, a pixel in the input image by a shift amount corresponding to the new viewpoint, and a second pixel-shifted image resulting from a process of shifting, by the same shift amount as for the first pixel-shifted image, a pixel in a background edge image included in the input image and containing a pixel located in a background region around an edge of a foreground object; an image fusion unit which fuses the second pixel-shifted image and the first pixel-shifted image to include a background region in the second pixel-shifted image into a hole; and a hole filling unit which fills the hole with pixel information based on the fused pixel-shifted image.

摘要翻译： 一种图像生成装置包括：像素移位图像生成单元，其基于输入图像和深度图生成从移位处理得到的第一像素移位图像，输入图像中的像素与对应于 新视点和由与第一像素移位图像相同移位量的处理产生的第二像素移位图像是包括在输入图像中的背景边缘图像中的像素，并且包含位于 前景对象边缘周围的背景区域; 图像融合单元，其将所述第二像素移位图像和所述第一像素移位图像融合以将所述第二像素移位图像中的背景区域融合到孔中; 以及孔填充单元，其基于融合的像素移位图像填充孔与像素信息。

公开(公告)号：US20120147139A1

公开(公告)日：2012-06-14

申请号：US13320640

申请日：2011-03-14

申请人： Bo Li ,  Pongsak Lasang ,  Chin Phek Ong ,  Sheng Mei Shen ,  Junichi Tagawa

发明人： Bo Li ,  Pongsak Lasang ,  Chin Phek Ong ,  Sheng Mei Shen ,  Junichi Tagawa

IPC分类号： H04N13/00

CPC分类号： G03B35/08 ,  H04N13/106 ,  H04N13/122 ,  H04N13/128 ,  H04N13/221 ,  H04N13/239 ,  H04N13/261 ,  H04N13/373 ,  H04N2013/0074

摘要： A stereoscopic image aligning apparatus (200) automatically aligns image pairs for stereoscopic viewing in a shorter amount of time than conventional apparatuses, which is applicable to image pairs captured by a single sensor camera or a variable baseline camera, without relying on camera parameters. The stereoscopic image aligning apparatus (200) includes: an image pair obtaining unit (205) obtaining an image pair including a left-eye image and a right-eye image corresponding to the left-eye image; a corresponding point detecting unit (252) detecting a corresponding point representing a set of a first point included in a first image that is one of the images of the image pair and a second point included in a second image that is the other of the images of the image pair and corresponding to the first point; a first matrix computing unit (254) computing a homography transformation matrix for transforming the first point such that a vertical parallax between the first and second points is smallest and an epipolar constraint is satisfied; a transforming unit (260) transforming the first image using the homography transformation matrix; and an output unit (210) outputting: a third image that is the transformed first image; and the second image.

摘要翻译： 立体图像对准装置（200）以比常规装置更短的时间自动对准用于立体观看的图像对，其可应用于由单个传感器相机或可变基线相机捕获的图像对，而不依赖于相机参数。 立体图像对准装置（200）包括：图像对获取单元（205），获得包括与左眼图像相对应的左眼图像和右眼图像的图像对; 对应点检测单元（252），检测表示包括在作为图像对的图像之一的第一图像中的第一点的集合的对应点和包括在作为另一个图像的第二图像中的第二点 的图像对并对应于第一点; 第一矩阵计算单元（254）计算用于变换第一点的单应变换矩阵，使得第一和第二点之间的垂直视差最小并且满足对极约束; 变换单元（260），其使用所述单应变换矩阵来变换所述第一图像; 以及输出单元（210），输出：作为变换后的第一图像的第三图像; 和第二个图像。

公开(公告)号：US09092875B2

公开(公告)日：2015-07-28

申请号：US13699811

申请日：2012-04-10

申请人： Hitoshi Yamada ,  Pongsak Lasang ,  Sheng Mei Shen

发明人： Hitoshi Yamada ,  Pongsak Lasang ,  Sheng Mei Shen

IPC分类号： G06T7/00 ,  G06T7/20

CPC分类号： G06T7/2006 ,  G06T7/246 ,  G06T7/571 ,  G06T2207/10016 ,  G06T2207/10148 ,  G06T2207/20201

摘要： A motion estimation apparatus according to an aspect of the present invention is a motion estimation apparatus for estimating, using a set of multi-focus images which correspond to a single scene and have different focuses, motion for each of the first regions included in the scene, including: a cost value computing unit configured to compute, using the set of multi-focus images, for each of the first regions, a cost value indicating a difference between a blur amount of the first region and a standard blur amount determined for each of distances in a depth direction; and a motion estimation unit configured to estimate, using the cost value, the motion of the first region corresponding to the cost value.

摘要翻译： 根据本发明的一个方面的运动估计装置是一种运动估计装置，用于使用与单个场景相对应且具有不同焦点的一组多焦点图像来估计包括在场景中的每个第一区域的运动 包括：成本值计算单元，被配置为针对所述第一区域中的每个区域计算使用所述一组多焦点图像，所述成本值指示所述第一区域的模糊量与为每个所述第一区域确定的标准模糊量之间的差异 深度方向的距离; 以及运动估计单元，被配置为使用所述成本值来估计与所述成本值对应的所述第一区域的运动。

公开(公告)号：US09076204B2

公开(公告)日：2015-07-07

申请号：US13520257

申请日：2011-11-07

申请人： Yasunobu Ogura ,  Pongsak Lasang ,  Sheng Mei Shen

发明人： Yasunobu Ogura ,  Pongsak Lasang ,  Sheng Mei Shen

IPC分类号： G06T5/00 ,  H04N5/232 ,  G06T5/50

CPC分类号： G06T5/003 ,  G06T5/50 ,  G06T2207/10148 ,  G06T2207/20221 ,  H04N5/23212

摘要： An image capturing device includes: a pre-capturing module which captures an imaging target at each of different focus positions in a predetermined focus range and outputs, as a capturing result, a plurality of pre-captured images lower in resolution than the output image; an object sharpness evaluating module which computes a sharpness level of each of the pre-captured images captured by the pre-capturing module; a focus varying range determining module which determines a focus position varying range within the predetermined focus range based on sharpness levels computed by the object sharpness evaluating module, such that a signal-to-noise ratio of the output image is greater than or equal to a predetermined threshold; and an image capturing module which captures the imaging target while varying the focus position according to the focus position varying range determined by the focus varying range determining module, and outputs the output image as a capturing result.

摘要翻译： 一种图像捕获装置包括：预捕获模块，其在预定的聚焦范围中的每个不同聚焦位置处捕获成像目标，并作为捕获结果输出分辨率低于输出图像的多个预先拍摄的图像; 对象清晰度评估模块，其计算由所述预捕获模块捕获的每个所述预捕获图像的清晰度水平; 焦点变化范围确定模块，其基于由对象锐度评估模块计算的清晰度水平确定预定焦距范围内的焦点位置变化范围，使得输出图像的信噪比大于或等于 预定阈值; 以及图像拍摄模块，其根据由焦点变化范围确定模块确定的焦点位置变化范围来改变焦点位置时捕获成像目标，并将输出图像输出为捕获结果。

公开(公告)号：US20130101177A1

公开(公告)日：2013-04-25

申请号：US13699811

申请日：2012-04-10

申请人： Hitoshi Yamada ,  Pongsak Lasang ,  Sheng Mei Shen

发明人： Hitoshi Yamada ,  Pongsak Lasang ,  Sheng Mei Shen

IPC分类号： G06T7/20 ,  G06T7/00

CPC分类号： G06T7/2006 ,  G06T7/246 ,  G06T7/571 ,  G06T2207/10016 ,  G06T2207/10148 ,  G06T2207/20201

摘要： A motion estimation apparatus according to an aspect of the present invention is a motion estimation apparatus for estimating, using a set of multi-focus images which correspond to a single scene and have different focuses, motion for each of the first regions included in the scene, including: a cost value computing unit configured to compute, using the set of multi-focus images, for each of the first regions, a cost value indicating a difference between a blur amount of the first region and a standard blur amount determined for each of distances in a depth direction; and a motion estimation unit configured to estimate, using the cost value, the motion of the first region corresponding to the cost value.

摘要翻译： 根据本发明的一个方面的运动估计装置是一种运动估计装置，用于使用与单个场景相对应且具有不同焦点的一组多焦点图像来估计包括在场景中的每个第一区域的运动 包括：成本值计算单元，被配置为针对所述第一区域中的每个区域计算使用所述一组多焦点图像，所述成本值指示所述第一区域的模糊量与为每个所述第一区域确定的标准模糊量之间的差异 深度方向的距离; 以及运动估计单元，被配置为使用所述成本值来估计与所述成本值对应的所述第一区域的运动。

公开(公告)号：US09111389B2

公开(公告)日：2015-08-18

申请号：US13808388

申请日：2012-05-07

申请人： Khang Nguyen ,  Pongsak Lasang ,  Kyaw Kyaw Win ,  Sheng Mei Shen

发明人： Khang Nguyen ,  Pongsak Lasang ,  Kyaw Kyaw Win ,  Sheng Mei Shen

IPC分类号： G06T15/20 ,  H04N13/00 ,  G06T5/00

CPC分类号： G06T15/205 ,  G06T5/005 ,  G06T2207/10028 ,  H04N13/111

摘要： An image generation apparatus includes: a pixel-shifted image generation unit which generates a first pixel-shifted image resulting from a process of shifting, based on an input image and a depth map, a pixel in the input image by a shift amount corresponding to the new viewpoint, and a second pixel-shifted image resulting from a process of shifting, by the same shift amount as for the first pixel-shifted image, a pixel in a background edge image included in the input image and containing a pixel located in a background region around an edge of a foreground object; an image fusion unit which fuses the second pixel-shifted image and the first pixel-shifted image to include a background region in the second pixel-shifted image into a hole; and a hole filling unit which fills the hole with pixel information based on the fused pixel-shifted image.

摘要翻译： 一种图像生成装置包括：像素移位图像生成单元，其基于输入图像和深度图生成从移位处理得到的第一像素移位图像，输入图像中的像素与对应于 新视点和由与第一像素移位图像相同移位量的处理产生的第二像素移位图像是包括在输入图像中的背景边缘图像中的像素，并且包含位于 前景对象边缘周围的背景区域; 图像融合单元，其将所述第二像素移位图像和所述第一像素移位图像融合以将所述第二像素移位图像中的背景区域融合到孔中; 以及孔填充单元，其基于融合的像素移位图像填充孔与像素信息。