公开(公告)号：US20100231745A1

公开(公告)日：2010-09-16

申请号：US12303797

申请日：2007-06-01

申请人： Ming Li ,  Ryota Kosakai ,  Akira Matsui

发明人： Ming Li ,  Ryota Kosakai ,  Akira Matsui

IPC分类号： H04N9/73

CPC分类号： H04N9/045 ,  H04N9/09 ,  H04N2209/047 ,  H04N2209/049

摘要： The present invention provides an imaging device that generates, for, each of a red color, a green color, and a blue color, an image signal having pixels arranged adjacent to each other in a two-dimensional array, including a red color imaging element that senses incident light to output a red color signal (20R) having pixels arranged in a check pattern, a green color imaging element that senses the incident light to output a green color signal (20G) having pixels arranged in a check pattern, a blue color imaging element that senses the incident light to output a blue color signal (20B) having pixels arranged in a check pattern, interpolation means for interpolating a blank pixel using neighboring pixels, and correlation means for determining a correlation of the neighboring pixels of the blank pixel, wherein the correlation means determines a correlation for each of the red color signal, the green color signal, and the blue color signal on the basis of at least one color signal of the red color signal, the green color signal, and the blue color signal, and wherein the interpolation means interpolates the blank pixel for each of the red color signal, the green color signal, and the blue color signal on the basis of the correlation to generate an imaging signal.

摘要翻译： 本发明提供了一种成像装置，其对于红色，绿色和蓝色各自产生具有以二维阵列彼此相邻布置的像素的图像信号，所述二维阵列包括红色成像元件 感测入射光以输出具有布置在检查图案中的像素的红色信号（20R）;感测入射光的绿色成像元件，以输出具有以检查图案布置的像素的绿色信号（20G），蓝色 感测所述入射光以输出具有以检查图案排列的像素的蓝色信号（20B）的彩色成像元件，用于使用相邻像素内插空白像素的插值装置，以及用于确定所述空白的相邻像素的相关性的相关装置 像素，其中所述相关装置基于所述红色信号，所述绿色信号和所述蓝色信号中的至少一个颜色信号来确定所述红色信号， 红色信号，绿色信号和蓝色信号，并且其中插值装置基于相关性来内插红色信号，绿色信号和蓝色信号中的每一个的空白像素以产生 成像信号。

公开(公告)号：US20070013786A1

公开(公告)日：2007-01-18

申请号：US11471360

申请日：2006-06-20

申请人： Takuya Chiba ,  Ryota Kosakai ,  Akira Matsui

发明人： Takuya Chiba ,  Ryota Kosakai ,  Akira Matsui

IPC分类号： H04N5/228

CPC分类号： H04N9/045

摘要： An image processing device includes a correlation value calculating unit calculating plural correlation values indicating degrees of correlation of an image for a pixel of attention to be interpolated on a solid-state imaging device having filters of predetermined color coding; a judging unit judging a direction in which interpolation should be performed by calculating, in different directions, at least two patterns of the plural correlation values calculated by the correlation value calculating unit and comparing the correlation values of at least two patterns with correlation lines obtained by plotting the correlation values with respect to straight lines of various angles; and an interpolating unit applying interpolation processing to the pixel of attention on the basis of information on pixels around the pixel of attention present in the direction judged by the judging unit.

摘要翻译： 一种图像处理装置，包括：相关值计算单元，对具有预定颜色编码滤波器的固态成像装置，计算表示要插值的注意像素的图像的相关度的多个相关值; 判断单元，通过在不同方向上计算由所述相关值计算单元计算出的所述多个相关值中的至少两个图案，并且将至少两个图案的相关值与相关行进行比较，所述相关值与 绘制相对于各种角度的直线的相关值; 以及内插单元，基于关于由所述判断单元判断的方向存在的关注像素周围的像素的信息，向所述注意的像素应用内插处理。

公开(公告)号：US07982781B2

公开(公告)日：2011-07-19

申请号：US11471360

申请日：2006-06-20

申请人： Takuya Chiba ,  Ryota Kosakai ,  Akira Matsui

发明人： Takuya Chiba ,  Ryota Kosakai ,  Akira Matsui

IPC分类号： H04N5/228

CPC分类号： H04N9/045

摘要： An image processing device includes a correlation value calculating unit calculating plural correlation values indicating degrees of correlation of an image for a pixel of attention to be interpolated on a solid-state imaging device having filters of predetermined color coding; a judging unit judging a direction in which interpolation should be performed by calculating, in different directions, at least two patterns of the plural correlation values calculated by the correlation value calculating unit and comparing the correlation values of at least two patterns with correlation lines obtained by plotting the correlation values with respect to straight lines of various angles; and an interpolating unit applying interpolation processing to the pixel of attention on the basis of information on pixels around the pixel of attention present in the direction judged by the judging unit.

摘要翻译： 一种图像处理装置，包括：相关值计算单元，对具有预定颜色编码滤波器的固态成像装置，计算表示要插值的注意像素的图像的相关度的多个相关值; 判断单元，通过在不同方向上计算由所述相关值计算单元计算出的所述多个相关值中的至少两个图案，并且将至少两个图案的相关值与相关行进行比较，所述相关值与 绘制相对于各种角度的直线的相关值; 以及内插单元，基于关于由所述判断单元判断的方向存在的关注像素周围的像素的信息，向所述注意的像素应用内插处理。

公开(公告)号：US07570290B2

公开(公告)日：2009-08-04

申请号：US11302703

申请日：2005-12-14

申请人： Kazuhide Yokota ,  Hisashi Kurebayashi ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda ,  Seishin Asato ,  Takuya Chiba ,  Ryota Kosakai

发明人： Kazuhide Yokota ,  Hisashi Kurebayashi ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda ,  Seishin Asato ,  Takuya Chiba ,  Ryota Kosakai

IPC分类号： H04N3/14 ,  H04N5/335 ,  H04N9/083 ,  H01L27/00

CPC分类号： H04N9/045 ,  H04N5/347

摘要： A drive method for a solid-state imaging device having an oblique pixel pattern includes the steps of: adding, separately for an odd-numbered row and an even-numbered row, x pixels in the horizontal direction and y pixels in the vertical direction, the x pixels and the y pixels having the same color, in an area having adjacent n pixels in the horizontal direction and adjacent n pixels in the vertical direction, where n is an odd number of three or greater and n≧x≧y; and repeatedly adding the x pixels and the y pixels while shifting the n×n area by m pixels in the vertical or horizontal direction, where m is an odd number of three or greater. The n×n area of odd-numbered rows is displaced from that of even-numbered rows by m pixels in the oblique direction in the oblique pixel pattern.

摘要翻译： 具有倾斜像素图案的固态成像装置的驱动方法包括以下步骤：分别对奇数行和偶数行添加水平方向上的x个像素和垂直方向上的y个像素， 具有相同颜色的x像素和y像素在具有水平方向上相邻的n个像素并且在垂直方向上相邻的n个像素的区域中，其中n是三个或更大的奇数，并且n> = x> = y ; 并且在垂直或水平方向上移动n×n个区域×m个像素的同时，重复地添加x个像素和y个像素，其中m是三个或更大的奇数。 奇数行的nxn区域在倾斜像素图案中沿倾斜方向从偶数行的像素移位m个像素。

公开(公告)号：US20090160988A1

公开(公告)日：2009-06-25

申请号：US12393179

申请日：2009-02-26

申请人： Kazuhide Yokota ,  Hisashi Kurebayashi ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda ,  Seishin Asato ,  Takuya Chiba ,  Ryota Kosakai

发明人： Kazuhide Yokota ,  Hisashi Kurebayashi ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda ,  Seishin Asato ,  Takuya Chiba ,  Ryota Kosakai

IPC分类号： H04N5/335

CPC分类号： H04N9/045 ,  H04N5/347

摘要： A solid-state imaging device having: (a) a pixel array with an oblique pixel pattern in which pixels are obliquely disposed, an odd-numbered row vertical signal line in an odd-numbered row vertical signal line group being connected to each column of odd-numbered row pixels and an even-numbered row vertical signal line in an even-numbered row vertical signal line group being connected to each column of even-numbered row pixels; (b) a row selector for separately selecting an odd-numbered row and an even-numbered row of the oblique pixel pattern; (c) an odd-numbered row column processing circuit group including column processing circuits and connected to the odd-numbered row vertical signal line group, for adding signals of the odd-numbered row pixels between columns; (d) an even-numbered row column processing circuit group including column processing circuits and connected to the even-numbered row vertical signal line group, for adding signals of the even-numbered row pixels in pixel columns; and (d) a column selector for selecting the column processing circuits of the odd-numbered row column processing circuit group and the column processing circuits of the even-numbered row column processing circuit group.

摘要翻译： 一种固态成像装置，具有：（a）具有倾斜像素图案的像素阵列，其中倾斜地设置有像素，奇数行垂直信号线组中的奇数行垂直信号线连接到每列 偶数行像素和偶数行垂直信号线组中的偶数行垂直信号线连接到每列偶数行像素; （b）用于分别选择倾斜像素图案的奇数行和偶数行的行选择器; （c）包括列处理电路并连接到奇数行垂直信号线组的奇数列列处理电路组，用于将列之间的奇数行像素的信号相加; （d）偶数行列处理电路组，包括列处理电路并连接到偶数行垂直信号线组，用于将像素列中的偶数行像素的信号相加; 和（d）用于选择奇数行列处理电路组的列处理电路和偶数行列处理电路组的列处理电路的列选择器。

公开(公告)号：US08471936B2

公开(公告)日：2013-06-25

申请号：US12303797

申请日：2007-06-01

申请人： Li Ming ,  Ryota Kosakai ,  Akira Matsui

发明人： Li Ming ,  Ryota Kosakai ,  Akira Matsui

IPC分类号： H04N9/09 ,  H04N9/83 ,  H04N3/14 ,  H04N5/335 ,  H04N9/04

CPC分类号： H04N9/045 ,  H04N9/09 ,  H04N2209/047 ,  H04N2209/049

摘要： The present invention provides an imaging device that generates, for each of a red color, a green color, and a blue color, an image signal having pixels arranged adjacent to each other in a two-dimensional array, including a red color imaging element that senses incident light to output a red color signal (20R) having pixels arranged in a check pattern, a green color imaging element that senses the incident light to output a green color signal (20G) having pixels arranged in a check pattern, a blue color imaging element that senses the incident light to output a blue color signal (20B) having pixels arranged in a check pattern, interpolation means for interpolating a blank pixel using neighboring pixels, and correlation means for determining a correlation of the neighboring pixels of the blank pixel, wherein the correlation means determines a correlation for each of the red color signal, the green color signal, and the blue color signal on the basis of at least one color signal of the red color signal, the green color signal, and the blue color signal, and wherein the interpolation means interpolates the blank pixel for each of the red color signal, the green color signal, and the blue color signal on the basis of the correlation to generate an imaging signal.

摘要翻译： 本发明提供了一种成像装置，其针对红色，绿色和蓝色中的每一者生成具有以二维阵列彼此相邻布置的像素的图像信号，所述二维阵列包括红色成像元件，所述红色成像元件 感测入射光以输出具有布置在检查图案中的像素的红色信号（20R）;感测入射光的绿色成像元件，以输出具有布置在检查图案中的像素的绿色信号（20G），蓝色 感测入射光以输出具有以检查图案排列的像素的蓝色信号（20B）的成像元件，用于使用相邻像素内插空白像素的内插装置，以及用于确定空白像素的相邻像素的相关性的相关装置 其中所述相关装置基于所述红色信号，所述绿色信号和所述蓝色信号中的至少一个颜色信号来确定每个所述红色信号， 红色信号，绿色信号和蓝色信号，并且其中插值装置基于相关性来内插红色信号，绿色信号和蓝色信号中的每一个的空白像素以产生 成像信号。

公开(公告)号：US08023018B2

公开(公告)日：2011-09-20

申请号：US12393179

申请日：2009-02-26

申请人： Kazuhide Yokota ,  Hisashi Kurebayashi ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda ,  Seishin Asato ,  Takuya Chiba ,  Ryota Kosakai

发明人： Kazuhide Yokota ,  Hisashi Kurebayashi ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda ,  Seishin Asato ,  Takuya Chiba ,  Ryota Kosakai

IPC分类号： H04N3/14 ,  H04N5/335 ,  H04N9/083 ,  H01L27/00

CPC分类号： H04N9/045 ,  H04N5/347

摘要： A solid-state imaging device having: (a) a pixel array with an oblique pixel pattern in which pixels are obliquely disposed, an odd-numbered row vertical signal line in an odd-numbered row vertical signal line group being connected to each column of odd-numbered row pixels and an even-numbered row vertical signal line in an even-numbered row vertical signal line group being connected to each column of even-numbered row pixels; (b) a row selector for separately selecting an odd-numbered row and an even-numbered row of the oblique pixel pattern; (c) an odd-numbered row column processing circuit group including column processing circuits and connected to the odd-numbered row vertical signal line group, for adding signals of the odd-numbered row pixels between columns; (d) an even-numbered row column processing circuit group including column processing circuits and connected to the even-numbered row vertical signal line group, for adding signals of the even-numbered row pixels in pixel columns; and (d) a column selector for selecting the column processing circuits of the odd-numbered row column processing circuit group and the column processing circuits of the even-numbered row column processing circuit group.

摘要翻译： 一种固态成像装置，具有：（a）具有倾斜像素图案的像素阵列，其中倾斜地设置有像素，奇数行垂直信号线组中的奇数行垂直信号线连接到每列 偶数行像素和偶数行垂直信号线组中的偶数行垂直信号线连接到每列偶数行像素; （b）用于分别选择倾斜像素图案的奇数行和偶数行的行选择器; （c）包括列处理电路并连接到奇数行垂直信号线组的奇数列列处理电路组，用于将列之间的奇数行像素的信号相加; （d）偶数行列处理电路组，包括列处理电路并连接到偶数行垂直信号线组，用于将像素列中的偶数行像素的信号相加; 和（d）用于选择奇数行列处理电路组的列处理电路和偶数行列处理电路组的列处理电路的列选择器。

公开(公告)号：US20060139469A1

公开(公告)日：2006-06-29

申请号：US11302703

申请日：2005-12-14

申请人： Kazuhide Yokota ,  Hisashi Kurebayashi ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda ,  Seishin Asato ,  Takuya Chiba ,  Ryota Kosakai

发明人： Kazuhide Yokota ,  Hisashi Kurebayashi ,  Kenji Tanaka ,  Akira Matsui ,  Yutaka Yoneda ,  Seishin Asato ,  Takuya Chiba ,  Ryota Kosakai

IPC分类号： H04N9/04

CPC分类号： H04N9/045 ,  H04N5/347

摘要： A drive method for a solid-state imaging device having an oblique pixel pattern includes the steps of: adding, separately for an odd-numbered row and an even-numbered row, x pixels in the horizontal direction and y pixels in the vertical direction, the x pixels and the y pixels having the same color, in an area having adjacent n pixels in the horizontal direction and adjacent n pixels in the vertical direction, where n is an odd number of three or greater and n≧x≧y; and repeatedly adding the x pixels and the y pixels while shifting the n×n area by m pixels in the vertical or horizontal direction, where m is an odd number of three or greater. The n×n area of odd-numbered rows is displaced from that of even-numbered rows by m pixels in the oblique direction in the oblique pixel pattern.

公开(公告)号：US09208570B2

公开(公告)日：2015-12-08

申请号：US13432065

申请日：2012-03-28

申请人： Gazi Ali ,  Pingshan Li ,  Akira Matsui ,  Takami Mizukura

发明人： Gazi Ali ,  Pingshan Li ,  Akira Matsui ,  Takami Mizukura

IPC分类号： H04N7/18 ,  G06T7/00 ,  H04N5/232

CPC分类号： G06T7/0069 ,  G06T7/571 ,  G06T2207/10004 ,  G06T2207/10148 ,  H04N5/23212

摘要： A system and method for supporting a depth estimation procedure by utilizing an adaptive kernel includes a capture subsystem for capturing images of a photographic target. The capture subsystem includes an aperture that is adjustable for admitting reflected light from the photographic target to a sensor device. An adaptive kernel is designed in a kernel design procedure based upon symmetry characteristics of the aperture. The adaptive kernel may be designed in either a frequency-domain kernel design procedure or in a spatial-domain kernel design procedure. A depth estimator utilizes the adaptive kernel for performing the depth estimation procedure.

摘要翻译： 通过利用自适应内核来支持深度估计过程的系统和方法包括用于捕获摄影目标图像的捕获子系统。 捕获子系统包括可调节的孔，用于允许从摄影目标到传感器装置的反射光。 基于孔径对称特性的内核设计程序设计了一个自适应内核。 可以在频域内核设计过程中或在空域内核设计过程中设计自适应内核。 深度估计器利用自适应内核来执行深度估计过程。

公开(公告)号：US09161010B2

公开(公告)日：2015-10-13

申请号：US13430915

申请日：2012-03-27

申请人： Gazi Ali ,  Pingshan Li ,  Akira Matsui ,  Takami Mizukura

发明人： Gazi Ali ,  Pingshan Li ,  Akira Matsui ,  Takami Mizukura

IPC分类号： H04N13/00 ,  H04N13/02 ,  G06T5/00

CPC分类号： H04N13/128 ,  G06T5/003 ,  G06T2207/10012 ,  G06T2207/10028 ,  G06T2207/20016 ,  H04N13/271 ,  H04N2013/0081

摘要： A system and method for generating robust depth maps includes a depth estimator that creates a depth map pyramid structure that includes a plurality of depth map levels that each have different resolution characteristics. In one embodiment, the depth map levels include a fine-scale depth map, a medium-scale depth map, and a coarse scale depth map. The depth estimator evaluates depth values from the fine-scale depth map by utilizing fine-scale confidence features, and evaluates depth values from the medium-scale depth map and the coarse-scale depth map by utilizing coarse-scale confidence features. The depth estimator then fuses optimal depth values from the different depth map levels into an optimal depth map.

摘要翻译： 用于产生鲁棒深度图的系统和方法包括：深度估计器，其创建深度图金字塔结构，其包括多个具有不同分辨率特征的深度图级别。 在一个实施例中，深度图层级包括精细尺度深度图，中等尺度深度图和粗尺度深度图。 深度估计器通过利用精细尺度置信特征来评估来自精细尺度深度图的深度值，并通过利用粗尺度置信特征来评估来自中尺度深度图和粗尺度深度图的深度值。 然后，深度估计器将来自不同深度图级的最佳深度值融合成最佳深度图。