公开(公告)号：US09179127B2

公开(公告)日：2015-11-03

申请号：US13810766

申请日：2012-05-09

申请人： Masao Hiramoto ,  Yasunori Ishii

发明人： Masao Hiramoto ,  Yasunori Ishii

IPC分类号： H04N13/02 ,  G03B35/08

CPC分类号： H04N13/207 ,  G03B35/08 ,  H04N13/214 ,  H04N13/257

摘要： This 3D image capture device includes: a light transmitting section 1 with first and second light transmitting areas 1L and 1R; an image sensor 2a with a plurality of unit blocks; an imaging section 3; and an image processing section which generates multi-viewpoint images based on photoelectrically converted signals supplied from the image sensor 2a. If functions representing the respective spectral transmittances of the first light transmitting area 1L, the second light transmitting area 1R, a first type of pixel, and a second type of pixel with respect to the wavelength λ of visible radiation are identified by TL(λ), TR(λ), T1(λ), and T2(λ), respectively, TL(λ)≠TR(λ) and T1(λ)≠T2(λ) are satisfied, and each of TL(λ), TR(λ), T1(λ) and T2(λ) has at least one local maximum value and at least one local minimum value within each of red, green and blue wavelength ranges.

摘要翻译： 该3D图像捕获装置包括：具有第一和第二透光区域1L和1R的光发射部分1; 具有多个单位块的图像传感器2a; 成像部3; 以及图像处理部，其基于从图像传感器2a供给的光电转换信号生成多视点图像。 如果通过TL（λ）识别表示第一透光区域1L，第二透光区域1R，第一类型像素和相对于可见光的波长λ的第二类型像素的各个光谱透射率的函数， ，分别为TR（λ），T1（λ）和T2（λ），TL（λ）≠TR（λ）和T1（λ）≠T2（λ） （λ），T1（λ）和T2（λ）在红色，绿色和蓝色波长范围内具有至少一个局部最大值和至少一个局部最小值。

公开(公告)号：US09154770B2

公开(公告)日：2015-10-06

申请号：US13810776

申请日：2012-05-09

申请人： Yasunori Ishii ,  Masao Hiramoto

发明人： Yasunori Ishii ,  Masao Hiramoto

IPC分类号： H04N13/02 ,  G03B35/08

CPC分类号： H04N13/225 ,  G03B35/08 ,  H04N13/214

摘要： A 3D image capture device includes: a light transmitting section 2 with m transmitting areas (where m is an integer and m≧2) that have different spectral transmittance characteristics; and an image sensor 1 which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which unit elements are arranged. Each unit element includes n photosensitive cells (where n is an integer and n≧m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells. The image capture device further includes an image processing section which modifies an n×m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×m matrix and which generates multi-viewpoint images using the modified n×m matrix.

摘要翻译： 3D图像捕获装置包括：具有m个透射区域（其中m是整数且m≥2）的光发射部分2，其具有不同的光谱透射率特性; 以及图像传感器1，其被配置为接收已经通过m个发送区域传输的并且布置有单元元件的光线。 每个单位元件包括n个感光单元（其中n是整数，n≥m）和n个具有相互不同的光谱透射特性的透射滤光片，它们被布置为面对n个感光单元。 图像捕获装置还包括图像处理部分，其通过改变m个发射区域和n个发射滤波器的相应光谱透射特性所限定的n×m矩阵， n×m矩阵，并且使用修改的n×m矩阵生成多视点图像。

公开(公告)号：US09100639B2

公开(公告)日：2015-08-04

申请号：US13882523

申请日：2012-09-04

申请人： Masao Hiramoto ,  Yasunori Ishii

发明人： Masao Hiramoto ,  Yasunori Ishii

IPC分类号： H04N13/02 ,  G02B27/00 ,  G02B3/00 ,  G06T7/00 ,  H04N5/225 ,  H04N9/04 ,  G03B35/10

CPC分类号： H04N13/20 ,  G02B3/00 ,  G02B27/0075 ,  G03B35/10 ,  G06T7/557 ,  G06T2207/10052 ,  H04N5/225 ,  H04N9/045 ,  H04N13/218 ,  H04N13/271

摘要： This image capture device includes: an image sensor 2 including first and second types of pixels that have mutually different spectral transmittance characteristics; a light-transmitting section 1 that is arranged to face the imaging area of the image sensor 2; and an imaging section 3 that includes at least a first imaging area having a first focal length and a second imaging area having a second focal length that is longer than the first focal length. The light-transmitting section 1 has a first light-transmitting area 1a comprised of multiple partial areas that are separated from each other and a second light-transmitting area 1b having a different spectral transmittance characteristic from the first light-transmitting area 1a. The distance from the light-transmitting section 1 to the imaging section 3 is equal to the first focal length f1 and the distance from the imaging area of the image sensor 2 to the imaging section 3 is equal to the second focal length f2.

摘要翻译： 该图像捕获装置包括：包括具有相互不同的光谱透射特性的第一和第二类像素的图像传感器2; 布置成面对图像传感器2的成像区域的光透射部分1; 以及成像部分3，其至少包括具有第一焦距的第一成像区域和具有比第一焦距长的第二焦距的第二成像区域。 透光部分1具有包括彼此分离的多个部分区域的第一透光区域1a和具有与第一透光区域1a不同的光谱透射特性的第二透光区域1b。 从透光部分1到成像部分3的距离等于第一焦距f1，并且从图像传感器2的成像区域到成像部分3的距离等于第二焦距f2。

公开(公告)号：US20130342661A1

公开(公告)日：2013-12-26

申请号：US14004465

申请日：2012-04-03

申请人： Yasunori Ishii ,  Masao Hiramoto

发明人： Yasunori Ishii ,  Masao Hiramoto

IPC分类号： H04N13/02

CPC分类号： H04N13/207 ,  G03B35/10 ,  G03B35/12 ,  H04N9/045 ,  H04N13/214 ,  H04N13/218 ,  H04N13/257

摘要： A 3D image capture device according to an aspect of the present invention includes: a light-transmitting section 2 including N different kinds of first filters C1, C2, C3 (where N is an integer that is equal to or greater than two) which are arranged so that light rays are incident on those filters in parallel with each other and of which the transmittances have mutually different wavelength dependences; an image sensor 1 that includes N second filters, of which the transmittances have mutually different wavelength dependences; and an image capturing driving section that drives the light-transmitting section 2 so that image capturing sessions are carried out M times sequentially (where M is an integer that is equal to or greater than N). The image capturing driving section drives the light-transmitting section 1 so that each of the first filters C1, C2, C3 changes its positions from one of N positions that have been set in advance with respect to the image sensor 1 after another every time the image capturing session is carried out.

摘要翻译： 根据本发明的一个方面的3D图像捕获装置包括：包括N种不同种类的第一滤波器C1，C2，C3（其中N是等于或大于2的整数）的光发射部分2 被布置为使得光线彼此平行地入射在那些滤光片上，并且透射率具有相互不同的波长依赖性; 图像传感器1，其包括N个第二滤波器，其中透射率具有相互不同的波长依赖性; 以及图像捕获驱动部分，其驱动光发射部分2，使得图像捕获会话顺序地执行M次（其中M​​是等于或大于N的整数）。 摄像驱动部驱动发光部1，使得第一滤光器C1，C2，C3中的每一个从每次相对于图像传感器1预先设置的N个位置之一改变， 执行图像捕获会话。

公开(公告)号：US08520950B2

公开(公告)日：2013-08-27

申请号：US13386500

申请日：2011-03-18

申请人： Yasunori Ishii ,  Masao Hiramoto

发明人： Yasunori Ishii ,  Masao Hiramoto

IPC分类号： G06K9/46

CPC分类号： G06K9/4671 ,  G06T7/337 ,  H04N2101/00

摘要： The image processing device includes: a storage unit (211) holding intensity gradient vectors Vr, position vectors Rr, and voting vectors Ur of a reference image; an intensity gradient vector calculation unit (212) which calculates intensity gradient vectors Vs of a search image; and a position determination unit (213) which determines a position of the reference image in the search image. The position determination unit (213) includes: a sampling unit (214) which thins out a part of the intensity gradient vectors Vs and/or the voting vectors Ur; an origin position estimation unit (215) which locates voting vectors Ur at each starting position of intensity gradient vectors Vs and estimates ending positions of the voting vectors Ur as candidate points; and a re-verification unit (216) which locates the position vectors Rr at each candidate point and determines a candidate point having most intensity gradient vectors Vs at ending positions of the position vectors Rr as an origin position.

摘要翻译： 图像处理装置包括：存储单元（211），其保持参考图像的强度梯度矢量Vr，位置矢量Rr和投票向量Ur; 强度梯度矢量计算单元，其计算搜索图像的强度梯度矢量Vs; 以及确定所述参考图像在所述搜索图像中的位置的位置确定单元（213）。 位置确定单元（213）包括：抽出部分强度梯度矢量Vs和/或投影向量Ur的采样单元（214） 原点位置估计单元，其在强度梯度矢量Vs的每个起始位置处定位投票向量Ur，并且将投票矢量Ur的结束位置估计为候选点; 以及在每个候选点处定位位置矢量Rr的重新验证单元（216），并且确定在位置矢量Rr的结束位置处具有最大强度梯度矢量Vs的候选点作为原始位置。

公开(公告)号：US20130188026A1

公开(公告)日：2013-07-25

申请号：US13813503

申请日：2012-09-12

申请人： Masao Hiramoto ,  Yasunori Ishii ,  Yusuke Monobe

发明人： Masao Hiramoto ,  Yasunori Ishii ,  Yusuke Monobe

IPC分类号： H04N13/02

CPC分类号： H04N13/236 ,  G01B11/24 ,  G03B35/10 ,  H04N13/218 ,  H04N13/271

摘要： A depth estimating image capture device as an embodiment of this invention includes: an image sensor 2 with photosensitive cells 10 arranged on its image capturing plane; an optical lens arranged to condense light on the plane; a light-transmitting member 1 arranged on the plane; and a signal processing section that processes signals supplied from the cells 10. The member 1 includes a first mirror 1a inside to reflect the light at least partially and a second mirror 1b with the same reflection property as the first mirror 1a on its upper surface. The first mirror 1a has a reflective surface tilted with respect to the upper surface of the member 1. The second mirror 1b has a reflective surface that is parallel to the upper surface. The first and second mirrors 1a and 1b are arranged so that a light beam coming from a point on a subject through the lens is reflected from the first mirror 1a and from the second mirror 1b and irradiates some area on the image capturing plane to make the irradiated area change according to the depth of the point on the subject.

摘要翻译： 作为本发明的实施例的深度估计图像捕获装置包括：具有布置在其图像捕获平面上的感光单元10的图像传感器2; 光学透镜，布置成在平面上冷凝光; 布置在平面上的透光构件1; 以及处理从单元10供给的信号的信号处理部。构件1包括内部以至少部分地反射光的第一反射镜1a和在其上表面具有与第一反射镜1a相同的反射特性的第二反射镜1b。 第一反射镜1a具有相对于构件1的上表面倾斜的反射表面。第二反射镜1b具有平行于上表面的反射表面。 第一和第二反射镜1a和1b被布置成使得来自通过透镜的被摄体上的点的光束从第一反射镜1a和第二反射镜1b反射并照射到图像捕获平面上的某个区域， 照射区域根据被摄体上的点的深度而变化。

公开(公告)号：US20120293634A1

公开(公告)日：2012-11-22

申请号：US13511029

申请日：2011-08-19

申请人： Yasunori Ishii ,  Masao Hiramoto

发明人： Yasunori Ishii ,  Masao Hiramoto

IPC分类号： H04N13/02

CPC分类号： G03B35/10 ,  G06T7/55 ,  G06T2207/20088 ,  H04N13/20 ,  H04N13/214 ,  H04N2013/0081

摘要： This 3D image capture device includes an image capturing section 100 and a signal processing section 200. The image capturing section 100 includes a light-transmitting section 2 with first, second and third transmitting areas that have mutually different transmission wavelength ranges, a solid-state image sensor 1 that is arranged to receive the light transmitted through the light-transmitting section, and an optical system 3 that produces an image on an imaging area of the solid-state image sensor. The signal processing section 200 includes an image generating section 7 that generates three image signals, representing the quantities of light rays that have been incident on the first, second and third transmitting areas, based on the output signal of the solid-state image sensor 1, and a parallax estimating section 40 that estimates parallax based on the three image signals.

摘要翻译： 该3D图像拍摄装置包括图像拍摄部100和信号处理部200.图像拍摄部100包括具有彼此不同的透射波长范围的第一，第二和第三透射区域的透光部分2，固态 被配置为接收透过透光部的光的图像传感器1以及在固体摄像元件的摄像区域上产生图像的光学系统3。 信号处理部分200包括：图像产生部分7，其根据固态图像传感器1的输出信号产生表示入射在第一，第二和第三传送区域上的光线的量的三个图像信号 以及基于三个图像信号来估计视差的视差估计部40。

公开(公告)号：US20120133743A1

公开(公告)日：2012-05-31

申请号：US13388313

申请日：2011-02-10

申请人： Masao Hiramoto ,  Teruyuki Takizawa ,  Masayuki Misaki ,  Yasunori Ishii

发明人： Masao Hiramoto ,  Teruyuki Takizawa ,  Masayuki Misaki ,  Yasunori Ishii

IPC分类号： H04N13/02

CPC分类号： H04N13/214 ,  H04N13/20 ,  H04N13/218 ,  H04N13/236 ,  H04N13/271

摘要： The 3D image capture device of this invention includes: a light-transmitting section 2 with light-transmitting areas C1, C2 and C3 that have mutually different transmission wavelength ranges; a solid-state image sensor 1 arranged to receive the light that has been transmitted through the light-transmitting section 2; and an optical system 3 configured to produce an image on an imaging area of the solid-state image sensor 1, which includes a photosensitive cell array and a color filter array on the imaging area. The transmission wavelength ranges of the light-transmitting areas and the color filters are defined such that the light that has been transmitted through at least one of the light-transmitting areas C1, C2 and C3 is transmissible through at least two of the color filters. A signal processing section generates data of at least two images with parallax by generating signals representing at least two of the respective intensities of light rays that are incident on the light-transmitting areas based on the output signals of the photosensitive cells.

摘要翻译： 本发明的3D图像捕获装置包括：具有透射区域C1，C2和C3的透光部分2，透光区域具有相互不同的透射波长范围; 固态图像传感器1，被配置为接收通过透光部2透射的光; 以及光学系统3，被配置为在固态图像传感器1的成像区域上产生图像，该图像在成像区域上包括感光单元阵列和滤色器阵列。 光透射区域和滤色器的透射波长范围被限定为使得已经透过至少一个透光区域C1，C2和C3的光通过至少两个滤色器传播。 信号处理部分基于感光单元的输出信号，通过产生表示入射到透光区域的相应的光线强度中的至少两个的信号来产生具有视差的至少两个图像的数据。

公开(公告)号：US08767114B2

公开(公告)日：2014-07-01

申请号：US13502408

申请日：2011-04-22

申请人： Masao Hiramoto ,  Masaaki Suzuki

发明人： Masao Hiramoto ,  Masaaki Suzuki

IPC分类号： H04N9/07

CPC分类号： H01L27/14621 ,  H01L27/14627 ,  H01L27/14629 ,  H04N9/045

摘要： The solid-state image sensor of the present invention includes an array of photosensitive cells, an array 100 of dispersing elements, and an array 300 of color filters. The photosensitive cell array 200 has a number of unit blocks 40, each of which includes photosensitive cells 2a and 2b. The dispersing element array 100 includes a dispersing element 1a, which makes all of incoming light (W) but a light ray falling within a first wavelength range incident on the first photosensitive cell 2a and which also makes at least a part of the light ray falling within the first wavelength range incident on the second photosensitive cell 2b. A color filter 3a that either absorbs or reflects the light ray falling within the first wavelength range is arranged between the photosensitive cell 2a and the dispersing element 1a.

摘要翻译： 本发明的固态图像传感器包括感光单元阵列，分散元件阵列100和滤色器阵列300。 感光单元阵列200具有多个单位块40，每个单元块40包括感光单元2a和2b。 分散元件阵列100包括分散元件1a，其使入射光（W）全部入射到第一感光单元2a上的第一波长范围内的光线，并且还使至少一部分光线落下 在入射到第二感光单元2b上的第一波长范围内。 吸收或反射落在第一波长范围内的光线的滤色器3a布置在感光单元2a和分散元件1a之间。

公开(公告)号：US20120182453A1

公开(公告)日：2012-07-19

申请号：US13498598

申请日：2011-04-22

申请人： Masao Hiramoto ,  Yusuke Monobe ,  Yoshiaki Sugitani ,  Masaaki Suzuki

发明人： Masao Hiramoto ,  Yusuke Monobe ,  Yoshiaki Sugitani ,  Masaaki Suzuki

IPC分类号： H04N9/07 ,  H04N9/04 ,  H04N3/14 ,  H01L27/146

CPC分类号： H01L27/14625 ,  H01L27/14621 ,  H01L27/14645 ,  H04N9/045 ,  H04N2209/047

摘要： The solid-state image sensor 10 includes an array of photosensitive cells and an array 100 of dispersing elements. The photosensitive cell array is comprised of unit blocks 40, each including four photosensitive cells 2a, 2b, 2c and 2d. The dispersing element array 100 makes light, obtained by subtracting a light ray with a first color component C1 from the incoming light W and adding a light ray with a second color component C2 to the remainder, incident on the first photosensitive cell 2a, also makes light, obtained by subtracting the light ray with the second color component C1 from the incoming light W and adding the light ray with the first color component C1 to the remainder, incident on the second photosensitive cell 2b, further makes light, obtained by subtracting the light rays with the first and second color components C1+C2 from the incoming light W, incident on the third photosensitive cell 2c, and further makes light, obtained by adding the light rays with the first and second color components C1+C2 to the incoming light W, incident on the fourth photosensitive cell 2d.

摘要翻译： 固态图像传感器10包括感光单元阵列和分散元件阵列100。 感光单元阵列由单元块40组成，每个单元块40包括四个感光单元2a，2b，2c和2d。 分散元件阵列100通过从入射光W减去具有第一颜色成分C1的光线并将入射到第一感光单元2a上的剩余部分中的第二颜色分量C2的光线加入而获得的光也使得 通过从入射光W减去具有第二颜色分量C1的光线并将入射到第二感光单元2b上的第一颜色分量C1的光线添加到余数而获得的光进一步使得通过减去 来自入射光W的第一和第二颜色分量C1 + C2的光线入射到第三感光单元2c上，并且进一步使通过将第一和第二颜色分量C1 + C2的光线与入射 入射到第四感光单元2d上的光W。