公开(公告)号：US09456198B2

公开(公告)日：2016-09-27

申请号：US13813503

申请日：2012-09-12

申请人： Masao Hiramoto ,  Yasunori Ishii ,  Yusuke Monobe

发明人： Masao Hiramoto ,  Yasunori Ishii ,  Yusuke Monobe

IPC分类号： H04N13/02 ,  G01B11/24 ,  G03B35/10

CPC分类号： H04N13/236 ,  G01B11/24 ,  G03B35/10 ,  H04N13/218 ,  H04N13/271

摘要： A depth estimating image capture device includes: an image sensor; an optical lens; a light-transmitting member arranged on the plane; and a signal processing section. The member includes a first mirror inside to reflect the light at least partially and a second mirror with the same reflection property as the first mirror on its upper surface. The first mirror has a reflective surface tilted with respect to the upper surface of the member. The second mirror has a reflective surface that is parallel to the upper surface. The first and second mirrors and are arranged so that a light beam coming from a point on a subject through the lens is reflected from the first mirror and from the second mirror and irradiates some area on an image capturing plane to make the irradiated area change according to the depth of the point on the subject.

摘要翻译： 深度估计图像捕获装置包括：图像传感器; 光学透镜; 布置在所述平面上的透光构件; 和信号处理部。 该构件包括至少部分地反射光的第一反射镜和在其上表面上具有与第一反射镜相同的反射特性的第二反射镜。 第一反射镜具有相对于构件的上表面倾斜的反射表面。 第二反射镜具有平行于上表面的反射表面。 第一和第二反射镜被布置成使得来自通过透镜的被摄体上的点的光束从第一反射镜和第二反射镜反射并且照射到图像捕获平面上的某个区域以使照射区域根据 到主题的深度。

公开(公告)号：US09086620B2

公开(公告)日：2015-07-21

申请号：US13498331

申请日：2011-04-22

申请人： Masao Hiramoto ,  Yasunori Ishii

发明人： Masao Hiramoto ,  Yasunori Ishii

IPC分类号： G03B35/08 ,  H04N5/225 ,  H04N9/07 ,  H04N13/02

CPC分类号： G03B35/08 ,  H04N5/2254 ,  H04N9/07 ,  H04N13/214

摘要： A 3D image capture device includes: a light-transmitting section 2 with N fan-shaped light-transmitting areas (where N is an integer and N≧3) with different transmission wavelength ranges; a solid-state image sensor 1 that receives the light transmitted through the light-transmitting section 2; an optical system 2 that produces an image on an imaging area of the sensor 1; and a signal processing section 200 that processes the output signal of the sensor 1. The sensor 1 includes a photosensitive cell array and a color filter array that are made up of unit elements, each of which includes N photosensitive cells and N color filters. The transmission wavelength ranges of the light-transmitting areas and the color filters are defined so that the light transmitted through at least one of the N light-transmitting areas is transmissible through at least two of the N color filters. The signal processing section generates signals representing at least two of the respective intensities of light rays incident on the light-transmitting areas based on the output signals of the photosensitive cells, thereby generating data representing at least two images with parallax.

摘要翻译： 3D图像捕获装置包括：具有不同透射波长范围的N个扇形透光区域（N为整数且N≥3）的透光部分2; 接收透过透光部2的光的固体摄像元件1; 在传感器1的成像区域上产生图像的光学系统2; 以及处理传感器1的输出信号的信号处理部200.传感器1包括由单元构成的感光单元阵列和滤色器阵列，每个单元包括N个感光单元和N个滤色器。 限定透光区域和滤色器的透射波长范围，使得透过N个透光区域中的至少一个透射的光通过N个滤色器中的至少两个透射。 信号处理部分基于感光单元的输出信号产生表示入射在透光区域上的相应光强度中的至少两个的信号，由此产生表示具有视差的至少两个图像的数据。

公开(公告)号：US08902293B2

公开(公告)日：2014-12-02

申请号：US13634638

申请日：2011-10-19

申请人： Yasunori Ishii ,  Masao Hiramoto

发明人： Yasunori Ishii ,  Masao Hiramoto

IPC分类号： H04N13/02 ,  G03B35/12 ,  G03B35/08

CPC分类号： G03B35/12 ,  G03B35/08 ,  H04N13/214 ,  H04N13/218

摘要： This 3D image capture device includes a light-transmitting section 2 with m transmitting areas (where m is an integer and m≧2) and a solid-state image sensor 1. The sensor 1 has unit elements, each of which includes n photosensitive cells (where n is an integer and n≧m) and n transmitting filters that face those photosensitive cells. If the wavelength is identified by λ, the transmittances of transmitting areas C1 and C2 are identified by Tc1(λ) and Tc2(λ), the transmittances of two transmitting filters are identified by Td1(λ) and Td2(λ), and the interval of integration is the entire visible radiation wavelength range, ∫Tc1(λ)Td1(λ)dλ>0, ∫Tc1(λ)Td2(λ)dλ>0, ∫Tc2(λ)Td1(λ)dλ>0, ∫Tc2(λ)Td2(λ)dλ>0, and ∫Tc1(λ)Td1(λ)dλ∫Tc2(λ)Td2(λ)dλ≠∫Tc2(λ)Td1(λ)dλ∫Tc1(λ)Td2(λ)dλ are satisfied.

摘要翻译： 该3D图像捕获装置包括具有m个透射区域（其中m为整数且m≥2）的透光部分2和固态图像传感器1.传感器1具有单元，每个单元包括n个感光单元 （其中n是整数，n≥m）和n个发射滤波器，其面对这些感光单元。 如果波长由λ表示，发射区C1和C2的透射率由Tc1（λ）和Tc2（λ）表示，两个发射滤波器的透射率由Td1（λ）和Td2（λ）标识， 积分间隔为整个可见光辐射波长范围，∫Tc1（λ）Td1（λ）dλ> 0，∫Tc1（λ）Td2（λ）dλ> 0，∫Tc2（λ）Td1（λ）dλ> ∫Tc2（λ）Td2（λ）dλ> 0和∫Tc1（λ）Td1（λ）dλ∫Tc2（λ）Td2（λ）dλ≠∫Tc2（λ）Td1（λ）dλ∫Tc1（λ） Td2（λ）dλ被满足。

公开(公告)号：US20130215231A1

公开(公告)日：2013-08-22

申请号：US13882523

申请日：2012-09-04

申请人： Masao Hiramoto ,  Yasunori Ishii

发明人： Masao Hiramoto ,  Yasunori Ishii

IPC分类号： H04N13/02

CPC分类号： H04N13/20 ,  G02B3/00 ,  G02B27/0075 ,  G03B35/10 ,  G06T7/557 ,  G06T2207/10052 ,  H04N5/225 ,  H04N9/045 ,  H04N13/218 ,  H04N13/271

摘要： This image capture device includes: an image sensor 2 including first and second types of pixels that have mutually different spectral transmittance characteristics; a light-transmitting section 1 that is arranged to face the imaging area of the image sensor 2; and an imaging section 3 that includes at least a first imaging area having a first focal length and a second imaging area having a second focal length that is longer than the first focal length. The light-transmitting section 1 has a first light-transmitting area 1a comprised of multiple partial areas that are separated from each other and a second light-transmitting area 1b having a different spectral transmittance characteristic from the first light-transmitting area 1a. The distance from the light-transmitting section 1 to the imaging section 3 is equal to the first focal length f1 and the distance from the imaging area of the image sensor 2 to the imaging section 3 is equal to the second focal length f2.

摘要翻译： 该图像捕获装置包括：包括具有相互不同的光谱透射特性的第一和第二类像素的图像传感器2; 布置成面对图像传感器2的成像区域的光透射部分1; 以及成像部分3，其至少包括具有第一焦距的第一成像区域和具有比第一焦距长的第二焦距的第二成像区域。 透光部分1具有包括彼此分离的多个部分区域的第一透光区域1a和具有与第一透光区域1a不同的光谱透射特性的第二透光区域1b。 从透光部分1到成像部分3的距离等于第一焦距f1，并且从图像传感器2的成像区域到成像部分3的距离等于第二焦距f2。

公开(公告)号：US20130120541A1

公开(公告)日：2013-05-16

申请号：US13810766

申请日：2012-05-09

申请人： Masao Hiramoto ,  Yasunori Ishii

发明人： Masao Hiramoto ,  Yasunori Ishii

IPC分类号： H04N13/02

CPC分类号： H04N13/207 ,  G03B35/08 ,  H04N13/214 ,  H04N13/257

摘要： This 3D image capture device includes: a light transmitting section 1 with first and second light transmitting areas 1L and 1R; an image sensor 2a with a plurality of unit blocks; an imaging section 3; and an image processing section which generates multi-viewpoint images based on photoelectrically converted signals supplied from the image sensor 2a. If functions representing the respective spectral transmittances of the first light transmitting area 1L, the second light transmitting area 1R, a first type of pixel, and a second type of pixel with respect to the wavelength λ of visible radiation are identified by TL(λ), TR(λ), T1(λ), and T2(λ), respectively, TL(λ)≠TR(λ) and T1(λ)≠T2(λ) are satisfied, and each of TL(λ), TR(λ), T1(λ) and T2(λ) has at least one local maximum value and at least one local minimum value within each of red, green and blue wavelength ranges.

摘要翻译： 该3D图像捕获装置包括：具有第一和第二透光区域1L和1R的光发射部分1; 具有多个单位块的图像传感器2a; 成像部3; 以及图像处理部，其基于从图像传感器2a供给的光电转换信号生成多视点图像。 如果通过TL（λ）识别表示第一透光区域1L，第二透光区域1R，第一类型像素和相对于可见光辐射波长λ的第二类型像素的各个光谱透射率的函数， ，分别为TR（λ），T1（λ）和T2（λ），TL（λ）<> TR（λ）和T1（λ）<> T2（λ） TR（λ），T1（λ）和T2（λ）在红色，绿色和蓝色波长范围内具有至少一个局部最大值和至少一个局部最小值。

公开(公告)号：US20130120540A1

公开(公告)日：2013-05-16

申请号：US13810776

申请日：2012-05-09

申请人： Yasunori Ishii ,  Masao Hiramoto

发明人： Yasunori Ishii ,  Masao Hiramoto

IPC分类号： H04N13/02

CPC分类号： H04N13/225 ,  G03B35/08 ,  H04N13/214

摘要： A 3D image capture device includes: a light transmitting section 2 with m transmitting areas (where m is an integer and m≧2) that have different spectral transmittance characteristics; and an image sensor 1 which is arranged to receive light rays that have been transmitted through the m transmitting areas and in which unit elements are arranged. Each unit element includes n photosensitive cells (where n is an integer and n≧m) and n transmitting filters with mutually different spectral transmittance characteristics which are arranged so as to face the n photosensitive cells. The image capture device further includes an image processing section which modifies an n×m matrix that is defined by the respective spectral transmittance characteristics of the m transmitting areas and the n transmitting filters by changing the angle between at least two out of m column vectors of the n×m matrix and which generates multi-viewpoint images using the modified n×m matrix.

摘要翻译： 3D图像捕获装置包括：具有m个透射区域（其中m是整数且m> = 2）的光发射部分2，其具有不同的光谱透射率特性; 以及图像传感器1，其被配置为接收已经通过m个发送区域传输的并且布置有单元元件的光线。 每个单位元件包括n个光敏单元（其中n是整数，n> = m），n个透射滤光器具有相互不同的光谱透射率特性，其布置成面对n个光敏单元。 图像捕获装置还包括图像处理部分，其通过改变m个发射区域和n个发射滤波器的相应光谱透射特性所限定的n×m矩阵， n×m矩阵，并且使用修改的n×m矩阵生成多视点图像。

公开(公告)号：US09628776B2

公开(公告)日：2017-04-18

申请号：US14004465

申请日：2012-04-03

申请人： Yasunori Ishii ,  Masao Hiramoto

发明人： Yasunori Ishii ,  Masao Hiramoto

IPC分类号： H04N13/00 ,  H04N9/04 ,  H04N9/083 ,  H04N13/02 ,  G03B35/12 ,  G03B35/10

CPC分类号： H04N13/207 ,  G03B35/10 ,  G03B35/12 ,  H04N9/045 ,  H04N13/214 ,  H04N13/218 ,  H04N13/257

摘要： A 3D image capture device according to an aspect of the present invention includes: a light-transmitting section including N different kinds of first filters (where N is an integer equal to or greater than two) which are arranged so that light rays are incident on those filters in parallel with each other and that the transmittances have mutually different wavelength dependences; an image sensor including N second filters, of which the transmittances have mutually different wavelength dependences; and an image capturing driving section driving the light-transmitting section so that image capturing sessions are carried out M times sequentially (where M is an integer equal to or greater than N), and that each of the first filters changes its positions from one of N positions that have been set in advance with respect to the image sensor after each time the image capturing session is carried out.

公开(公告)号：US09161017B2

公开(公告)日：2015-10-13

申请号：US13812909

申请日：2012-07-04

申请人： Masao Hiramoto ,  Yasunori Ishii

发明人： Masao Hiramoto ,  Yasunori Ishii

IPC分类号： H04N13/00 ,  H04N9/04 ,  H04N9/083 ,  H04N13/02 ,  G03B35/04 ,  G03B35/10 ,  G03B35/12

CPC分类号： H04N13/25 ,  G03B35/04 ,  G03B35/10 ,  G03B35/12 ,  H04N13/207 ,  H04N13/214 ,  H04N13/257

摘要： This 3D image capture device includes: a light-transmitting section 1 including first and second light-transmitting areas 1L and 1R; an image sensor 2a arranged to receive the light transmitted through the light-transmitting section 1; an imaging section 3 that produces an image on an imaging area of the image sensor 2a; and an image capturing driving section that drives the image sensor so as to perform image capturing sessions at least twice in a row and drives the light-transmitting section so that the first and second light-transmitting areas change their positions every image capturing session. The first light-transmitting area 1L transmits light falling within a first wavelength range included in a color red wavelength range and light falling within a second wavelength range included in a color green wavelength range. The second light-transmitting area 1R transmits light falling within a third wavelength range, included in the color green wavelength range and shorter than the second wavelength range, and light falling within a fourth wavelength range included in a color blue wavelength range.

摘要翻译： 该3D图像捕获装置包括：包含第一和第二透光区域1L和1R的透光部分1; 布置成接收透过光透射部分1的光的图像传感器2a; 成像部分3，其在图像传感器2a的成像区域上产生图像; 以及图像拍摄驱动部，其驱动所述图像传感器，以便至少执行两次连续的图像拍摄会话，并且驱动所述光发射部分，使得所述第一和第二光透射区域在每个图像拍摄会话期间改变其位置。 第一透光区域1L透射在包括在红色的红色波长范围内的第一波长范围内的光以及落在彩色绿色波长范围内的第二波长范围内的光。 第二透光区域1R发射包括在彩色绿色波长范围内且短于第二波长范围的第三波长范围内的光，以及落在包括在蓝色蓝色波长范围内的第四波长范围内的光。

公开(公告)号：US08902291B2

公开(公告)日：2014-12-02

申请号：US13388313

申请日：2011-02-10

申请人： Masao Hiramoto ,  Teruyuki Takizawa ,  Masayuki Misaki ,  Yasunori Ishii

发明人： Masao Hiramoto ,  Teruyuki Takizawa ,  Masayuki Misaki ,  Yasunori Ishii

IPC分类号： H04N13/02

CPC分类号： H04N13/214 ,  H04N13/20 ,  H04N13/218 ,  H04N13/236 ,  H04N13/271

摘要： The 3D image capture device of this invention includes: a light-transmitting section 2 with light-transmitting areas C1, C2 and C3 that have mutually different transmission wavelength ranges; a solid-state image sensor 1 arranged to receive the light that has been transmitted through the light-transmitting section 2; and an optical system 3 configured to produce an image on an imaging area of the solid-state image sensor 1, which includes a photosensitive cell array and a color filter array on the imaging area. The transmission wavelength ranges of the light-transmitting areas and the color filters are defined such that the light that has been transmitted through at least one of the light-transmitting areas C1, C2 and C3 is transmissible through at least two of the color filters. A signal processing section generates data of at least two images with parallax by generating signals representing at least two of the respective intensities of light rays that are incident on the light-transmitting areas based on the output signals of the photosensitive cells.

摘要翻译： 本发明的3D图像捕获装置包括：具有透射区域C1，C2和C3的透光部分2，透光区域具有相互不同的透射波长范围; 固态图像传感器1，被配置为接收通过透光部2透射的光; 以及光学系统3，被配置为在固态图像传感器1的成像区域上产生图像，该图像在成像区域上包括感光单元阵列和滤色器阵列。 光透射区域和滤色器的透射波长范围被限定为使得已经透过至少一个透光区域C1，C2和C3的光通过至少两个滤色器传播。 信号处理部分基于感光单元的输出信号，通过产生表示入射到透光区域的相应的光线强度中的至少两个的信号来产生具有视差的至少两个图像的数据。

公开(公告)号：US20120121189A1

公开(公告)日：2012-05-17

申请号：US13386500

申请日：2011-03-18

申请人： Yasunori Ishii ,  Masao Hiramoto

发明人： Yasunori Ishii ,  Masao Hiramoto

IPC分类号： G06K9/46

CPC分类号： G06K9/4671 ,  G06T7/337 ,  H04N2101/00

摘要： The image processing device includes: a storage unit (211) holding intensity gradient vectors Vr, position vectors Rr, and voting vectors Ur of a reference image; an intensity gradient vector calculation unit (212) which calculates intensity gradient vectors Vs of a search image; and a position determination unit (213) which determines a position of the reference image in the search image. The position determination unit (213) includes: a sampling unit (214) which thins out a part of the intensity gradient vectors Vs and/or the voting vectors Ur; an origin position estimation unit (215) which locates voting vectors Ur at each starting position of intensity gradient vectors Vs and estimates ending positions of the voting vectors Ur as candidate points; and a re-verification unit (216) which locates the position vectors Rr at each candidate point and determines a candidate point having most intensity gradient vectors Vs at ending positions of the position vectors Rr as an origin position.

摘要翻译： 图像处理装置包括：存储单元（211），其保持参考图像的强度梯度矢量Vr，位置矢量Rr和投票向量Ur; 强度梯度矢量计算单元，其计算搜索图像的强度梯度矢量Vs; 以及确定所述参考图像在所述搜索图像中的位置的位置确定单元（213）。 位置确定单元（213）包括：抽出部分强度梯度矢量Vs和/或投影向量Ur的采样单元（214） 原点位置估计单元，其在强度梯度矢量Vs的每个起始位置处定位投票向量Ur，并且将投票矢量Ur的结束位置估计为候选点; 以及在每个候选点处定位位置矢量Rr的重新验证单元（216），并且确定在位置矢量Rr的结束位置处具有最大强度梯度矢量Vs的候选点作为原始位置。