-
公开(公告)号:US11847762B2
公开(公告)日:2023-12-19
申请号:US17048762
申请日:2019-01-31
Applicant: SONY CORPORATION
Inventor: Teppei Kurita , Shun Kaizu , Yasutaka Hirasawa , Yuhi Kondo
Abstract: A polarization imaging unit generates, as polarization information, a polarization image including pixels in a plurality of polarization directions. An interpolation processing unit of an information processor performs interpolation processing using the polarization image obtained from the polarization imaging unit, and generates a polarization image for each polarization method. A polarization degree calculation unit calculates, for example, a polarization degree for each pixel as object surface information on the basis of the polarization image for each polarization method. A noise amount calculation unit calculates a noise amount for each pixel on the basis of the polarization image for each polarization method and the like. A polarization degree correction unit serves as an information correction unit, and corrects, according to the noise amount calculated by the noise amount calculation unit, the polarization degree that is object surface information calculated by the polarization degree calculation unit.
-
2.
公开(公告)号:US20190124281A1
公开(公告)日:2019-04-25
申请号:US16226567
申请日:2018-12-19
Applicant: Sony Corporation
Inventor: Tomoo Mitsunaga , Shun Kaizu , Teppei Kurita , Toru Nishi
IPC: H04N5/355 , H04N5/235 , H04N5/3745 , H04N9/04 , H04N5/378
Abstract: [Object] The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times.[Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities. Further, a first line in which first pixels having the panchromatic spectral sensitivity are arranged in a two-pixel cycle in a specific direction and a second line in which the first pixels are arranged while deviating by one pixel from the first line in the specific direction are arranged alternately in a direction orthogonal to the specific direction, and pixels having spectral sensitivities different from the spectral sensitivity of the first pixels are arranged in a 2- or 4-pixel cycle in the specific direction for each of the spectral sensitivities and 2-dimensionally constitute a cyclic arrangement of 4×4 pixels in which the first spectral sensitivity pixels are arranged in a checkerboard arrangement.
-
公开(公告)号:US11663831B2
公开(公告)日:2023-05-30
申请号:US16770908
申请日:2018-10-12
Applicant: SONY CORPORATION
Inventor: Hajime Mihara , Shun Kaizu , Teppei Kurita , Yuhi Kondo , Yasutaka Hirasawa
IPC: G06K9/46 , G06V10/60 , G06V10/56 , G06V10/145 , G06V10/147 , G06V10/10 , G06V10/30
CPC classification number: G06V10/60 , G06V10/10 , G06V10/145 , G06V10/147 , G06V10/30 , G06V10/56
Abstract: A polarized image acquisition section 11a acquires a polarized image of a target object having one or more polarization directions. A polarization parameter acquisition section 12-1 calculates the average brightness α of a polarization model on the basis of a non-polarized image subjected to sensitivity correction. Further, the polarization parameter acquisition section 12-1 calculates the amplitude β of the polarization model on the basis of the calculated average brightness α, pre-stored information regarding the zenith angle θ of the normal line of the target object, a refractive index r, and reflectance property information indicative of whether a subject is diffuse reflection or specular reflection. A polarization model detection section 13-1 is able to detect the polarization properties of the target object through the use of an image polarized in one or more polarization directions, by calculating the phase ϕ of the polarization model on the basis of a polarized image of the target object having one or more polarization directions, the average brightness α, and the amplitude β of the polarization model.
-
公开(公告)号:US11108951B2
公开(公告)日:2021-08-31
申请号:US16619170
申请日:2018-04-09
Applicant: SONY CORPORATION
Inventor: Teppei Kurita , Shun Kaizu , Yasutaka Hirasawa
Abstract: In an image capturing unit 20, an imaging element has a 4×4-pixel area in which: pixels including at least one pixel of every color component of a plurality of color components are polarization pixels of the same polarization direction; and pixels which are not the polarization pixels constitute a majority of the 4×4-pixel area, and are non-polarization pixels. The unpolarized component calculating unit 31 of the image processing unit 30 calculates unpolarized components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit 20. The diffuse reflection component calculating unit 32 calculates diffuse reflection components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit 20.
-
公开(公告)号:US10460422B2
公开(公告)日:2019-10-29
申请号:US15765086
申请日:2016-09-09
Applicant: SONY CORPORATION
Inventor: Teppei Kurita , Shun Kaizu , Yuhi Kondo , Yasutaka Hirasawa , Ying Lu
IPC: G06T3/40 , H04N9/04 , B60R11/02 , H04N5/232 , G06T7/90 , H04N5/30 , H04N9/083 , H04N9/31 , G01J4/02 , G01J4/00
Abstract: The polarization imaging unit generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated based on the low frequency component and the component information for each polarization component.
-
6.
公开(公告)号:US10200639B2
公开(公告)日:2019-02-05
申请号:US15885701
申请日:2018-01-31
Applicant: Sony Corporation
Inventor: Tomoo Mitsunaga , Shun Kaizu , Teppei Kurita , Toru Nishi
Abstract: [Object] The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times.[Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities. Further, a first line in which first pixels having the panchromatic spectral sensitivity are arranged in a two-pixel cycle in a specific direction and a second line in which the first pixels are arranged while deviating by one pixel from the first line in the specific direction are arranged alternately in a direction orthogonal to the specific direction, and pixels having spectral sensitivities different from the spectral sensitivity of the first pixels are arranged in a 2- or 4-pixel cycle in the specific direction for each of the spectral sensitivities and 2-dimensionally constitute a cyclic arrangement of 4×4 pixels in which the first spectral sensitivity pixels are arranged in a checkerboard arrangement.
-
公开(公告)号:US09699429B2
公开(公告)日:2017-07-04
申请号:US14384835
申请日:2012-12-26
Applicant: Sony Corporation
Inventor: Shun Kaizu
IPC: H04N9/083 , H04N3/14 , H04N5/335 , H04N9/04 , H04N9/73 , H04N9/07 , G06T3/40 , H04N5/359 , H04N5/235 , H04N5/355
CPC classification number: H04N9/735 , G06T3/4015 , G06T2207/20208 , H04N5/2355 , H04N5/35581 , H04N5/3597 , H04N9/045 , H04N9/07 , H04N2209/045
Abstract: There are provided an apparatus and a method which generate an RGB image having less color noise and fewer false colors by inputting an RGBW image. The apparatus has an image sensor having an RGBW array, and an image processing unit which performs image processing by inputting a sensor image formed of an RGBW pixel signal output from the image sensor. The image sensor has a periodic array of a unit composition formed of each RGBW pixel, and has an array in which composition ratios of each RGB pixel within the unit composition are adapted to be the same as each other. The image processing unit converts a pixel array of the sensor image formed of the RGBW pixel signal, and performs at least either array conversion processing for generating an RGB array image or signal processing for generating each RGB image signal in which all RGB pixel values are set for each pixel position of the sensor image.
-
公开(公告)号:US09596454B2
公开(公告)日:2017-03-14
申请号:US14281117
申请日:2014-05-19
Applicant: Sony Corporation
Inventor: Akihisa Yamazaki , Tomoo Mitsunaga , Shun Kaizu , Shin Yoshimura
IPC: H04N13/02
CPC classification number: H04N13/257 , H04N13/239 , H04N13/25 , H04N2213/001
Abstract: An imaging apparatus includes: a first imaging device including a first filter, and configured to output a first image signal, and the first filter preventing light in a predetermined wavelength band of wavelengths longer than visible light; a second imaging device arranged at a different position and configured to perform photoelectric conversion on subject light containing a wavelength component of the light in the predetermined wavelength band to output a second image signal; a correlation detection unit configured to detect a correlation between the first and second image signals; a luminance signal generation unit configured to generate a luminance signal; a color signal generation unit configured to generate a color signal; and a three-dimensional image generation unit configured to generate a three-dimensional image by the correlation, the luminance signal, and the color signal.
Abstract translation: 一种成像装置包括:第一成像装置,包括第一滤光器,并且被配置为输出第一图像信号;以及第一滤光器,其防止在比可见光长的波长的预定波长带中的光; 第二成像装置,其布置在不同的位置,并被配置为对包含预定波长带中的光的波长分量的对象光进行光电转换,以输出第二图像信号; 相关检测单元,被配置为检测第一和第二图像信号之间的相关性; 亮度信号生成部,生成亮度信号; 配置为生成颜色信号的颜色信号生成单元; 以及三维图像生成单元,被配置为通过相关性,亮度信号和颜色信号生成三维图像。
-
9.
公开(公告)号:US20170034460A9
公开(公告)日:2017-02-02
申请号:US14905794
申请日:2014-07-11
Applicant: SONY CORPORATION
Inventor: Tomoo Mitsunaga , Shun Kaizu , Teppei Kurita , Toru Nishi Kaizu
CPC classification number: H04N5/35563 , H04N5/2353 , H04N5/2355 , H04N5/35518 , H04N5/35554 , H04N5/37457 , H04N5/378 , H04N9/045
Abstract: The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times.[Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities. Further, a first line in which first pixels having the panchromatic spectral sensitivity are arranged in a two-pixel cycle in a specific direction and a second line in which the first pixels are arranged while deviating by one pixel from the first line in the specific direction are arranged alternately in a direction orthogonal to the specific direction, and pixels having spectral sensitivities different from the spectral sensitivity of the first pixels are arranged in a 2- or 4-pixel cycle in the specific direction for each of the spectral sensitivities and 2-dimensionally constitute a cyclic arrangement of 4x4 pixels in which the first spectral sensitivity pixels are arranged in a checkerboard arrangement.
Abstract translation: 本技术可应用于包括具有4种类型的光谱灵敏度的像素的图像拾取装置,其包括具有全色光谱灵敏度并且被布置在图像拾取表面上的像素,实现第一曝光的像素和实现第一曝光的像素 相对于4种光谱灵敏度,与第一曝光不同的第二曝光被布置在图像拾取表面上。 此外,其中具有全色光谱灵敏度的第一像素在特定方向上以二像素周期排列的第一行和其中第一像素排列在与特定方向上的第一行偏移一个像素的第二行 在与特定方向正交的方向上交替布置,并且具有与第一像素的光谱灵敏度不同的光谱灵敏度的像素针对每个光谱灵敏度以特定方向排列成2或4像素, 尺寸构成4×4像素的循环布置,其中第一光谱灵敏度像素布置在棋盘布置中。
-
10.
公开(公告)号:US20160173793A1
公开(公告)日:2016-06-16
申请号:US14905794
申请日:2014-07-11
Applicant: SONY CORPORATION
Inventor: Tomoo Mitsunaga , Shun Kaizu , Teppei Kurita , Toru Nishi Kaizu
CPC classification number: H04N5/35563 , H04N5/2353 , H04N5/2355 , H04N5/35518 , H04N5/35554 , H04N5/37457 , H04N5/378 , H04N9/045
Abstract: The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times.[Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities. Further, a first line in which first pixels having the panchromatic spectral sensitivity are arranged in a two-pixel cycle in a specific direction and a second line in which the first pixels are arranged while deviating by one pixel from the first line in the specific direction are arranged alternately in a direction orthogonal to the specific direction, and pixels having spectral sensitivities different from the spectral sensitivity of the first pixels are arranged in a 2- or 4-pixel cycle in the specific direction for each of the spectral sensitivities and 2-dimensionally constitute a cyclic arrangement of 4x4 pixels in which the first spectral sensitivity pixels are arranged in a checkerboard arrangement.
Abstract translation: 本技术涉及能够在改变曝光时间的同时控制具有4种光谱灵敏度的像素的图像拾取装置,图像拾取方法和程序。 本技术可应用于包括具有4种类型的光谱灵敏度的像素的图像拾取装置,其包括具有全色光谱灵敏度并且被布置在图像拾取表面上的像素,实现第一曝光的像素和实现第一曝光的像素 相对于4种光谱灵敏度,与第一曝光不同的第二曝光被布置在图像拾取表面上。 此外,其中具有全色光谱灵敏度的第一像素在特定方向上以二像素周期排列的第一行和其中第一像素排列在与特定方向上的第一行偏移一个像素的第二行 在与特定方向正交的方向上交替布置,并且具有与第一像素的光谱灵敏度不同的光谱灵敏度的像素针对每个光谱灵敏度以特定方向排列成2或4像素, 尺寸构成4×4像素的循环布置,其中第一光谱灵敏度像素布置在棋盘布置中。
-
-
-
-
-
-
-
-
-