-
公开(公告)号:US20210243437A1
公开(公告)日:2021-08-05
申请号:US17273891
申请日:2019-06-06
Applicant: SONY CORPORATION
Inventor: Yuhi KONDO , Yasutaka HIRASAWA , Takefumi NAGUMO , Toshinori IHARA , Teppei KURITA , Legong SUN
IPC: H04N19/105 , H04N19/182 , H04N19/136 , H04N19/186 , H04N19/423
Abstract: A polarization imaging unit 20 acquires a polarized image including polarization pixels with a plurality of polarization directions. An information compression unit 40 sets reference image information based on polarized image information of reference polarization pixels with at least a plurality of polarization directions in the polarized image and generates difference information between the polarized image information of each of polarization pixels different from the reference polarization pixels in the polarized image and the reference image information. In addition, the information compression unit 40 reduces the amount of information of the difference information generated for each of the polarization pixels with the plurality of polarization directions to generate compressed image information including the reference image information and the difference information with the reduced amount of information. An information decoding unit 70 applies a decoding process corresponding to the compression process of the information compression unit 40 to the compressed image information acquired through a recording medium 50 or a transmission path 60 to generate the polarized image and outputs the polarized image to a polarized image using unit 80.
-
公开(公告)号:US20210211619A1
公开(公告)日:2021-07-08
申请号:US17059353
申请日:2019-03-13
Applicant: SONY CORPORATION
Inventor: Hajime MIHARA , Shun KAIZU , Teppei KURITA , Yasutaka HIRASAWA
Abstract: An information generation unit 30 acquires, from a polarization imaging unit 20, observation values in which polarization directions are at least three or more directions (m≥3). A noise amount calculation unit 35-1 calculates an amount of noise on the basis of an observation value in a first polarization direction. Similarly, noise amount calculation units 35-2 to 35-m calculate amounts of noise on the basis of observation values in second to m-th polarization directions. A polarization model estimation unit 36 estimates a polarization model by using the observation values for the respective polarization directions and the amounts of noise calculated by the noise amount calculation units 35-1 to 35-m. Thus, it is possible to calculate a polarization model that is robust against noise.
-
3.
公开(公告)号:US20200068182A1
公开(公告)日:2020-02-27
申请号:US16670239
申请日:2019-10-31
Applicant: SONY CORPORATION
Inventor: Yuhi KONDO , Shun KAIZU , Teppei KURITA , Tuo ZHUANG , Yasutaka HIRASAWA , Ying LU
Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30. Therefore, the polarized image outputted from the correction processing section 40 becomes a high-quality polarized image with, for example, its sensitivity variations corrected.
-
公开(公告)号:US20190260974A1
公开(公告)日:2019-08-22
申请号:US16339579
申请日:2017-08-28
Applicant: SONY CORPORATION
Inventor: Shun KAIZU , Yasutaka HIRASAWA , Yuhi KONDO , Teppei KURITA , Ying LU
Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light. Therefore, accurate polarization information can be acquired compared to a case where polarization information is generated on the basis of the polarization component image.
-
公开(公告)号:US20180013988A1
公开(公告)日:2018-01-11
申请号:US15540456
申请日:2015-12-08
Applicant: SONY CORPORATION
Inventor: Yuhi KONDO , Yasutaka HIRASAWA , Ying LU , Ayaka NAKATANI
CPC classification number: H04N9/07 , G01B11/24 , G02B5/201 , G02B5/3025 , G06T7/514 , H04N5/232 , H04N9/04 , H04N9/646
Abstract: An imaging unit 20 has a configuration in which an identical polarization pixel block made up of a plurality of pixels with an identical polarization direction is provided for each of a plurality of polarization directions and pixels of respective predetermined colors are provided in the identical polarization pixel block. A correction processing unit 31 performs correction processing such as white balance correction on a polarized image generated by the imaging unit 20. A polarized image processing unit 32 separates or extracts a reflection component using the polarized image after the correction processing. By using a polarized image of the separated or extracted reflection component, for example, it is possible to generate normal line information with high accuracy.
-
6.
公开(公告)号:US20190166342A1
公开(公告)日:2019-05-30
申请号:US16313394
申请日:2017-06-13
Applicant: SONY CORPORATION
Inventor: Yuhi KONDO , Shun KAIZU , Teppei KURITA , Tuo ZHUANG , Yasutaka HIRASAWA , Ying LU
Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30. Therefore, the polarized image outputted from the correction processing section 40 becomes a high-quality polarized image with, for example, its sensitivity variations corrected.
-
公开(公告)号:US20170366802A1
公开(公告)日:2017-12-21
申请号:US15540396
申请日:2015-12-08
Applicant: SONY CORPORATION
Inventor: Yasutaka HIRASAWA , Yuhi KONDO , Ying LU , Ayaka NAKATANI
CPC classification number: H04N13/271 , G01B11/24 , G03B17/12 , G03B35/10 , G03B35/26 , H04N5/2226 , H04N5/2258 , H04N5/232 , H04N13/133 , H04N13/243 , H04N13/282 , H04N2013/0081 , H04N2213/001
Abstract: A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.
-
公开(公告)号:US20170124689A1
公开(公告)日:2017-05-04
申请号:US15127226
申请日:2015-02-13
Applicant: SONY CORPORATION
Inventor: Kentaro DOBA , Yasutaka HIRASAWA , Masaki HANDA
CPC classification number: G06T5/009 , G03B15/02 , G03B35/08 , G06K9/4661 , G06T7/593 , G06T7/70 , G06T15/506 , G06T2207/10012 , G06T2207/20092 , H04N5/23216 , H04N5/2354 , H04N13/133
Abstract: A subject information acquisition unit 12 acquires imaged subject information indicative of attributes related to illumination for a subject from a taken image. A preset information selection unit 21 selects preset information as illumination setting information for setting an illumination environment according to a user operation. An illumination setting information adjustment unit adjusts the illumination setting information selected by the illumination setting information selection unit to illumination setting information corresponding to the subject on the basis of the imaged subject information acquired by the subject information acquisition unit. By simply selecting the preset information, it is possible to set easily an illumination environment for relighting, for example.
-
公开(公告)号:US20170011496A1
公开(公告)日:2017-01-12
申请号:US15115510
申请日:2015-05-27
Applicant: SONY CORPORATION
Inventor: Ying LU , Yasutaka HIRASAWA
CPC classification number: G06T5/009 , G06T7/40 , G06T15/50 , G06T15/506 , G06T19/20
Abstract: There is provided an image processing device including circuitry configured to generate an image of a subject under an illumination environment based on illumination information, from subject information which is associated with illumination of the subject and from the illumination information, wherein the illumination information is acquired on the basis of a virtual illumination body within a real space.
Abstract translation: 提供了一种图像处理装置,包括:电路,被配置为基于照明信息,在与照明物体相关的被摄体信息和照明信息的基础上,在照明环境下生成被摄体的图像,其中, 在真实空间内的虚拟照明体的基础。
-
公开(公告)号:US20180308217A1
公开(公告)日:2018-10-25
申请号:US15765086
申请日:2016-09-09
Applicant: SONY CORPORATION
Inventor: Teppei KURITA , Shun KAIZU , Yuhi KONDO , Yasutaka HIRASAWA , Ying LU
CPC classification number: G06T3/4015 , B60R11/02 , G01J3/513 , G01J4/02 , G01J2004/005 , G06T3/40 , G06T7/90 , H04N5/232 , H04N5/30 , H04N9/045 , H04N9/04515 , H04N9/04551 , H04N9/083 , H04N9/3182
Abstract: The polarization imaging unit generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated based on the low frequency component and the component information for each polarization component.
-
-
-
-
-
-
-
-
-