-
公开(公告)号:US10444617B2
公开(公告)日:2019-10-15
申请号:US15565968
申请日:2016-03-01
Applicant: SONY CORPORATION
Inventor: Ayaka Nakatani , Yasutaka Hirasawa , Yuhi Kondo , Ying Lu
IPC: G06K9/00 , G03B35/26 , G01B11/26 , G01B11/00 , G06F3/01 , G06T7/00 , G01B11/16 , G03B35/04 , G03B35/06 , H04N5/225 , G06K9/20
Abstract: A polarized image acquisition section 20 acquires a plurality of polarized images having different polarization directions. The polarized images show, for example, an input indicator for a user interface as a recognition target object. A normal line calculation section 30 calculates normal lines for individual pixels of the recognition target object in accordance with the polarized images acquired by the polarized image acquisition section 20. The normal lines represent information based on the three-dimensional shape of the recognition target object. A recognition section 40 recognizes the object by using the normal lines calculated by the normal line calculation section 30, determines, for example, the type, position, and posture of the input indicator, and outputs the result of determination as input information on the user interface. The object can be recognized easily and with high accuracy.
-
2.
公开(公告)号:US11637967B2
公开(公告)日:2023-04-25
申请号:US17044533
申请日:2019-01-15
Applicant: SONY CORPORATION
Inventor: Ying Lu , Yasutaka Hirasawa , Yuhi Kondo , Tuo Zhuang , Legong Sun
Abstract: Provided is a polarization imaging unit that acquires a polarization image using a lens. In a parameter storage unit of an information processing unit, parameters related to a change in polarization state due to the lens which are estimated in advance from polarization state information acquired by imaging a light source in a predetermined polarization state using the lens and polarization state information indicating the polarization state of the light source, for example, change parameters indicating the change in polarization state due to the lens or correction parameters for correcting the change in polarization state due to the lens are stored. A polarization state correction unit of the information processing unit corrects the change in polarization state due to the lens, using the parameters stored in advance in the parameter storage unit.
-
3.
公开(公告)号:US10904503B2
公开(公告)日:2021-01-26
申请号:US16670239
申请日:2019-10-31
Applicant: SONY CORPORATION
Inventor: Yuhi Kondo , Shun Kaizu , Teppei Kurita , Tuo Zhuang , Yasutaka Hirasawa , Ying Lu
Abstract: A correction information generation section 50 emits measurement light having uniform intensity onto a polarized image acquisition section 20 acquiring a polarized image. Further, on the basis of a measured polarized image acquired from the polarized image acquisition section 20, the correction information generation section 50 generates variation correction information for correcting sensitivity variations caused in the measured polarized image due to difference in polarization direction, and causes a correction information storage section 30 to store the generated variation correction information. A correction processing section 40 then corrects the sensitivity variations caused in the polarized image acquired by the polarized image acquisition section 20 due to the difference in polarization direction by using the pre-generated variation correction information stored in the correction information storage section 30. Therefore, the polarized image outputted from the correction processing section 40 becomes a high-quality polarized image with, for example, its sensitivity variations corrected.
-
公开(公告)号:US10529076B2
公开(公告)日:2020-01-07
申请号:US15569259
申请日:2016-03-01
Applicant: SONY CORPORATION
Inventor: Ying Lu , Yasutaka Hirasawa , Yuhi Kondo , Ayaka Nakatani , Akihiko Kaino
Abstract: A normal-line information generation block 30 generates normal-line information for a frame subject to detection. A data storage block 50 stores normal-line information and the like of a key frame. A motion amount detection block 40 detects a motion amount of an imaging position of the frame subject to detection relative to an imaging position of the key frame on the basis of the normal-line information of the key frame stored in the data storage block 50 and the normal-line information of the frame subject to detection generated by the normal-line information generation block 30. Even if a positional difference of a same point is small or a luminance difference occurs between a taken image of the key frame and a taken image of a current frame, a motion amount of the imaging position of the frame subject to detection relative to the imaging position of the key frame can be accurately detected on the basis of normal-line information. Therefore, an observation position can be accurately detected.
-
公开(公告)号:US10204404B2
公开(公告)日:2019-02-12
申请号:US15115510
申请日:2015-05-27
Applicant: SONY CORPORATION
Inventor: Ying Lu , Yasutaka Hirasawa
Abstract: There is provided an image processing device including circuitry configured to generate an image of a subject under an illumination environment based on illumination information, from subject information which is associated with illumination of the subject and from the illumination information, wherein the illumination information is acquired on the basis of a virtual illumination body within a real space.
-
公开(公告)号:US11605661B2
公开(公告)日:2023-03-14
申请号:US16763543
申请日:2018-09-18
Applicant: SONY CORPORATION
Inventor: Teppei Kurita , Ying Lu , Yuhi Kondo , Yasutaka Hirasawa
IPC: H01L27/146 , H04N5/369 , H04N9/04
Abstract: An unpolarized component image generating section generates unpolarized component image signals of specific and non-specific colors. A polarized component image generating section generates polarized component image signals of the specific and non-specific colors. A specific color polarization property detecting section detects polarization properties of the specific color using pixel signals of polarized or unpolarized pixels of the specific color having at least three polarization directions and pixel signals of polarized pixels having two polarization directions. An unpolarized color polarization property detecting section detects polarization properties of the non-specific color on the basis of the polarization properties of the specific color detected by the specific color polarization property detecting section, the pixel signals of the unpolarized pixels of the non-specific color, and the pixel signals of the polarized pixels of the non-specific color having fewer polarization directions than the polarized pixels of the specific color.
-
公开(公告)号:US10812735B2
公开(公告)日:2020-10-20
申请号:US16340604
申请日:2017-10-26
Applicant: SONY CORPORATION
Inventor: Yasutaka Hirasawa , Yuhi Kondo , Hideki Oyaizu , Shun Kaizu , Teppei Kurita , Tuo Zhuang , Ying Lu , Hajime Mihara
Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided. The image processing device includes: an image input unit that acquires at least three types of images formed with polarization images of different polarizing directions or non-polarization images; an angle input unit that outputs reflection angles that are the angles between the image capturing directions of the acquired images and the plane direction corresponding to the normal direction of the reflecting surface, to an intensity transmittance and intensity reflectance calculation unit; a calculation unit that calculates the respective intensity transmittances and the respective intensity reflectances of S waves and P waves, using the reflection angles; and a reflection component separation unit that removes the reflected light component from the images acquired by the image input unit, using the respective intensity transmittances and the respective intensity reflectances of the S waves and P waves. These processes enable removal of reflected light components from captured images having various reflection angles.
-
公开(公告)号:US10750136B2
公开(公告)日:2020-08-18
申请号:US16339579
申请日:2017-08-28
Applicant: SONY CORPORATION
Inventor: Shun Kaizu , Yasutaka Hirasawa , Yuhi Kondo , Teppei Kurita , Ying Lu
Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light. Therefore, accurate polarization information can be acquired compared to a case where polarization information is generated on the basis of the polarization component image.
-
公开(公告)号:US10798367B2
公开(公告)日:2020-10-06
申请号:US15540396
申请日:2015-12-08
Applicant: SONY CORPORATION
Inventor: Yasutaka Hirasawa , Yuhi Kondo , Ying Lu , Ayaka Nakatani
IPC: H04N13/271 , H04N5/232 , G03B17/12 , G03B35/26 , H04N5/222 , G01B11/24 , G03B35/10 , H04N5/225 , H04N13/133 , H04N13/243 , H04N13/282 , H04N13/00
Abstract: A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.
-
公开(公告)号:US10460422B2
公开(公告)日:2019-10-29
申请号:US15765086
申请日:2016-09-09
Applicant: SONY CORPORATION
Inventor: Teppei Kurita , Shun Kaizu , Yuhi Kondo , Yasutaka Hirasawa , Ying Lu
IPC: G06T3/40 , H04N9/04 , B60R11/02 , H04N5/232 , G06T7/90 , H04N5/30 , H04N9/083 , H04N9/31 , G01J4/02 , G01J4/00
Abstract: The polarization imaging unit generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated based on the low frequency component and the component information for each polarization component.
-
-
-
-
-
-
-
-
-