-
公开(公告)号:US11605661B2
公开(公告)日:2023-03-14
申请号:US16763543
申请日:2018-09-18
Applicant: SONY CORPORATION
Inventor: Teppei Kurita , Ying Lu , Yuhi Kondo , Yasutaka Hirasawa
IPC: H01L27/146 , H04N5/369 , H04N9/04
Abstract: An unpolarized component image generating section generates unpolarized component image signals of specific and non-specific colors. A polarized component image generating section generates polarized component image signals of the specific and non-specific colors. A specific color polarization property detecting section detects polarization properties of the specific color using pixel signals of polarized or unpolarized pixels of the specific color having at least three polarization directions and pixel signals of polarized pixels having two polarization directions. An unpolarized color polarization property detecting section detects polarization properties of the non-specific color on the basis of the polarization properties of the specific color detected by the specific color polarization property detecting section, the pixel signals of the unpolarized pixels of the non-specific color, and the pixel signals of the polarized pixels of the non-specific color having fewer polarization directions than the polarized pixels of the specific color.
-
公开(公告)号:US10812735B2
公开(公告)日:2020-10-20
申请号:US16340604
申请日:2017-10-26
Applicant: SONY CORPORATION
Inventor: Yasutaka Hirasawa , Yuhi Kondo , Hideki Oyaizu , Shun Kaizu , Teppei Kurita , Tuo Zhuang , Ying Lu , Hajime Mihara
Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided. The image processing device includes: an image input unit that acquires at least three types of images formed with polarization images of different polarizing directions or non-polarization images; an angle input unit that outputs reflection angles that are the angles between the image capturing directions of the acquired images and the plane direction corresponding to the normal direction of the reflecting surface, to an intensity transmittance and intensity reflectance calculation unit; a calculation unit that calculates the respective intensity transmittances and the respective intensity reflectances of S waves and P waves, using the reflection angles; and a reflection component separation unit that removes the reflected light component from the images acquired by the image input unit, using the respective intensity transmittances and the respective intensity reflectances of the S waves and P waves. These processes enable removal of reflected light components from captured images having various reflection angles.
-
公开(公告)号:US10750136B2
公开(公告)日:2020-08-18
申请号:US16339579
申请日:2017-08-28
Applicant: SONY CORPORATION
Inventor: Shun Kaizu , Yasutaka Hirasawa , Yuhi Kondo , Teppei Kurita , Ying Lu
Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light. Therefore, accurate polarization information can be acquired compared to a case where polarization information is generated on the basis of the polarization component image.
-
公开(公告)号:US20200039509A1
公开(公告)日:2020-02-06
申请号:US16599740
申请日:2019-10-11
Applicant: Sony Corporation
Inventor: Hideki Oyaizu , Yuhi Kondo , Yasutaka Hirasawa , Suguru Aoki , Taketo Akama
IPC: B60W30/095 , G08G1/16 , G06K9/00 , B62D15/02 , B60W30/09 , B60R21/0134 , B60W30/08 , B62D6/00 , B60R21/00
Abstract: [Abstract] A damage reduction device according to an embodiment of the present technology includes an input unit, a prediction unit, a recognition unit, and a determination unit. The input unit inputs status data regarding a status in a moving direction of a moving body apparatus. The prediction unit predicts a collision with an object in the moving direction on the basis of the status data. The recognition unit recognizes whether the object includes a person. The determination unit determines, when the collision with the object is predicted and it is recognized that the object includes a person, a steering direction of the moving body apparatus in which a collision with the person is avoidable, on the basis of the status data.
-
公开(公告)号:US11663831B2
公开(公告)日:2023-05-30
申请号:US16770908
申请日:2018-10-12
Applicant: SONY CORPORATION
Inventor: Hajime Mihara , Shun Kaizu , Teppei Kurita , Yuhi Kondo , Yasutaka Hirasawa
IPC: G06K9/46 , G06V10/60 , G06V10/56 , G06V10/145 , G06V10/147 , G06V10/10 , G06V10/30
CPC classification number: G06V10/60 , G06V10/10 , G06V10/145 , G06V10/147 , G06V10/30 , G06V10/56
Abstract: A polarized image acquisition section 11a acquires a polarized image of a target object having one or more polarization directions. A polarization parameter acquisition section 12-1 calculates the average brightness α of a polarization model on the basis of a non-polarized image subjected to sensitivity correction. Further, the polarization parameter acquisition section 12-1 calculates the amplitude β of the polarization model on the basis of the calculated average brightness α, pre-stored information regarding the zenith angle θ of the normal line of the target object, a refractive index r, and reflectance property information indicative of whether a subject is diffuse reflection or specular reflection. A polarization model detection section 13-1 is able to detect the polarization properties of the target object through the use of an image polarized in one or more polarization directions, by calculating the phase ϕ of the polarization model on the basis of a polarized image of the target object having one or more polarization directions, the average brightness α, and the amplitude β of the polarization model.
-
公开(公告)号:US10798367B2
公开(公告)日:2020-10-06
申请号:US15540396
申请日:2015-12-08
Applicant: SONY CORPORATION
Inventor: Yasutaka Hirasawa , Yuhi Kondo , Ying Lu , Ayaka Nakatani
IPC: H04N13/271 , H04N5/232 , G03B17/12 , G03B35/26 , H04N5/222 , G01B11/24 , G03B35/10 , H04N5/225 , H04N13/133 , H04N13/243 , H04N13/282 , H04N13/00
Abstract: A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.
-
公开(公告)号:US10793149B2
公开(公告)日:2020-10-06
申请号:US15761901
申请日:2016-09-05
Applicant: Sony Corporation
Inventor: Taketo Akama , Suguru Aoki , Hideki Oyaizu , Yasutaka Hirasawa , Yuhi Kondo
Abstract: A control apparatus includes an input unit and a control unit. To the input unit, a pickup image of a camera provided to an own vehicle is input. The control unit detects a mirror provided to a different vehicle that exists in front of the own vehicle from the input pickup image, detects a person from a mirror image of the detected mirror, and recognizes a state of the person from an image of the detected person. Further, the control unit performs an alerting process or a control process for the own vehicle to prevent an accident of the own vehicle or the different vehicle in accordance with the recognized state of the person.
-
公开(公告)号:US10523873B2
公开(公告)日:2019-12-31
申请号:US15773440
申请日:2016-09-09
Applicant: SONY CORPORATION
Inventor: Hideki Oyaizu , Yasutaka Hirasawa , Yuhi Kondo
Abstract: The low-sensitivity polarization characteristic model calculation unit 31 of the polarized image processing unit 30-1 calculates the low-sensitivity polarization characteristic model on the basis of the low-sensitivity polarized image in the plurality of polarization directions that is generated by the low-sensitivity imaging unit 21. The non-saturation polarized image extraction unit 32 extracts an image in a polarization direction in which saturation has not occurred from the high-sensitivity polarized image in the plurality of polarization directions that is generated by the high-sensitivity imaging unit 22. The high-sensitivity component acquisition unit 33-1 calculates a high-sensitivity polarization characteristic model having the phase component identical to the low-sensitivity polarization characteristic model from an image in a plurality of polarization directions in which saturation has not occurred in the high-sensitivity polarized image. Furthermore, the high-sensitivity component acquisition unit 33-1 acquires the amplitude of the high-sensitivity polarization characteristic model as the polarization component of a photographic object, and acquires the minimum value of the high-sensitivity polarization characteristic model as the non-polarization component of the photographic object. It is possible to determine polarization characteristics of a photographic object with high sensitivity from an image.
-
公开(公告)号:US10460422B2
公开(公告)日:2019-10-29
申请号:US15765086
申请日:2016-09-09
Applicant: SONY CORPORATION
Inventor: Teppei Kurita , Shun Kaizu , Yuhi Kondo , Yasutaka Hirasawa , Ying Lu
IPC: G06T3/40 , H04N9/04 , B60R11/02 , H04N5/232 , G06T7/90 , H04N5/30 , H04N9/083 , H04N9/31 , G01J4/02 , G01J4/00
Abstract: The polarization imaging unit generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated based on the low frequency component and the component information for each polarization component.
-
公开(公告)号:US20180229725A1
公开(公告)日:2018-08-16
申请号:US15761901
申请日:2016-09-05
Applicant: Sony Corporation
Inventor: Taketo Akama , Suguru Aoki , Hideki Oyaizu , Yasutaka Hirasawa , Yuhi Kondo
IPC: B60W30/095 , B60W40/04 , G06K9/00 , B60R11/04
Abstract: A control apparatus includes an input unit and a control unit. To the input unit, a pickup image of a camera provided to an own vehicle is input. The control unit detects a mirror provided to a different vehicle that exists in front of the own vehicle from the input pickup image, detects a person from a mirror image of the detected mirror, and recognizes a state of the person from an image of the detected person. Further, the control unit performs an alerting process or a control process for the own vehicle to prevent an accident of the own vehicle or the different vehicle in accordance with the recognized state of the person.
-
-
-
-
-
-
-
-
-