Image processing apparatus, image processing method, and solid-state imaging apparatus to detect polarization properties of each color

    公开(公告)号:US11605661B2

    公开(公告)日:2023-03-14

    申请号:US16763543

    申请日:2018-09-18

    Abstract: An unpolarized component image generating section generates unpolarized component image signals of specific and non-specific colors. A polarized component image generating section generates polarized component image signals of the specific and non-specific colors. A specific color polarization property detecting section detects polarization properties of the specific color using pixel signals of polarized or unpolarized pixels of the specific color having at least three polarization directions and pixel signals of polarized pixels having two polarization directions. An unpolarized color polarization property detecting section detects polarization properties of the non-specific color on the basis of the polarization properties of the specific color detected by the specific color polarization property detecting section, the pixel signals of the unpolarized pixels of the non-specific color, and the pixel signals of the polarized pixels of the non-specific color having fewer polarization directions than the polarized pixels of the specific color.

    Image processing device and image processing method

    公开(公告)号:US10812735B2

    公开(公告)日:2020-10-20

    申请号:US16340604

    申请日:2017-10-26

    Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided. The image processing device includes: an image input unit that acquires at least three types of images formed with polarization images of different polarizing directions or non-polarization images; an angle input unit that outputs reflection angles that are the angles between the image capturing directions of the acquired images and the plane direction corresponding to the normal direction of the reflecting surface, to an intensity transmittance and intensity reflectance calculation unit; a calculation unit that calculates the respective intensity transmittances and the respective intensity reflectances of S waves and P waves, using the reflection angles; and a reflection component separation unit that removes the reflected light component from the images acquired by the image input unit, using the respective intensity transmittances and the respective intensity reflectances of the S waves and P waves. These processes enable removal of reflected light components from captured images having various reflection angles.

    Image processing apparatus, image processing method, and image pickup device

    公开(公告)号:US10750136B2

    公开(公告)日:2020-08-18

    申请号:US16339579

    申请日:2017-08-28

    Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light. Therefore, accurate polarization information can be acquired compared to a case where polarization information is generated on the basis of the polarization component image.

    Image processing device and image processing method

    公开(公告)号:US11663831B2

    公开(公告)日:2023-05-30

    申请号:US16770908

    申请日:2018-10-12

    Abstract: A polarized image acquisition section 11a acquires a polarized image of a target object having one or more polarization directions. A polarization parameter acquisition section 12-1 calculates the average brightness α of a polarization model on the basis of a non-polarized image subjected to sensitivity correction. Further, the polarization parameter acquisition section 12-1 calculates the amplitude β of the polarization model on the basis of the calculated average brightness α, pre-stored information regarding the zenith angle θ of the normal line of the target object, a refractive index r, and reflectance property information indicative of whether a subject is diffuse reflection or specular reflection. A polarization model detection section 13-1 is able to detect the polarization properties of the target object through the use of an image polarized in one or more polarization directions, by calculating the phase ϕ of the polarization model on the basis of a polarized image of the target object having one or more polarization directions, the average brightness α, and the amplitude β of the polarization model.

    Control apparatus, control method, and program

    公开(公告)号:US10793149B2

    公开(公告)日:2020-10-06

    申请号:US15761901

    申请日:2016-09-05

    Abstract: A control apparatus includes an input unit and a control unit. To the input unit, a pickup image of a camera provided to an own vehicle is input. The control unit detects a mirror provided to a different vehicle that exists in front of the own vehicle from the input pickup image, detects a person from a mirror image of the detected mirror, and recognizes a state of the person from an image of the detected person. Further, the control unit performs an alerting process or a control process for the own vehicle to prevent an accident of the own vehicle or the different vehicle in accordance with the recognized state of the person.

    Image processing device and image processing method

    公开(公告)号:US10523873B2

    公开(公告)日:2019-12-31

    申请号:US15773440

    申请日:2016-09-09

    Abstract: The low-sensitivity polarization characteristic model calculation unit 31 of the polarized image processing unit 30-1 calculates the low-sensitivity polarization characteristic model on the basis of the low-sensitivity polarized image in the plurality of polarization directions that is generated by the low-sensitivity imaging unit 21. The non-saturation polarized image extraction unit 32 extracts an image in a polarization direction in which saturation has not occurred from the high-sensitivity polarized image in the plurality of polarization directions that is generated by the high-sensitivity imaging unit 22. The high-sensitivity component acquisition unit 33-1 calculates a high-sensitivity polarization characteristic model having the phase component identical to the low-sensitivity polarization characteristic model from an image in a plurality of polarization directions in which saturation has not occurred in the high-sensitivity polarized image. Furthermore, the high-sensitivity component acquisition unit 33-1 acquires the amplitude of the high-sensitivity polarization characteristic model as the polarization component of a photographic object, and acquires the minimum value of the high-sensitivity polarization characteristic model as the non-polarization component of the photographic object. It is possible to determine polarization characteristics of a photographic object with high sensitivity from an image.

    Image processing device and image processing method

    公开(公告)号:US10460422B2

    公开(公告)日:2019-10-29

    申请号:US15765086

    申请日:2016-09-09

    Abstract: The polarization imaging unit generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated based on the low frequency component and the component information for each polarization component.

    CONTROL APPARATUS, CONTROL METHOD, AND PROGRAM

    公开(公告)号:US20180229725A1

    公开(公告)日:2018-08-16

    申请号:US15761901

    申请日:2016-09-05

    Abstract: A control apparatus includes an input unit and a control unit. To the input unit, a pickup image of a camera provided to an own vehicle is input. The control unit detects a mirror provided to a different vehicle that exists in front of the own vehicle from the input pickup image, detects a person from a mirror image of the detected mirror, and recognizes a state of the person from an image of the detected person. Further, the control unit performs an alerting process or a control process for the own vehicle to prevent an accident of the own vehicle or the different vehicle in accordance with the recognized state of the person.

Patent Agency Ranking