公开(公告)号：US20210174127A1

公开(公告)日：2021-06-10

申请号：US16770908

申请日：2018-10-12

Applicant: SONY CORPORATION

Inventor： HAJIME MIHARA ,  SHUN KAIZU ,  TEPPEI KURITA ,  YUHI KONDO ,  YASUTAKA HIRASAWA

IPC: G06K9/46 ,  G06K9/20

Abstract: A polarized image acquisition section 11a acquires a polarized image of a target object having one or more polarization directions. A polarization parameter acquisition section 12-1 calculates the average brightness α of a polarization model on the basis of a non-polarized image subjected to sensitivity correction. Further, the polarization parameter acquisition section 12-1 calculates the amplitude β of the polarization model on the basis of the calculated average brightness α, pre-stored information regarding the zenith angle θ of the normal line of the target object, a refractive index r, and reflectance property information indicative of whether a subject is diffuse reflection or specular reflection. A polarization model detection section 13-1 is able to detect the polarization properties of the target object through the use of an image polarized in one or more polarization directions, by calculating the phase ϕ of the polarization model on the basis of a polarized image of the target object having one or more polarization directions, the average brightness α, and the amplitude β of the polarization model.

公开(公告)号：US20190273856A1

公开(公告)日：2019-09-05

申请号：US16340604

申请日：2017-10-26

Applicant: SONY CORPORATION

Inventor： YASUTAKA HIRASAWA ,  YUHI KONDO ,  HIDEKI OYAIZU ,  SHUN KAIZU ,  TEPPEI KURITA ,  TUO ZHUANG ,  YING LU ,  HAJIME MIHARA

IPC: H04N5/238 ,  H04N5/217

Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided. The image processing device includes: an image input unit that acquires at least three types of images formed with polarization images of different polarizing directions or non-polarization images; an angle input unit that outputs reflection angles that are the angles between the image capturing directions of the acquired images and the plane direction corresponding to the normal direction of the reflecting surface, to an intensity transmittance and intensity reflectance calculation unit; a calculation unit that calculates the respective intensity transmittances and the respective intensity reflectances of S waves and P waves, using the reflection angles; and a reflection component separation unit that removes the reflected light component from the images acquired by the image input unit, using the respective intensity transmittances and the respective intensity reflectances of the S waves and P waves. These processes enable removal of reflected light components from captured images having various reflection angles.

公开(公告)号：US20180268700A1

公开(公告)日：2018-09-20

申请号：US15760412

申请日：2016-08-26

Applicant: SONY CORPORATION

Inventor： SUGURU AOKI ,  TAKETO AKAMA ,  HIDEKI OYAIZU ,  YASUTAKA HIRASAWA ,  YUHI KONDO

IPC: G08G1/16 ,  B60W50/14 ,  B60W30/095 ,  B60W40/064 ,  G06T7/60 ,  G06K9/00

Abstract: An information processing apparatus according to an embodiment of the present technology includes a detection unit, an estimation unit, and a judgment unit. The detection unit detects a target object from an input image. The estimation unit estimates a posture of the detected target object. The judgment unit judges a possibility of the target object slipping on the basis of the estimated posture.

公开(公告)号：US20210217191A1

公开(公告)日：2021-07-15

申请号：US16769159

申请日：2018-10-12

Applicant: SONY CORPORATION

Inventor： SHUN KAIZU ,  YASUTAKA HIRASAWA ,  TEPPEI KURITA

IPC: G06T7/593

Abstract: A local match processing section 361 of a parallax detecting section 36 generates a cost volume indicating a cost indicating, for each pixel and each parallax, the similarity between images acquired by imaging sections 21 and 22 that are different in viewpoint positions. A cost volume processing section 363 performs cost adjustment processing on a cost volume on the basis of a polarization image acquired by the imaging section 21, by using normal line information generated for each pixel by a normal line information generating section 31. A minimum value search processing section 365 detects, from the cost volume having undergone the cost adjustment processing, a parallax at which the similarity becomes maximum, by using the parallax-based costs of a parallax detection target pixel. A depth calculating section 37 generates depth information indicating depths of respective pixels on the basis of parallaxes detected, for the respective pixels, by the parallax detecting section 36. This enables detection of a parallax with high precision almost without the influences of an object shape, an image capturing condition, and the like.

公开(公告)号：US20200350353A1

公开(公告)日：2020-11-05

申请号：US16763543

申请日：2018-09-18

Applicant: SONY CORPORATION

Inventor： TEPPEI KURITA ,  YING LU ,  YUHI KONDO ,  YASUTAKA HIRASAWA

IPC: H01L27/146 ,  H04N5/369

Abstract: An unpolarized component image generating section 32-1 generates unpolarized component image signals of specific and non-specific colors. A polarized component image generating section 33-1 generates polarized component image signals of the specific and non-specific colors. A specific color polarization property detecting section 34-1 detects polarization properties of the specific color using pixel signals of polarized or unpolarized pixels of the specific color having at least three polarization directions and pixel signals of polarized pixels having two polarization directions. An unpolarized color polarization property detecting section 35 detects polarization properties of the non-specific color on the basis of the polarization properties of the specific color detected by the specific color polarization property detecting section 34-1, the pixel signals of the unpolarized pixels of the non-specific color, and the pixel signals of the polarized pixels of the non-specific color having fewer polarization directions than the polarized pixels of the specific color. The polarization properties are thus detected for each color without recourse to the assumption that the degree of polarization is the same for each color.

公开(公告)号：US20180122086A1

公开(公告)日：2018-05-03

申请号：US15569259

申请日：2016-03-01

Applicant: SONY CORPORATION

Inventor： YING LU ,  YASUTAKA HIRASAWA ,  YUHI KONDO ,  AYAKA NAKATANI ,  AKIHIKO KAINO

IPC: G06T7/246 ,  G06T7/73

CPC classification number: G06T7/246 ,  G06T7/20 ,  G06T7/579 ,  G06T7/73 ,  G06T2207/10028 ,  G06T2207/30244

Abstract: A normal-line information generation block 30 generates normal-line information for a frame subject to detection. A data storage block 50 stores normal-line information and the like of a key frame. A motion amount detection block 40 detects a motion amount of an imaging position of the frame subject to detection relative to an imaging position of the key frame on the basis of the normal-line information of the key frame stored in the data storage block 50 and the normal-line information of the frame subject to detection generated by the normal-line information generation block 30. Even if a positional difference of a same point is small or a luminance difference occurs between a taken image of the key frame and a taken image of a current frame, a motion amount of the imaging position of the frame subject to detection relative to the imaging position of the key frame can be accurately detected on the basis of normal-line information. Therefore, an observation position can be accurately detected.

公开(公告)号：US20210374906A1

公开(公告)日：2021-12-02

申请号：US17056550

申请日：2019-02-18

Applicant: Masayoshi Doshida ,  SONY CORPORATION

Inventor： LEGONG SUN ,  YASUTAKA HIRASAWA ,  YUHI KONDO ,  YING LU ,  TUO ZHUANG

IPC: G06T3/40 ,  G06T7/90 ,  G06T7/60

Abstract: A normal candidate information generation unit 31 of an information processor 30 generates normal candidate information for each pixel indicating, for example, a zenith angle, or an azimuth angle, or a zenith angle and an azimuth angle, on the basis of a polarization image in a plurality of polarization directions obtained by a polarization imaging unit 20. The in-plane pixel selection unit 32 selects a plurality of pixels indicating the plane to be observed in the polarization image. A normal calculation unit 33 calculates a normal of the plane to be observed on the basis of the normal candidate information of the pixels selected by the in-plane pixel selection unit 32. For example, the normal calculation unit 33 calculates the normal of the plane to be observed on the basis of a line-of-sight axis indicating a light beam direction from the plane to be observed corresponding to the pixels selected by the in-plane pixel selection unit 32 toward the polarization imaging unit 20 and the zenith angles of the selected pixels.

公开(公告)号：US20210281786A1

公开(公告)日：2021-09-09

申请号：US16324937

申请日：2017-06-13

Applicant: SONY CORPORATION

Inventor： TEPPEI KURITA ,  SHUN KAIZU ,  YUHI KONDO ,  YASUTAKA HIRASAWA

IPC: H04N5/367 ,  H04N17/00 ,  H04N5/355 ,  H04N5/374 ,  H04N5/372

Abstract: A polarization imaging section 20 includes polarized pixels in each of a plurality of polarization directions. The polarization imaging section 20 includes a polarizer. The polarization imaging section 20 outputs image signals of a polarized image to a defect detecting section 35 of an image processing section 30. In a case where a difference between a pixel value of a target polarized pixel generated by the polarization imaging section and a pixel value of the target polarized pixel estimated from polarization characteristics corresponding to pixel values of peripheral pixels in a polarization direction different from a polarization direction of the target polarized pixel is greater than a predetermined allowable range, the defect detecting section 35 determines that the target polarized pixel is a defective pixel. Therefore, it is possible to detect a defect of a pixel in the polarization imaging section that generates the polarized image.

公开(公告)号：US20180359401A1

公开(公告)日：2018-12-13

申请号：US15773440

申请日：2016-09-09

Applicant: SONY CORPORATION

Inventor： HIDEKI OYAIZU ,  YASUTAKA HIRASAWA ,  YUHI KONDO

IPC: H04N5/235 ,  H04N5/225

CPC classification number: H04N5/2351 ,  G02B5/201 ,  G02B5/30 ,  H04N5/2258 ,  H04N5/2353 ,  H04N5/2355 ,  H04N5/35554 ,  H04N5/35563 ,  H04N5/35581 ,  H04N7/18 ,  H04N9/04555

Abstract: The low-sensitivity polarization characteristic model calculation unit 31 of the polarized image processing unit 30-1 calculates the low-sensitivity polarization characteristic model on the basis of the low-sensitivity polarized image in the plurality of polarization directions that is generated by the low-sensitivity imaging unit 21. The non-saturation polarized image extraction unit 32 extracts an image in a polarization direction in which saturation has not occurred from the high-sensitivity polarized image in the plurality of polarization directions that is generated by the high-sensitivity imaging unit 22. The high-sensitivity component acquisition unit 33-1 calculates a high-sensitivity polarization characteristic model having the phase component identical to the low-sensitivity polarization characteristic model from an image in a plurality of polarization directions in which saturation has not occurred in the high-sensitivity polarized image. Furthermore, the high-sensitivity component acquisition unit 33-1 acquires the amplitude of the high-sensitivity polarization characteristic model as the polarization component of a photographic object, and acquires the minimum value of the high-sensitivity polarization characteristic model as the non-polarization component of the photographic object. It is possible to determine polarization characteristics of a photographic object with high sensitivity from an image.

公开(公告)号：US20180107108A1

公开(公告)日：2018-04-19

申请号：US15565968

申请日：2016-03-01

Applicant: SONY CORPORATION

Inventor： AYAKA NAKATANI ,  YASUTAKA HIRASAWA ,  YUHI KONDO ,  YING LU

IPC: G03B35/26 ,  G01B11/16 ,  G01B11/26 ,  G01B11/00 ,  G03B35/06 ,  G03B35/04 ,  H04N5/225

CPC classification number: G03B35/26 ,  G01B11/00 ,  G01B11/005 ,  G01B11/168 ,  G01B11/26 ,  G03B35/04 ,  G03B35/06 ,  G06F3/01 ,  G06K9/00375 ,  G06K9/2036 ,  G06K9/209 ,  G06T7/00 ,  H04N5/2254

Abstract: A polarized image acquisition section 20 acquires a plurality of polarized images having different polarization directions. The polarized images show, for example, an input indicator for a user interface as a recognition target object. A normal line calculation section 30 calculates normal lines for individual pixels of the recognition target object in accordance with the polarized images acquired by the polarized image acquisition section 20. The normal lines represent information based on the three-dimensional shape of the recognition target object. A recognition section 40 recognizes the object by using the normal lines calculated by the normal line calculation section 30, determines, for example, the type, position, and posture of the input indicator, and outputs the result of determination as input information on the user interface. The object can be recognized easily and with high accuracy.