公开(公告)号：US11676245B2

公开(公告)日：2023-06-13

申请号：US17056550

申请日：2019-02-18

Applicant: SONY CORPORATION ,  Masayoshi Doshida

Inventor： Legong Sun ,  Yasutaka Hirasawa ,  Yuhi Kondo ,  Ying Lu ,  Tuo Zhuang

IPC: G06T3/40 ,  G06T7/60 ,  G06T7/90

CPC classification number: G06T3/4015 ,  G06T7/60 ,  G06T7/90

Abstract: A normal candidate information generation unit of an information processor generates normal candidate information for each pixel indicating, for example, a zenith angle, or an azimuth angle, or a zenith angle and an azimuth angle, on the basis of a polarization image in a plurality of polarization directions obtained by a polarization imaging unit. The in-plane pixel selection unit selects a plurality of pixels indicating the plane to be observed in the polarization image. A normal calculation unit calculates a normal of the plane to be observed on the basis of the normal candidate information of the pixels selected by the in-plane pixel selection unit.

公开(公告)号：US11405603B2

公开(公告)日：2022-08-02

申请号：US16942323

申请日：2020-07-29

Applicant: SONY CORPORATION

Inventor： Yasutaka Hirasawa ,  Yuhi Kondo ,  Ying Lu ,  Ayaka Nakatani

IPC: H04N13/271 ,  G03B17/12 ,  G03B35/26 ,  H04N5/222 ,  G01B11/24 ,  G03B35/10 ,  H04N5/225 ,  H04N9/04 ,  H04N13/133 ,  H04N13/243 ,  H04N13/282 ,  H04N13/00

Abstract: A third imaging unit including a pixel not having a polarization characteristic is interposed between a first imaging unit and a second imaging unit including a pixel having a polarization characteristic for each of a plurality of polarization directions. A depth map is generated from a viewpoint of the first imaging unit by matching processing using a first image generated by the first imaging unit and a second image generated by the second imaging unit. A normal map is generated on the basis of a polarization state of the first image. Integration processing of the depth map and the normal map is performed and a depth map with a high accuracy is generated. The depth map generated by the map integrating unit is converted into a map from a viewpoint of the third imaging unit, and an image free from deterioration can be generated.

公开(公告)号：US10362280B2

公开(公告)日：2019-07-23

申请号：US15540456

申请日：2015-12-08

Applicant: SONY CORPORATION

Inventor： Yuhi Kondo ,  Yasutaka Hirasawa ,  Ying Lu ,  Ayaka Nakatani

IPC: H04N9/07 ,  G06T7/514 ,  H04N9/64 ,  H04N9/04 ,  G02B5/30 ,  G02B5/20 ,  H04N5/232 ,  G01B11/24

Abstract: An imaging unit 20 has a configuration in which an identical polarization pixel block made up of a plurality of pixels with an identical polarization direction is provided for each of a plurality of polarization directions and pixels of respective predetermined colors are provided in the identical polarization pixel block. A correction processing unit 31 performs correction processing such as white balance correction on a polarized image generated by the imaging unit 20. A polarized image processing unit 32 separates or extracts a reflection component using the polarized image after the correction processing. By using a polarized image of the separated or extracted reflection component, for example, it is possible to generate normal line information with high accuracy.