公开(公告)号：US20210281786A1

公开(公告)日：2021-09-09

申请号：US16324937

申请日：2017-06-13

Applicant: SONY CORPORATION

Inventor： TEPPEI KURITA ,  SHUN KAIZU ,  YUHI KONDO ,  YASUTAKA HIRASAWA

IPC: H04N5/367 ,  H04N17/00 ,  H04N5/355 ,  H04N5/374 ,  H04N5/372

Abstract: A polarization imaging section 20 includes polarized pixels in each of a plurality of polarization directions. The polarization imaging section 20 includes a polarizer. The polarization imaging section 20 outputs image signals of a polarized image to a defect detecting section 35 of an image processing section 30. In a case where a difference between a pixel value of a target polarized pixel generated by the polarization imaging section and a pixel value of the target polarized pixel estimated from polarization characteristics corresponding to pixel values of peripheral pixels in a polarization direction different from a polarization direction of the target polarized pixel is greater than a predetermined allowable range, the defect detecting section 35 determines that the target polarized pixel is a defective pixel. Therefore, it is possible to detect a defect of a pixel in the polarization imaging section that generates the polarized image.

公开(公告)号：US20210217191A1

公开(公告)日：2021-07-15

申请号：US16769159

申请日：2018-10-12

Applicant: SONY CORPORATION

Inventor： SHUN KAIZU ,  YASUTAKA HIRASAWA ,  TEPPEI KURITA

IPC: G06T7/593

Abstract: A local match processing section 361 of a parallax detecting section 36 generates a cost volume indicating a cost indicating, for each pixel and each parallax, the similarity between images acquired by imaging sections 21 and 22 that are different in viewpoint positions. A cost volume processing section 363 performs cost adjustment processing on a cost volume on the basis of a polarization image acquired by the imaging section 21, by using normal line information generated for each pixel by a normal line information generating section 31. A minimum value search processing section 365 detects, from the cost volume having undergone the cost adjustment processing, a parallax at which the similarity becomes maximum, by using the parallax-based costs of a parallax detection target pixel. A depth calculating section 37 generates depth information indicating depths of respective pixels on the basis of parallaxes detected, for the respective pixels, by the parallax detecting section 36. This enables detection of a parallax with high precision almost without the influences of an object shape, an image capturing condition, and the like.

公开(公告)号：US20210201450A1

公开(公告)日：2021-07-01

申请号：US17048762

申请日：2019-01-31

Applicant: SONY CORPORATION

Inventor： TEPPEI KURITA ,  SHUN KAIZU ,  YASUTAKA HIRASAWA ,  YUHI KONDO

IPC: G06T5/00 ,  G06T7/40

Abstract: A polarization imaging unit 20 generates, as polarization information, a polarization image including pixels in a plurality of polarization directions. An interpolation processing unit 31 of an information processor 30 performs interpolation processing using the polarization image obtained from the polarization imaging unit 20, and generates a polarization image for each polarization method. A polarization degree calculation unit 32 calculates, for example, a polarization degree for each pixel as object surface information on the basis of the polarization image for each polarization method. A noise amount calculation unit 33 calculates a noise amount for each pixel on the basis of the polarization image for each polarization method and the like. A polarization degree correction unit 34 serves as an information correction unit, and corrects, according to the noise amount calculated by the noise amount calculation unit 33, the polarization degree that is object surface information calculated by the polarization degree calculation unit 32. The object surface information that is robust to noise can be obtained.

公开(公告)号：US20210152749A1

公开(公告)日：2021-05-20

申请号：US17046456

申请日：2019-01-31

Applicant: SONY CORPORATION

Inventor： TEPPEI KURITA ,  SHUN KAIZU

IPC: H04N5/243 ,  G06T5/50 ,  H04N5/225 ,  G06T5/20

Abstract: The polarization imaging unit 20 acquires a polarization image of a subject, and outputs the polarization image to the image processing unit 30. An interpolation processing unit 31 of the image processing apparatus 30 performs interpolation processing by using the polarization image acquired by the polarization imaging unit 20 to generate an image signal for each polarization component and each color component. A component image generation unit 32 calculates a specular reflection component and a diffuse reflection component for each pixel and for each color component, and generates, as component images, a specular reflection image representing the specular reflection components and a diffuse reflection image representing the diffuse reflection components. A target image generation unit 33 sets gain for each pixel of the component images by using a learned model on the basis of the component images. Furthermore, the target image generation unit 33 performs level adjustment of the component images for each pixel with the set gain, and generates a target image such as a high-texture image from the level-adjusted component images.

公开(公告)号：US20210227116A1

公开(公告)日：2021-07-22

申请号：US17056335

申请日：2019-02-13

Applicant: SONY CORPORATION

Inventor： SHUN KAIZU

IPC: H04N5/235

Abstract: A signal processing apparatus and a signal processing method that process a signal to control exposure timing of an image sensor, and an imaging device are provided. The signal processing apparatus includes a first adjustment unit that adjusts exposure density in an exposure period, and a second adjustment unit that adjusts a start time and an end time of exposure in a frame period, and provides a control signal to control exposure timing by the exposure density between the start time and the end time, to an image sensor including a mechanism to accumulate photoelectrically converted charge a plurality of times separately and then AD-convert and read out total charge, to allow acquisition of a flicker-free high dynamic range image.

公开(公告)号：US20210174127A1

公开(公告)日：2021-06-10

申请号：US16770908

申请日：2018-10-12

Applicant: SONY CORPORATION

Inventor： HAJIME MIHARA ,  SHUN KAIZU ,  TEPPEI KURITA ,  YUHI KONDO ,  YASUTAKA HIRASAWA

IPC: G06K9/46 ,  G06K9/20

Abstract: A polarized image acquisition section 11a acquires a polarized image of a target object having one or more polarization directions. A polarization parameter acquisition section 12-1 calculates the average brightness α of a polarization model on the basis of a non-polarized image subjected to sensitivity correction. Further, the polarization parameter acquisition section 12-1 calculates the amplitude β of the polarization model on the basis of the calculated average brightness α, pre-stored information regarding the zenith angle θ of the normal line of the target object, a refractive index r, and reflectance property information indicative of whether a subject is diffuse reflection or specular reflection. A polarization model detection section 13-1 is able to detect the polarization properties of the target object through the use of an image polarized in one or more polarization directions, by calculating the phase ϕ of the polarization model on the basis of a polarized image of the target object having one or more polarization directions, the average brightness α, and the amplitude β of the polarization model.

公开(公告)号：US20190273856A1

公开(公告)日：2019-09-05

申请号：US16340604

申请日：2017-10-26

Applicant: SONY CORPORATION

Inventor： YASUTAKA HIRASAWA ,  YUHI KONDO ,  HIDEKI OYAIZU ,  SHUN KAIZU ,  TEPPEI KURITA ,  TUO ZHUANG ,  YING LU ,  HAJIME MIHARA

IPC: H04N5/238 ,  H04N5/217

Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided. The image processing device includes: an image input unit that acquires at least three types of images formed with polarization images of different polarizing directions or non-polarization images; an angle input unit that outputs reflection angles that are the angles between the image capturing directions of the acquired images and the plane direction corresponding to the normal direction of the reflecting surface, to an intensity transmittance and intensity reflectance calculation unit; a calculation unit that calculates the respective intensity transmittances and the respective intensity reflectances of S waves and P waves, using the reflection angles; and a reflection component separation unit that removes the reflected light component from the images acquired by the image input unit, using the respective intensity transmittances and the respective intensity reflectances of the S waves and P waves. These processes enable removal of reflected light components from captured images having various reflection angles.

公开(公告)号：US20160344954A1

公开(公告)日：2016-11-24

申请号：US15225276

申请日：2016-08-01

Applicant: SONY CORPORATION

Inventor： SHUN KAIZU ,  TOMOO MITSUNAGA

IPC: H04N5/353 ,  H04N5/355 ,  H04N5/378 ,  H04N5/235

CPC classification number: H04N5/3535 ,  H04N5/2353 ,  H04N5/35554 ,  H04N5/378

Abstract: An image processing apparatus includes an intermediate image generating unit configured to input an image which has been shot with differing exposure times set by region, generates a plurality of exposure pattern images corresponding to differing exposure times based on the input image, and generates a plurality of timing images which are difference images of the plurality of exposure pattern images; and a distortion correction processing unit configured to generate a corrected image equivalent to an exposure processing image at a predetermined exposure time by synthesizing processing of the plurality of timing images.

Abstract translation: 一种图像处理装置包括：中间图像生成单元，被配置为输入由区域设定的不同曝光时间拍摄的图像，根据输入图像生成与不同的曝光时间对应的多个曝光图案图像，并且生成多个 定时图像，其是所述多个曝光图案图像的差分图像; 以及失真校正处理单元，被配置为通过合成多个定时图像的处理，在预定的曝光时间产生与曝光处理图像相当的校正图像。