公开(公告)号：US20190124281A1

公开(公告)日：2019-04-25

申请号：US16226567

申请日：2018-12-19

Applicant: Sony Corporation

Inventor： Tomoo Mitsunaga ,  Shun Kaizu ,  Teppei Kurita ,  Toru Nishi

IPC: H04N5/355 ,  H04N5/235 ,  H04N5/3745 ,  H04N9/04 ,  H04N5/378

Abstract: [Object] The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times.[Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities. Further, a first line in which first pixels having the panchromatic spectral sensitivity are arranged in a two-pixel cycle in a specific direction and a second line in which the first pixels are arranged while deviating by one pixel from the first line in the specific direction are arranged alternately in a direction orthogonal to the specific direction, and pixels having spectral sensitivities different from the spectral sensitivity of the first pixels are arranged in a 2- or 4-pixel cycle in the specific direction for each of the spectral sensitivities and 2-dimensionally constitute a cyclic arrangement of 4×4 pixels in which the first spectral sensitivity pixels are arranged in a checkerboard arrangement.

公开(公告)号：US20150206280A1

公开(公告)日：2015-07-23

申请号：US14415382

申请日：2013-05-21

Applicant: Sony Corporation

Inventor： Hiroaki Ono ,  Teppei Kurita ,  Tomoo Mitsunaga

IPC: G06T3/40 ,  H04N9/04

CPC classification number: G06T3/4015 ,  G06T3/4069 ,  G06T2207/10024 ,  H04N9/045

Abstract: An apparatus and a method are provided which have a simple configuration to perform highly accurate demosaic processing. A local region of interest being a region to be processed is selected from a raw image format, and a standard color image is generated based on an input image. Further, a similar local region is selected which has a phase different from that of the local region of interest, and is determined to have high similarity to the local region of interest based on the standard color image. Further, the local region of interest and the similar local region are combined to generate a local region image set with RGB, having each RGB pixel value set to each pixel position of component pixels of the local region of interest. Further, the local region images set with RGB corresponding to different local regions of interest are combined to generate an RGB image having each RGB pixel value set to each pixel position of component pixels of the input raw image format.

Abstract translation: 提供了具有简单配置以执行高精度去马赛克处理的装置和方法。 从原始图像格式中选择要处理的区域的局部感兴趣区域，并且基于输入图像生成标准彩色图像。 此外，选择与目标局部区域不同的相位的类似的局部区域，并且基于标准彩色图像确定为与感兴趣的局部区域具有高度相似性。 此外，将感兴趣的局部区域和类似的局部区域组合以产生具有RGB的局部区域图像集合，其中将每个RGB像素值设置为感兴趣的局部区域的分量像素的每个像素位置。 此外，组合RGB对应于不同局部感兴趣区域的局部区域图像，以产生RGB输入原始图像格式的分量像素的每个像素位置设置RGB像素值的RGB图像。

公开(公告)号：US11605661B2

公开(公告)日：2023-03-14

申请号：US16763543

申请日：2018-09-18

Applicant: SONY CORPORATION

Inventor： Teppei Kurita ,  Ying Lu ,  Yuhi Kondo ,  Yasutaka Hirasawa

IPC: H01L27/146 ,  H04N5/369 ,  H04N9/04

Abstract: An unpolarized component image generating section generates unpolarized component image signals of specific and non-specific colors. A polarized component image generating section generates polarized component image signals of the specific and non-specific colors. A specific color polarization property detecting section detects polarization properties of the specific color using pixel signals of polarized or unpolarized pixels of the specific color having at least three polarization directions and pixel signals of polarized pixels having two polarization directions. An unpolarized color polarization property detecting section detects polarization properties of the non-specific color on the basis of the polarization properties of the specific color detected by the specific color polarization property detecting section, the pixel signals of the unpolarized pixels of the non-specific color, and the pixel signals of the polarized pixels of the non-specific color having fewer polarization directions than the polarized pixels of the specific color.

公开(公告)号：US10812735B2

公开(公告)日：2020-10-20

申请号：US16340604

申请日：2017-10-26

Applicant: SONY CORPORATION

Inventor： Yasutaka Hirasawa ,  Yuhi Kondo ,  Hideki Oyaizu ,  Shun Kaizu ,  Teppei Kurita ,  Tuo Zhuang ,  Ying Lu ,  Hajime Mihara

IPC: H04N5/238 ,  H04N5/217 ,  H04N5/232 ,  H04N5/225

Abstract: An image processing device and a method that enable removal of reflection component light from images captured from various directions are provided. The image processing device includes: an image input unit that acquires at least three types of images formed with polarization images of different polarizing directions or non-polarization images; an angle input unit that outputs reflection angles that are the angles between the image capturing directions of the acquired images and the plane direction corresponding to the normal direction of the reflecting surface, to an intensity transmittance and intensity reflectance calculation unit; a calculation unit that calculates the respective intensity transmittances and the respective intensity reflectances of S waves and P waves, using the reflection angles; and a reflection component separation unit that removes the reflected light component from the images acquired by the image input unit, using the respective intensity transmittances and the respective intensity reflectances of the S waves and P waves. These processes enable removal of reflected light components from captured images having various reflection angles.

公开(公告)号：US10750136B2

公开(公告)日：2020-08-18

申请号：US16339579

申请日：2017-08-28

Applicant: SONY CORPORATION

Inventor： Shun Kaizu ,  Yasutaka Hirasawa ,  Yuhi Kondo ,  Teppei Kurita ,  Ying Lu

IPC: H04N9/04 ,  H04N5/217 ,  H04N5/235 ,  G06T5/50 ,  H04N5/225 ,  H04N5/232

Abstract: An image pickup unit 20 has a configuration in which non-polarizing pixels and polarizing pixels are disposed, the polarizing pixels being provided per angle in at least two polarization directions. A demosaicing unit 50 generates a non-polarized image, and a polarization component image per polarization direction, from a captured image generated by the image pickup unit 20. A polarization information generating unit 60 generates polarization information indicating the polarization characteristics of a subject included in the captured image, from the non-polarized image and the polarization component image generated by the demosaicing unit 50. As described above, the polarization information is generated with not only the polarization component image but also the highly-sensitive non-polarized image not having a decrease in the amount of light. Therefore, accurate polarization information can be acquired compared to a case where polarization information is generated on the basis of the polarization component image.

公开(公告)号：US10015417B2

公开(公告)日：2018-07-03

申请号：US14905794

申请日：2014-07-11

Applicant: Sony Corporation

Inventor： Tomoo Mitsunaga ,  Shun Kaizu ,  Teppei Kurita ,  Toru Nishi

IPC: H04N5/355 ,  H04N9/04 ,  H04N5/235 ,  H04N5/378 ,  H04N5/3745

CPC classification number: H04N5/35563 ,  H04N5/2353 ,  H04N5/2355 ,  H04N5/35518 ,  H04N5/35554 ,  H04N5/37457 ,  H04N5/378 ,  H04N9/045

Abstract: [Object] The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times.[Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities. Further, a first line in which first pixels having the panchromatic spectral sensitivity are arranged in a two-pixel cycle in a specific direction and a second line in which the first pixels are arranged while deviating by one pixel from the first line in the specific direction are arranged alternately in a direction orthogonal to the specific direction, and pixels having spectral sensitivities different from the spectral sensitivity of the first pixels are arranged in a 2- or 4-pixel cycle in the specific direction for each of the spectral sensitivities and 2-dimensionally constitute a cyclic arrangement of 4×4 pixels in which the first spectral sensitivity pixels are arranged in a checkerboard arrangement.

公开(公告)号：US10003745B2

公开(公告)日：2018-06-19

申请号：US15320782

申请日：2015-06-23

Applicant: SONY CORPORATION

Inventor： Daisuke Iso ,  Hideshi Yamada ,  Teppei Kurita

IPC: H04N5/232 ,  H04N5/347 ,  H04N5/3745 ,  H04N5/345

CPC classification number: H04N5/23274 ,  G03B7/00 ,  G03B17/00 ,  G03B2207/005 ,  G03B2217/005 ,  H04N5/23254 ,  H04N5/23258 ,  H04N5/23264 ,  H04N5/2353 ,  H04N5/345 ,  H04N5/347 ,  H04N5/3535 ,  H04N5/3745

Abstract: The present disclosure relates to an imaging apparatus, an imaging method and a program, and a reproduction apparatus according to which an image sensor is divided into a plurality of areas and exposure control may be performed for each area according to the amount of camera shake. An imaging apparatus which is an aspect of the present disclosure includes an image sensor unit for generating pixel data of a pixel constituting a frame by photoelectric conversion, a calculation unit for calculating an amount of camera shake in each of areas obtained by dividing the frame, and a control unit for controlling exposure time of the image sensor for each of the areas according to the amount of camera shake calculated for each of the areas. The present disclosure is applicable to an electronic device such as a camera including an area ADC type image sensor, for example.

公开(公告)号：US20130266219A1

公开(公告)日：2013-10-10

申请号：US13780243

申请日：2013-02-28

Applicant: SONY CORPORATION

Inventor： Teppei Kurita ,  Tomoo Mitsunaga

IPC: G06T5/00

CPC classification number: G06T5/002 ,  G06T5/008 ,  G06T2207/10024

Abstract: There is provided an image processing apparatus including a representative pixel calculation unit configured to select some pixels in an input image as representative pixels, a representative pixel update unit configured to update pixel values of the representative pixels, and a corrected image generation unit configured to set pixel values for pixels other than the representative pixels by applying the updated pixel values of the representative pixels. The representative pixel update unit is configured to, based on pixels around a position of the representative pixels in a smoothed image generated based on the input image as reference pixels, execute pixel value correction of the representative pixels by applying the pixel values of the reference pixels.

Abstract translation: 提供了一种图像处理装置，包括：代表像素计算单元，被配置为选择输入图像中的一些像素作为代表像素;代表像素更新单元，被配置为更新代表像素的像素值;以及校正图像生成单元， 通过应用代表像素的更新像素值，代表像素以外的像素的像素值。 代表像素更新单元被配置为基于基于作为参考像素的输入图像生成的平滑图像中的代表像素的位置周围的像素，通过应用参考像素的像素值来执行代表像素的像素值校正 。

公开(公告)号：US11663831B2

公开(公告)日：2023-05-30

申请号：US16770908

申请日：2018-10-12

Applicant: SONY CORPORATION

Inventor： Hajime Mihara ,  Shun Kaizu ,  Teppei Kurita ,  Yuhi Kondo ,  Yasutaka Hirasawa

IPC: G06K9/46 ,  G06V10/60 ,  G06V10/56 ,  G06V10/145 ,  G06V10/147 ,  G06V10/10 ,  G06V10/30

CPC classification number: G06V10/60 ,  G06V10/10 ,  G06V10/145 ,  G06V10/147 ,  G06V10/30 ,  G06V10/56

Abstract: A polarized image acquisition section 11a acquires a polarized image of a target object having one or more polarization directions. A polarization parameter acquisition section 12-1 calculates the average brightness α of a polarization model on the basis of a non-polarized image subjected to sensitivity correction. Further, the polarization parameter acquisition section 12-1 calculates the amplitude β of the polarization model on the basis of the calculated average brightness α, pre-stored information regarding the zenith angle θ of the normal line of the target object, a refractive index r, and reflectance property information indicative of whether a subject is diffuse reflection or specular reflection. A polarization model detection section 13-1 is able to detect the polarization properties of the target object through the use of an image polarized in one or more polarization directions, by calculating the phase ϕ of the polarization model on the basis of a polarized image of the target object having one or more polarization directions, the average brightness α, and the amplitude β of the polarization model.

公开(公告)号：US11108951B2

公开(公告)日：2021-08-31

申请号：US16619170

申请日：2018-04-09

Applicant: SONY CORPORATION

Inventor： Teppei Kurita ,  Shun Kaizu ,  Yasutaka Hirasawa

IPC: H04N5/232 ,  H04N5/235 ,  H04N9/04 ,  H04N5/341

Abstract: In an image capturing unit 20, an imaging element has a 4×4-pixel area in which: pixels including at least one pixel of every color component of a plurality of color components are polarization pixels of the same polarization direction; and pixels which are not the polarization pixels constitute a majority of the 4×4-pixel area, and are non-polarization pixels. The unpolarized component calculating unit 31 of the image processing unit 30 calculates unpolarized components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit 20. The diffuse reflection component calculating unit 32 calculates diffuse reflection components for each pixel and for each color component by using pixel signals of polarization pixels, and pixel signals of non-polarization pixels that are generated at the image capturing unit 20.