公开(公告)号：US20180160060A1

公开(公告)日：2018-06-07

申请号：US15885701

申请日：2018-01-31

Applicant: Sony Corporation

Inventor： Tomoo Mitsunaga ,  Shun Kaizu ,  Teppei Kurita ,  Toru Nishi

IPC: H04N5/355 ,  H04N9/04 ,  H04N5/378 ,  H04N5/3745 ,  H04N5/235

CPC classification number: H04N5/35563 ,  H04N5/2353 ,  H04N5/2355 ,  H04N5/35518 ,  H04N5/35554 ,  H04N5/37457 ,  H04N5/378 ,  H04N9/045

Abstract: [Object] The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times.[Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities. Further, a first line in which first pixels having the panchromatic spectral sensitivity are arranged in a two-pixel cycle in a specific direction and a second line in which the first pixels are arranged while deviating by one pixel from the first line in the specific direction are arranged alternately in a direction orthogonal to the specific direction, and pixels having spectral sensitivities different from the spectral sensitivity of the first pixels are arranged in a 2- or 4-pixel cycle in the specific direction for each of the spectral sensitivities and 2-dimensionally constitute a cyclic arrangement of 4×4 pixels in which the first spectral sensitivity pixels are arranged in a checkerboard arrangement.

公开(公告)号：US20190124281A1

公开(公告)日：2019-04-25

申请号：US16226567

申请日：2018-12-19

Applicant: Sony Corporation

Inventor： Tomoo Mitsunaga ,  Shun Kaizu ,  Teppei Kurita ,  Toru Nishi

IPC: H04N5/355 ,  H04N5/235 ,  H04N5/3745 ,  H04N9/04 ,  H04N5/378

Abstract: [Object] The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times.[Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities. Further, a first line in which first pixels having the panchromatic spectral sensitivity are arranged in a two-pixel cycle in a specific direction and a second line in which the first pixels are arranged while deviating by one pixel from the first line in the specific direction are arranged alternately in a direction orthogonal to the specific direction, and pixels having spectral sensitivities different from the spectral sensitivity of the first pixels are arranged in a 2- or 4-pixel cycle in the specific direction for each of the spectral sensitivities and 2-dimensionally constitute a cyclic arrangement of 4×4 pixels in which the first spectral sensitivity pixels are arranged in a checkerboard arrangement.

公开(公告)号：US10171750B2

公开(公告)日：2019-01-01

申请号：US15326259

申请日：2015-07-10

Applicant: SONY CORPORATION

Inventor： Taro Sugizaki ,  Go Yamanaka ,  Daisuke Yoshioka ,  Toru Nishi ,  Yousuke Horie ,  Takesi Kozasa ,  Keneki Go ,  Norihiro Ichimaru ,  Naoki Hosoi

IPC: H04N5/243 ,  H04N5/355 ,  H04N5/357 ,  H01L27/146 ,  H04N5/235 ,  H04N5/353 ,  H04N5/369 ,  H04N5/378 ,  H04N9/04 ,  H04N9/07

Abstract: The present technology relates to a solid-state image sensor, an imaging control method, a signal processing method, and an electronic apparatus that suppress the deterioration of image quality, which is caused by the difference of sensitivity between pixels. A solid-state image sensor includes: a pixel array unit including a plurality of pixels arranged, the plurality of pixels including a plurality of kinds of pixels, the plurality of kinds of pixels including a first pixel and a second pixel, the first pixel having the highest sensitivity, the second pixel having a sensitivity lower than the sensitivity of the first pixel; and a control unit that controls at least one of an analog gain and exposure time of/for the respective pixels depending on a ratio between the sensitivities of the first pixel and the second pixel. The present technology is applicable to a solid-state image sensor such as a CMOS image sensor.

公开(公告)号：US10015417B2

公开(公告)日：2018-07-03

申请号：US14905794

申请日：2014-07-11

Applicant: Sony Corporation

Inventor： Tomoo Mitsunaga ,  Shun Kaizu ,  Teppei Kurita ,  Toru Nishi

IPC: H04N5/355 ,  H04N9/04 ,  H04N5/235 ,  H04N5/378 ,  H04N5/3745

CPC classification number: H04N5/35563 ,  H04N5/2353 ,  H04N5/2355 ,  H04N5/35518 ,  H04N5/35554 ,  H04N5/37457 ,  H04N5/378 ,  H04N9/045

Abstract: [Object] The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times.[Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities. Further, a first line in which first pixels having the panchromatic spectral sensitivity are arranged in a two-pixel cycle in a specific direction and a second line in which the first pixels are arranged while deviating by one pixel from the first line in the specific direction are arranged alternately in a direction orthogonal to the specific direction, and pixels having spectral sensitivities different from the spectral sensitivity of the first pixels are arranged in a 2- or 4-pixel cycle in the specific direction for each of the spectral sensitivities and 2-dimensionally constitute a cyclic arrangement of 4×4 pixels in which the first spectral sensitivity pixels are arranged in a checkerboard arrangement.

公开(公告)号：US20130301928A1

公开(公告)日：2013-11-14

申请号：US13887021

申请日：2013-05-03

Applicant: SONY CORPORATION

Inventor： Paul Springer ,  Toru Nishi ,  Matthias Bruggemann

IPC: G06T5/00

CPC classification number: G06T5/00 ,  G06T7/246 ,  G06T2207/10016

Abstract: An apparatus for determining the reliability of shift vectors between two images comprises an image compensation unit for compensating local shifts between a first image and a second image and to obtain a compensated second image. A similarity estimation unit is provided for determining a similarity information by determining one or more similarity measures between said first image and said compensated second image. A vector consistency check device for comparing shift vectors describing the shift between said first image and said second image from different shift estimation directions to obtain a consistency weight information, and a combination unit for combining said similarity information and said consistency weight information to obtain a reliability information describing the reliability of said shift vectors are provided.

Abstract translation: 用于确定两个图像之间的移动矢量的可靠性的装置包括用于补偿第一图像和第二图像之间的局部移位并获得补偿的第二图像的图像补偿单元。 提供相似性估计单元，用于通过确定所述第一图像和所述补偿后的第二图像之间的一个或多个相似性度量来确定相似度信息。 一种矢量一致性检查装置，用于比较描述从不同移位估计方向的所述第一图像和所述第二图像之间的偏移的移动矢量以获得一致性加权信息的组合单元，以及用于组合所述相似度信息和所述一致性权重信息以获得可靠性 提供描述所述移位向量的可靠性的信息。

公开(公告)号：US10200639B2

公开(公告)日：2019-02-05

申请号：US15885701

申请日：2018-01-31

Applicant: Sony Corporation

Inventor： Tomoo Mitsunaga ,  Shun Kaizu ,  Teppei Kurita ,  Toru Nishi

IPC: H04N5/355 ,  H04N9/04 ,  H04N5/235 ,  H04N5/378 ,  H04N5/374 ,  H04N5/3745

Abstract: [Object] The present technique relates to an image pickup device, an image pickup method, and a program that enables pixels having 4 types of spectral sensitivities to be controlled while changing exposure times.[Solving Means] The present technique is applicable to an image pickup device including pixels having 4 types of spectral sensitivities, that include pixels having a panchromatic spectral sensitivity and are arranged on an image pickup surface, pixels that realize a first exposure and pixels that realize a second exposure different from the first exposure being arranged on the image pickup surface with respect to the 4 types of spectral sensitivities. Further, a first line in which first pixels having the panchromatic spectral sensitivity are arranged in a two-pixel cycle in a specific direction and a second line in which the first pixels are arranged while deviating by one pixel from the first line in the specific direction are arranged alternately in a direction orthogonal to the specific direction, and pixels having spectral sensitivities different from the spectral sensitivity of the first pixels are arranged in a 2- or 4-pixel cycle in the specific direction for each of the spectral sensitivities and 2-dimensionally constitute a cyclic arrangement of 4×4 pixels in which the first spectral sensitivity pixels are arranged in a checkerboard arrangement.

公开(公告)号：US20150181204A1

公开(公告)日：2015-06-25

申请号：US14413941

申请日：2013-06-03

Applicant: Sony Corporation

Inventor： Toru Nishi ,  Oliver Erdler ,  Thimo Emmerrich

IPC: H04N13/04

CPC classification number: H04N13/31 ,  H04N13/128 ,  H04N13/30

Abstract: A stereoscopic effect of an interpolation image is stabilized by properly performing, on a parallax image, processing of expanding a parallax of an object in a foreground toward a background at a boundary of the object.A flat portion detection unit 701 detects a flat portion within an original image frame on the basis of a luminance signal or the like. A MIN filter 702 performs the processing of expanding the parallax in the foreground toward the background with respect to only the flat portion on the basis of the detected signal from the flat portion detection unit 701, whereby the application of the MIN filter 702 to a non-flat portion is inhibited. A MAX filter 703 then performs processing of expanding the parallax in the foreground toward the background on the parallax image processed by the MIN filter 702.

Abstract translation: 通过在视差图像上适当地执行将物体在前景中的视差扩展到物体边界处的背景的处理，来稳定内插图像的立体效果。 平坦部分检测单元701基于亮度信号等检测原始图像帧内的平坦部分。 MIN滤波器702基于来自平坦部分检测单元701的检测信号，执行仅使平坦部分在前景朝向背景扩展视差的处理，由此将MIN滤波器702应用于非平坦部分 - 平坦部分被抑制。 然后，MAX滤波器703执行在由MIN滤波器702处理的视差图像上将前景中的视差扩展到背景的处理。

公开(公告)号：US20130301949A1

公开(公告)日：2013-11-14

申请号：US13886807

申请日：2013-05-03

Applicant: SONY CORPORATION

Inventor： Paul Springer ,  Toru Nishi ,  Matthias Bruggemann

IPC: G06T5/00

CPC classification number: G06T5/00 ,  G06T5/004 ,  G06T5/50 ,  G06T2207/10016 ,  G06T2207/20182 ,  G06T2207/20221

Abstract: An image enhancement apparatus for enhancing an input image of a sequence of input images of at least a first view and obtaining an enhanced output image of at least said first view comprises an unsharp masking unit configured to enhance the sharpness of the input image, a motion compensation unit configured to generate at least one preceding motion compensated image by compensating motion in a preceding output image, a weighted selection unit configured to generate a weighted selection image from said sharpness enhanced input image and said preceding motion compensated image based on selection weighting factor, a detail signal generation unit configured to generate a detail signal from said input image and said weighted selection image, and a combination unit configured to generate said enhanced output image from said detail signal and from said input image and/or said weighted selection image.

Abstract translation: 一种用于增强至少第一视图的输入图像序列的输入图像并获得至少所述第一视图的增强输出图像的图像增强装置包括：非锐化蒙版单元，被配置为增强输入图像的清晰度，运动 补偿单元，被配置为通过补偿先前输出图像中的运动来生成至少一个前述运动补偿图像;加权选择单元，被配置为基于选择加权因子从所述锐度增强输入图像和所述先前运动补偿图像生成加权选择图像， 详细信号生成单元，被配置为从所述输入图像和所述加权选择图像生成细节信号，以及组合单元，被配置为从所述细节信号和所述输入图像和/或所述加权选择图像生成所述增强输出图像。