RGB-RWB dual images by multi-layer sensors towards better image quality

    公开(公告)号:US09712792B2

    公开(公告)日:2017-07-18

    申请号:US14924704

    申请日:2015-10-27

    IPC分类号: H04N9/04 H04N5/225 H04N9/64

    摘要: Using improved Image Signal Processing (ISP) along with a multi-layer Color Filter Array (CFA) architecture to capture both the Red-Green-Blue (RGB) as well as the Red-X-Blue (RXB) images substantially simultaneously on the same Complementary Metal Oxide Semiconductor (CMOS) image sensor chip in a single shot so that subsequent image processing stage(s) can choose between RGB and RXB images to improve the quality of the final image. The color “X” in the RXB image may be a white color, a yellow color, or a cyan color. In contrast to the individual RWB or RGB imaging based conventional CMOS sensors, the disclosed CMOS sensor with one or more layers of specifically-selected CFAs can capture both the RGB and RXB images in a single shot using associated ISP. The multi-layer sensor may be an organic sensor or a stacked X3 sensor. The dual RGB-RXB imaging may reduce colorblindness, chromatic aberration, and saturation artifacts.

    TIMESTAMP CALIBRATION OF THE 3D CAMERA WITH EPIPOLAR LINE LASER POINT SCANNING
    3.
    发明申请
    TIMESTAMP CALIBRATION OF THE 3D CAMERA WITH EPIPOLAR LINE LASER POINT SCANNING 审中-公开
    三维相机的TIMESTAMP校准与EPIPOLAR线激光点扫描

    公开(公告)号:US20160309140A1

    公开(公告)日:2016-10-20

    申请号:US14973709

    申请日:2015-12-17

    摘要: Using the same image sensor to capture a two-dimensional (2D) image and three-dimensional (3D) depth measurements for a 3D object. A laser point-scans the surface of the object with light spots, which are detected by a pixel array in the image sensor to generate the 3D depth profile of the object using triangulation. Each row of pixels in the pixel array forms an epipolar line of the corresponding laser scan line. Timestamping provides a correspondence between the pixel location of a captured light spot and the respective scan angle of the laser to remove any ambiguity in triangulation. An Analog-to-Digital Converter (ADC) in the image sensor operates as a Time-to-Digital (TDC) converter to generate timestamps. A timestamp calibration circuit is provided on-board to record the propagation delay of each column of pixels in the pixel array and to provide necessary corrections to the timestamp values generated during 3D depth measurements.

    摘要翻译: 使用相同的图像传感器捕获3D对象的二维(2D)图像和三维(3D)深度测量。 激光点通过光斑扫描物体的表面,该光点由图像传感器中的像素阵列检测,以使用三角测量生成对象的3D深度轮廓。 像素阵列中的每行像素形成对应的激光扫描线的核线。 时间戳提供捕获的光点的像素位置和激光的相应扫描角之间的对应关系,以消除三角测量中的任何歧义。 图像传感器中的模数转换器(ADC)用作时间数字(TDC)转换器来产生时间戳。 在板上提供时间戳校准电路以记录像素阵列中每列像素的传播延迟,并为3D深度测量期间产生的时间戳值提供必要的校正。

    Super-resolution in processing images such as from multi-layer sensors
    4.
    发明授权
    Super-resolution in processing images such as from multi-layer sensors 有权
    处理像多层传感器等图像的超分辨率

    公开(公告)号:US09392166B2

    公开(公告)日:2016-07-12

    申请号:US14191417

    申请日:2014-02-26

    IPC分类号: H04N5/232 H04N5/335 G06T3/40

    摘要: Pixels of an array capture values for an input image. The captured values correspond to pixel center points of the pixels that captured the values. Additional values about the input image may be further computed from the captured values. These additional values may correspond to additional center points, which can be different from any of the pixel center points. An output image may be constructed from the captured values plus the additional values. These values may be stored together and/or displayed together as the output image. Embodiments are applicable to images such as from multi-layer sensors. Since the output image can be created from a higher total number of values than those captured by the available number of pixels, such image processing can be called super-resolution, and can be applied to image processing within imaging devices, for still pictures, video and motion pictures, and so on.

    摘要翻译: 数组的像素捕获输入图像的值。 捕获的值对应于捕获值的像素的像素中心点。 可以从捕获的值进一步计算关于输入图像的附加值。 这些附加值可以对应于可以与任何像素中心点不同的附加中心点。 可以从捕获的值加上附加值来构建输出图像。 这些值可以一起存储在一起和/或一起显示为输出图像。 实施例适用于诸如来自多层传感器的图像。 由于输出图像可以由比可用数量的像素捕获的数值更高的总数创建,所以这种图像处理可以被称为超分辨率,并且可以应用于成像设备内的图像处理,用于静止图像,视频 和动态影像等。

    CORRECTION OF DEPTH IMAGES FROM T-O-F 3D CAMERA WITH ELECTRONIC-ROLLING-SHUTTER FOR LIGHT MODULATION CHANGES TAKING PLACE DURING LIGHT INTEGRATION
    5.
    发明申请
    CORRECTION OF DEPTH IMAGES FROM T-O-F 3D CAMERA WITH ELECTRONIC-ROLLING-SHUTTER FOR LIGHT MODULATION CHANGES TAKING PLACE DURING LIGHT INTEGRATION 审中-公开
    来自T-O-F 3D摄像机的深度图像的校正与电子滚动快门在轻型整合期间进行轻调制变化

    公开(公告)号:US20160198147A1

    公开(公告)日:2016-07-07

    申请号:US14883598

    申请日:2015-10-14

    IPC分类号: H04N13/02 G01S17/89

    摘要: In embodiments, a T-O-F depth imaging device renders a depth image of an object that has corrected depth values. The device includes a pixel array that uses an Electronic Rolling Shutter scheme. The device also includes a light source that transmits towards the object light that is modulated at an operating frequency, and an optical shutter that opens and closes at the operating frequency. The optical shutter further modulates the light that is reflected from the object, before it reaches the pixel array. The transmission of the light and the operation of the shutter change phase relative to each other while at least one of the pixels is sensing the light it receives, which permits a faster frame rate. Depth is determined by the amount of light sensed by the pixels, and a correction is computed to compensate for the changing phase.

    摘要翻译: 在实施例中,T-O-F深度成像装置呈现具有校正深度值的对象的深度图像。 该装置包括使用电子滚动快门方案的像素阵列。 该装置还包括朝向在工作频率被调制的物体光发射的光源,以及以工作频率打开和关闭的光学快门。 光学快门在到达像素阵列之前进一步调制从物体反射的光。 当至少一个像素感测到其接收到的光时,光的传输和快门改变阶段的操作相对于彼此的操作,这允许更快的帧速率。 深度由像素感测的光量确定,并且计算校正以补偿变化相位。

    Method and apparatus for image noise reduction using noise models

    公开(公告)号:US08442345B2

    公开(公告)日:2013-05-14

    申请号:US13330041

    申请日:2011-12-19

    申请人: Ilia Ovsiannikov

    发明人: Ilia Ovsiannikov

    IPC分类号: G06K9/00

    CPC分类号: H04N5/217 G06T5/002

    摘要: A method and apparatus for processing imager pixel signals to reduce noise. The processing includes receiving a target pixel signal, receiving at least one neighboring pixel signal, formulating a dynamic noise signal based at least in part on a value of the target pixel signal, and controlling a noise reduction operation using the dynamic noise signal.

    Method and apparatus for applying tonal correction to images
    9.
    发明授权
    Method and apparatus for applying tonal correction to images 有权
    对图像进行色调校正的方法和装置

    公开(公告)号:US08400522B2

    公开(公告)日:2013-03-19

    申请号:US13100813

    申请日:2011-05-04

    申请人: Ilia Ovsiannikov

    发明人: Ilia Ovsiannikov

    IPC分类号: H04N5/228

    CPC分类号: H04N1/4072

    摘要: A method and apparatus for applying tonal correction to images to obtain a more pleasing photographic image by redistributing low-key, mid-tone and high-key tones. Luminance is calculated by using formulas appropriate for the color space or directly inputted. Two color-difference components are computed for the original image. Luminance is subjected to a tonal correction function to obtain a tonal corrected luminance. Luminance gain is calculated and applied to the color-difference components to obtain two tonal corrected color-difference components. The tonal corrected luminance and two tonal corrected color-difference components can be directly output or used to calculate three color component signals for the desired color space.

    摘要翻译: 一种用于对图像应用色调校正以通过重新分配低调,中音和高音音调来获得更令人愉快的摄影图像的方法和装置。 通过使用适合颜色空间或直接输入的公式计算亮度。 为原始图像计算两个色差分量。 亮度经受色调校正功能以获得色调校正亮度。 计算亮度增益并将其应用于色差分量,以获得两个色调校正的色差分量。 色调校正亮度和两个色调校正色差分量可直接输出或用于计算所需颜色空间的三色分量信号。

    Methods and apparatuses that reduce noise in image signals
    10.
    发明授权
    Methods and apparatuses that reduce noise in image signals 有权
    降低图像信号噪声的方法和装置

    公开(公告)号:US07876957B2

    公开(公告)日:2011-01-25

    申请号:US11806491

    申请日:2007-05-31

    IPC分类号: G06K9/00

    CPC分类号: H04N9/045 H04N2209/046

    摘要: Methods and apparatuses for noise reduction include embodiments that use a weighted combination based on the presence of edges of two calculated demosaiced signals to produce a noise reduced signal. The noise reduced signal may be sharpened based on a calculated luminance of the two demosaiced signals.

    摘要翻译: 用于降噪的方法和装置包括基于两个计算的去马赛克信号的边缘的存在使用加权组合以产生降噪信号的实施例。 基于所计算的两个去马赛克信号的亮度,降噪信号可以被削弱。