Imaging systems and methods for generating motion-compensated high-dynamic-range images

    公开(公告)号:US09883125B2

    公开(公告)日:2018-01-30

    申请号:US14563887

    申请日:2014-12-08

    发明人: Huai Dong Li Peng Lin

    摘要: Electronic devices may include image sensors. Image sensors may be used to capture images having rows of long-exposure image pixel values that are interleaved with rows of short-exposure image pixel values. The long-exposure and short-exposure values in each interleaved image frame may be interpolated to form interpolated values. A combined long-exposure image and a combined short-exposure image may be generated using the long-exposure and the short-exposure values from the interleaved image frames and the interpolated values from a selected one of the interleaved image frames. The combined long-exposure and short-exposure images may each include image pixel values from either of the interleaved image frames in a non-motion edge region and image pixel values based only on the image pixel values or the interpolated values from the selected one of the interleaved images in a motion or non-edge region. High-dynamic-range images may be generated using the combined long-exposure and short-exposure images.

    Systems and methods for generating interpolated high-dynamic-range images
    2.
    发明授权
    Systems and methods for generating interpolated high-dynamic-range images 有权
    用于生成内插高动态范围图像的系统和方法

    公开(公告)号:US09007488B2

    公开(公告)日:2015-04-14

    申请号:US13786199

    申请日:2013-03-05

    发明人: Huai Dong Li

    摘要: Electronic devices may have camera modules that include an image sensor and processing circuitry. The image sensor may capture an interleaved image having rows of long-exposure pixel values that are interleaved with rows of short-exposure pixel values. The image sensor may separate the interleaved image into first and second images each having empty image pixel values. The processing circuitry may generate interpolated long-exposure and interpolated short-exposure images by generating chroma-filtered interpolated pixel values for the empty pixel values in the first and second images. The processing circuitry may perform interpolation operations along one or more directions for the empty image pixels based on whether the empty image pixels are within a texture area or on a dominant edge of the captured image. The processing circuitry may combine the interpolated long-exposure image and the interpolated short-exposure image to generate a high-dynamic-range image.

    摘要翻译: 电子设备可以具有包括图像传感器和处理电路的相机模块。 图像传感器可以捕获具有与短曝光像素值行交错的长曝光像素值行的交错图像。 图像传感器可以将交织的图像分离成具有空的图像像素值的第一和第二图像。 处理电路可以通过对第一和第二图像中的空的像素值生成色度滤波的内插像素值来生成内插的长曝光和内插的短曝光图像。 处理电路可以基于空图像像素是否在纹理区域内或在捕获图像的主要边缘上,针对空图像像素沿着一个或多个方向执行插值操作。 处理电路可以组合内插的长曝光图像和内插的短曝光图像以产生高动态范围图像。

    Imaging systems and methods for generating auto-exposed high-dynamic-range images
    3.
    发明授权
    Imaging systems and methods for generating auto-exposed high-dynamic-range images 有权
    用于生成自动曝光的高动态范围图像的成像系统和方法

    公开(公告)号:US09172889B2

    公开(公告)日:2015-10-27

    申请号:US13755988

    申请日:2013-01-31

    发明人: Huai Dong Li Peng Lin

    IPC分类号: H04N5/235 H04N5/355

    摘要: Electronic devices may have camera modules that include an image sensor and processing circuitry. The image sensor may capture an image from a scene. The processing circuitry may extract image statistics and exposure levels from the image. The processing circuitry may use the image statistics and the exposure levels to generate a first exposure time, a second exposure time, and gain settings for the image sensor. The image sensor may capture additional images from the scene having long-exposure image pixel values that are captured using the first exposure time and short-exposure image pixel values that are captured using the second exposure time. The processing circuitry may generate a long-exposure image and a short-exposure image from the second image. The processing circuitry may generate auto-exposed high-dynamic-range images of the scene using the long-exposure image and the short-exposure image.

    摘要翻译: 电子设备可以具有包括图像传感器和处理电路的相机模块。 图像传感器可以从场景捕获图像。 处理电路可以从图像提取图像统计和曝光水平。 处理电路可以使用图像统计和曝光水平来生成图像传感器的第一曝光时间,第二曝光时间和增益设置。 图像传感器可以从具有使用第一曝光时间拍摄的长曝光图像像素值和使用第二曝光时间捕获的短曝光图像像素值的场景拍摄附加图像。 处理电路可以产生来自第二图像的长曝光图像和短曝光图像。 处理电路可以使用长曝光图像和短曝光图像来生成场景的自动曝光的高动态范围图像。

    IMAGING SYSTEMS AND METHODS FOR GENERATING MOTION-COMPENSATED HIGH-DYNAMIC-RANGE IMAGES
    4.
    发明申请
    IMAGING SYSTEMS AND METHODS FOR GENERATING MOTION-COMPENSATED HIGH-DYNAMIC-RANGE IMAGES 有权
    用于产生运动补偿高动态范围图像的成像系统和方法

    公开(公告)号:US20150092079A1

    公开(公告)日:2015-04-02

    申请号:US14563887

    申请日:2014-12-08

    发明人: Huai Dong Li Peng Lin

    IPC分类号: H04N5/355

    摘要: Electronic devices may include image sensors. Image sensors may be used to capture images having rows of long-exposure image pixel values that are interleaved with rows of short-exposure image pixel values. The long-exposure and short-exposure values in each interleaved image frame may be interpolated to form interpolated values. A combined long-exposure image and a combined short-exposure image may be generated using the long-exposure and the short-exposure values from the interleaved image frames and the interpolated values from a selected one of the interleaved image frames. The combined long-exposure and short-exposure images may each include image pixel values from either of the interleaved image frames in a non-motion edge region and image pixel values based only on the image pixel values or the interpolated values from the selected one of the interleaved images in a motion or non-edge region. High-dynamic-range images may be generated using the combined long-exposure and short-exposure images.

    摘要翻译: 电子设备可以包括图像传感器。 图像传感器可用于捕获具有与短曝光图像像素值行交错的长曝光图像像素值行的图像。 每个交错图像帧中的长曝光和短曝光值可被内插以形成内插值。 组合的长曝光图像和组合的短曝光图像可以使用来自交织的图像帧的长曝光值和短曝光值以及来自所选交织图像帧中的内插值来生成。 组合的长曝光和短曝光图像可以各自包括来自非运动边缘区域中的交织图像帧中的任一个的图像像素值,以及仅基于图像像素值的图像像素值或来自所选择的图像像素值的内插值 运动或非边缘区域中的交错图像。 可以使用组合的长曝光和短曝光图像来生成高动态范围图像。

    Imaging systems and methods for generating binned high-dynamic-range images
    5.
    发明授权
    Imaging systems and methods for generating binned high-dynamic-range images 有权
    用于生成叠加的高动态范围图像的成像系统和方法

    公开(公告)号:US09438827B2

    公开(公告)日:2016-09-06

    申请号:US14459213

    申请日:2014-08-13

    发明人: Huai Dong Li

    摘要: Electronic devices may include image sensors that capture interleaved images having rows of long-exposure pixel values interleaved with rows of short-exposure pixel values. Processing circuitry in the electronic device may (spatially) partition the interleaved images into multiple bins. The processing circuitry may generate a weighted long-exposure pixel value for each bin and a weighted short-exposure pixel value for each bin. The weighted long and short exposure values in each bin may be combined to generate a binned high-dynamic-range (HDR) pixel value for that bin. The processing circuitry may output a binned HDR image formed from the binned HDR pixel values to additional circuitry such as video processing circuitry for performing additional image processing operations. If desired, the image sensor and processing circuitry may be combined into an integrated structure that generates a single binned HDR pixel value and multiple integrated structures may be used.

    摘要翻译: 电子设备可以包括图像传感器,其捕获具有与短曝光像素值行交错的长曝光像素值行的交错图像。 电子设备中的处理电路可以(空间地)将交错的图像分割成多个分区。 处理电路可以为每个仓生成加权的长曝光像素值,并为每个仓生成加权的短曝光像素值。 可以组合每个仓中的加权的长曝光值和短曝光值,以生成用于该纸盒的合并高动态范围(HDR)像素值。 处理电路可以将从分组的HDR像素值形成的二进制HDR图像输出到附加电路,例如用于执行附加图像处理操作的视频处理电路。 如果需要,图像传感器和处理电路可以被组合成一个集成的结构,其生成单个分组的HDR像素值,并且可以使用多个集成结构。