Method and system for tuning a camera image signal processor for computer vision tasks

    公开(公告)号:US11849212B2

    公开(公告)日:2023-12-19

    申请号:US17677919

    申请日:2022-02-22

    申请人: ALGOLUX INC.

    IPC分类号: H04N23/60

    CPC分类号: H04N23/64

    摘要: Image Signal Processing (ISP) optimization framework for computer vision applications is disclosed. The tuning of the ISP is performed automatically and presented as a nonlinear multi-objective optimization problem, followed by solving the problem using an evolutionary stochastic solver. An improved ISP of the embodiments of the invention includes at least features of search space reduction for reducing a number of ISP configurations, remapping the generated population to the reduced search space via mirroring, and global optimization function processing, which allow tuning all the blocks of the ISP at the same time instead of the prior art tuning of each ISP block separately. Also shown that an ISP tuned for image quality performs inferior compared with an ISP trained for a specific downstream image recognition task.

    METHOD FOR PROVIDING AN ESTIMATION OF A POINT SPREAD FUNCTION INDICATIVE OF INTRINSIC CAMERA BLUR
    2.
    发明申请
    METHOD FOR PROVIDING AN ESTIMATION OF A POINT SPREAD FUNCTION INDICATIVE OF INTRINSIC CAMERA BLUR 有权
    提供内在摄像机显示点消除功能的估计方法

    公开(公告)号:US20160301922A1

    公开(公告)日:2016-10-13

    申请号:US15093501

    申请日:2016-04-07

    申请人: Algolux Inc.

    IPC分类号: H04N17/00 G06T7/00

    CPC分类号: H04N17/002 G06T5/003 G06T5/50

    摘要: A method for determining a point spread function (PSF) of a camera, comprising: displaying on a display at least two images comprising visual features, elements having a different optical intensity, and a test pattern; acquiring the images using the camera; determining a coordinate transformation using the image comprising the visual features and its corresponding acquired image, the coordinate transformation for aligning together a coordinate system of the camera and a coordinate system of the display; aligning the acquired image comprising the elements having a different optical intensity using the determined coordinate system and determining a difference of intensity between the displayed image comprising the elements having a different optical intensity and the corresponding acquired image; aligning the acquired image comprising the test pattern and correcting an intensity of the acquired image comprising the test pattern, thereby obtaining a corrected image; and estimating a PSF using the corrected image.

    摘要翻译: 一种用于确定相机的点扩散函数(PSF)的方法,包括:在显示器上显示包括视觉特征,具有不同光强度的元件和测试图案的至少两个图像; 使用相机获取图像; 使用包括视觉特征及其对应的获取图像的图像来确定坐标变换,用于将相机的坐标系和显示器的坐标系对准的坐标变换; 使用所确定的坐标系对准包含具有不同光强度的元件的获取图像,并且确定包括具有不同光强度的元件的显示图像与相应的获取图像之间的强度差; 对准包含测试图案的获取图像并校正包含测试图案的所获取图像的强度,从而获得校正图像; 以及使用校正图像来估计PSF。

    Method and system for tuning a camera image signal processor for computer vision tasks

    公开(公告)号:US11283991B2

    公开(公告)日:2022-03-22

    申请号:US16893388

    申请日:2020-06-04

    申请人: ALGOLUX INC.

    IPC分类号: H04N5/232

    摘要: Image Signal Processing (ISP) optimization framework for computer vision applications is disclosed. The tuning of the ISP is performed automatically and presented as a nonlinear multi-objective optimization problem, followed by solving the problem using an evolutionary stochastic solver. An improved ISP of the embodiments of the invention includes at least features of search space reduction for reducing a number of ISP configurations, remapping the generated population to the reduced search space via mirroring, and global optimization function processing, which allow tuning all the blocks of the ISP at the same time instead of the prior art tuning of each ISP block separately. Also shown that an ISP tuned for image quality performs inferior compared with an ISP trained for a specific downstream image recognition task.

    Method for providing an estimation of a point spread function indicative of intrinsic camera blur

    公开(公告)号:US09800866B2

    公开(公告)日:2017-10-24

    申请号:US15093501

    申请日:2016-04-07

    申请人: Algolux Inc.

    CPC分类号: H04N17/002 G06T5/003 G06T5/50

    摘要: A method for determining a point spread function (PSF) of a camera, comprising: displaying on a display at least two images comprising visual features, elements having a different optical intensity, and a test pattern; acquiring the images using the camera; determining a coordinate transformation using the image comprising the visual features and its corresponding acquired image, the coordinate transformation for aligning together a coordinate system of the camera and a coordinate system of the display; aligning the acquired image comprising the elements having a different optical intensity using the determined coordinate system and determining a difference of intensity between the displayed image comprising the elements having a different optical intensity and the corresponding acquired image; aligning the acquired image comprising the test pattern and correcting an intensity of the acquired image comprising the test pattern, thereby obtaining a corrected image; and estimating a PSF using the corrected image.