Saliency of an object for image processing operations

    公开(公告)号:US11308345B2

    公开(公告)日:2022-04-19

    申请号:US16848315

    申请日:2020-04-14

    申请人: Apple Inc.

    IPC分类号: G06K9/62 G06K9/20 G06K9/46

    摘要: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.

    Saliency of an object for image processing operations

    公开(公告)号:US11663806B2

    公开(公告)日:2023-05-30

    申请号:US17659377

    申请日:2022-04-15

    申请人: Apple Inc.

    摘要: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.

    Synchronization of camera focus movement control with frame capture

    公开(公告)号:US11627244B1

    公开(公告)日:2023-04-11

    申请号:US17011804

    申请日:2020-09-03

    申请人: Apple Inc.

    摘要: Various embodiments include synchronization of camera focus movement control with frame capture. In some embodiments, such synchronization may comprise synchronized focus movement control that is based at least in part on integration timing and/or region of interest (ROI) timing. According to some examples, an actuator of a camera module may be controlled such that a lens group and/or an image sensor of the camera module move towards a focus position during one or more time periods (e.g., a non-integration time period in which the image sensor is not being exposed, a non-ROI time period in which a ROI of the image sensor is not being exposed for image capture, and/or a blanking interval, etc.). Additionally, or alternatively, the actuator may be controlled such that the lens group and the image sensor do not move relative to each other in a focus direction during one or more other time periods (e.g., an integration time period in which the image sensor is being exposed, a ROI time period in which the ROI of the image sensor is being exposed, etc.).

    Color calibration and use of multi-LED flash modules
    16.
    发明授权
    Color calibration and use of multi-LED flash modules 有权
    彩色校准和使用多LED闪光灯模块

    公开(公告)号:US09532024B2

    公开(公告)日:2016-12-27

    申请号:US14257161

    申请日:2014-04-21

    申请人: Apple Inc.

    摘要: Systems, methods, and computer readable media to identify the operating characteristics of a multi-LED flash module for use with a image capture device are described. Flash modules having multiple LEDs have been found to exhibit large module-to-module variation in the light spectrum they emit. It has been determined that such variations make defining a “golden module” impractical. To overcome this and other issues, techniques to characterize the operational behavior of a flash module having multiple LEDs using easily obtained measurements are disclosed. Such characterizations permit the characterization of each flash module to account for the particular lighting capability of its specific LEDs during image capture operations.

    摘要翻译: 描述用于识别用于图像捕获装置的多LED闪光模块的操作特性的系统,方法和计算机可读介质。 已经发现具有多个LED的闪存模块在它们发射的光谱中表现出大的模块到模块的变化。 已经确定这种变化使得定义“黄金模块”是不切实际的。 为了克服这个和其他问题,公开了使用容易获得的测量来表征具有多个LED的闪存模块的操作行为的技术。 这种特征允许每个闪光灯模块的特性描述在图像捕获操作期间考虑其特定LED的特定照明能力。