Saliency of an Object for Image Processing Operations

    公开(公告)号:US20200380289A1

    公开(公告)日:2020-12-03

    申请号:US16848315

    申请日:2020-04-14

    申请人: Apple Inc.

    IPC分类号: G06K9/46 G06K9/20 G06K9/62

    摘要: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.

    Saliency of an Object for Image Processing Operations

    公开(公告)号:US20220237887A1

    公开(公告)日:2022-07-28

    申请号:US17659377

    申请日:2022-04-15

    申请人: Apple Inc.

    IPC分类号: G06V10/46 G06K9/62 G06V10/22

    摘要: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.

    Shallow depth of field (SDOF) rendering

    公开(公告)号:US10897558B1

    公开(公告)日:2021-01-19

    申请号:US16566017

    申请日:2019-09-10

    申请人: Apple Inc.

    摘要: This disclosure relates to the lightweight and efficient synthesis of shallow depth of field (SDOF) renderings. According to some embodiments, coarse focus information and semantic segmentation information may be leveraged to generate SDOF renderings in a “live preview” or “streaming” mode. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Segmentations may include as many classes as are desired by a given implementation (e.g., a ‘foreground’ class and a ‘background’ class). In some embodiments, the rendering of synthetic SDOF images according to the techniques described herein may be completed using only a single camera of a device and without the use of dedicated depth-sensing technology (e.g., structured light cameras, stereo cameras, time-of-flight cameras, etc.), thereby allowing the SDOF rendering process to operate in a fashion that is not unduly time-, processing-, and/or power-intensive.

    Color Calibration and Use of Multi-LED Flash Modules
    7.
    发明申请
    Color Calibration and Use of Multi-LED Flash Modules 有权
    彩色校准和使用多LED闪光灯模块

    公开(公告)号:US20150304620A1

    公开(公告)日:2015-10-22

    申请号:US14257161

    申请日:2014-04-21

    申请人: Apple Inc.

    IPC分类号: H04N9/73 H04N5/235 H04N5/225

    摘要: Systems, methods, and computer readable media to identify the operating characteristics of a multi-LED flash module for use with a image capture device are described. Flash modules having multiple LEDs have been found to exhibit large module-to-module variation in the light spectrum they emit. It has been determined that such variations make defining a “golden module” impractical. To overcome this and other issues, techniques to characterize the operational behavior of a flash module having multiple LEDs using easily obtained measurements are disclosed. Such characterizations permit the characterization of each flash module to account for the particular lighting capability of its specific LEDs during image capture operations.

    摘要翻译: 描述用于识别用于图像捕获装置的多LED闪光模块的操作特性的系统,方法和计算机可读介质。 已经发现具有多个LED的闪存模块在它们发射的光谱中表现出大的模块到模块的变化。 已经确定这种变化使得定义“黄金模块”是不切实际的。 为了克服这个和其他问题,公开了使用容易获得的测量来表征具有多个LED的闪存模块的操作行为的技术。 这种特征允许每个闪光灯模块的特性描述在图像捕获操作期间考虑其特定LED的特定照明能力。

    Object Depth Estimation and Camera Focusing Techniques for Multiple-Camera Systems

    公开(公告)号:US20230081349A1

    公开(公告)日:2023-03-16

    申请号:US17479584

    申请日:2021-09-20

    申请人: Apple Inc.

    摘要: Various embodiments disclosed herein include techniques for operating a multiple camera system. In some embodiments, a primary camera may be selected from a plurality of cameras using object distance estimates, distance error information, and minimum object distances for some or all of the plurality of cameras. In other embodiments, a camera may be configured to use defocus information to obtain an object distance estimate to a target object closer than a minimum object distance of the camera. This object distance estimate may be used to assist in focusing another camera of the multi-camera system.