Saliency of an object for image processing operations

    公开(公告)号:US11308345B2

    公开(公告)日:2022-04-19

    申请号:US16848315

    申请日:2020-04-14

    Applicant: Apple Inc.

    Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.

    Detection of close-range specular targets

    公开(公告)号:US20240406552A1

    公开(公告)日:2024-12-05

    申请号:US18325150

    申请日:2023-05-30

    Applicant: Apple Inc.

    Abstract: Imaging apparatus includes a camera, which includes an autofocus mechanism. A range sensor includes a transmitter, which includes multiple emitters configured to transmit optical pulses at different angles toward the scene, and a receiver, to receive and sense respective times of flight of the optical pulses that are reflected from the scene. A photodetector outputs a signal indicative of an intensity of reflections from the scene. Control circuitry drives the emitters in alternation to transmit the optical pulses, estimates a range to a target in the scene responsively to the times of flight sensed by the receiver, detects a difference in the signal output by the photodetector in response to the pulses transmitted by different ones of the emitters, and sets the autofocus mechanism responsively to the estimated range as long as the detected difference is no greater than a predefined threshold difference.

    Saliency of an object for image processing operations

    公开(公告)号:US11663806B2

    公开(公告)日:2023-05-30

    申请号:US17659377

    申请日:2022-04-15

    Applicant: Apple Inc.

    CPC classification number: G06V10/255 G06F18/214 G06V10/462 G06V20/64

    Abstract: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.

    Synchronization of camera focus movement control with frame capture

    公开(公告)号:US11627244B1

    公开(公告)日:2023-04-11

    申请号:US17011804

    申请日:2020-09-03

    Applicant: Apple Inc.

    Abstract: Various embodiments include synchronization of camera focus movement control with frame capture. In some embodiments, such synchronization may comprise synchronized focus movement control that is based at least in part on integration timing and/or region of interest (ROI) timing. According to some examples, an actuator of a camera module may be controlled such that a lens group and/or an image sensor of the camera module move towards a focus position during one or more time periods (e.g., a non-integration time period in which the image sensor is not being exposed, a non-ROI time period in which a ROI of the image sensor is not being exposed for image capture, and/or a blanking interval, etc.). Additionally, or alternatively, the actuator may be controlled such that the lens group and the image sensor do not move relative to each other in a focus direction during one or more other time periods (e.g., an integration time period in which the image sensor is being exposed, a ROI time period in which the ROI of the image sensor is being exposed, etc.).

    Color calibration and use of multi-LED flash modules
    17.
    发明授权
    Color calibration and use of multi-LED flash modules 有权
    彩色校准和使用多LED闪光灯模块

    公开(公告)号:US09532024B2

    公开(公告)日:2016-12-27

    申请号:US14257161

    申请日:2014-04-21

    Applicant: Apple Inc.

    CPC classification number: H04N9/735 H04N5/2256 H04N5/2354 H04N17/002

    Abstract: Systems, methods, and computer readable media to identify the operating characteristics of a multi-LED flash module for use with a image capture device are described. Flash modules having multiple LEDs have been found to exhibit large module-to-module variation in the light spectrum they emit. It has been determined that such variations make defining a “golden module” impractical. To overcome this and other issues, techniques to characterize the operational behavior of a flash module having multiple LEDs using easily obtained measurements are disclosed. Such characterizations permit the characterization of each flash module to account for the particular lighting capability of its specific LEDs during image capture operations.

    Abstract translation: 描述用于识别用于图像捕获装置的多LED闪光模块的操作特性的系统,方法和计算机可读介质。 已经发现具有多个LED的闪存模块在它们发射的光谱中表现出大的模块到模块的变化。 已经确定这种变化使得定义“黄金模块”是不切实际的。 为了克服这个和其他问题,公开了使用容易获得的测量来表征具有多个LED的闪存模块的操作行为的技术。 这种特征允许每个闪光灯模块的特性描述在图像捕获操作期间考虑其特定LED的特定照明能力。

Patent Agency Ranking