-
公开(公告)号:US20200380289A1
公开(公告)日:2020-12-03
申请号:US16848315
申请日:2020-04-14
申请人: Apple Inc.
摘要: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.
-
公开(公告)号:US12015845B2
公开(公告)日:2024-06-18
申请号:US17479584
申请日:2021-09-20
申请人: Apple Inc.
IPC分类号: H04N23/67 , G02B7/28 , G03B13/36 , H04N23/51 , H04N23/959
CPC分类号: H04N23/675 , G02B7/285 , G03B13/36 , H04N23/51 , H04N23/959
摘要: Various embodiments disclosed herein include techniques for operating a multiple camera system. In some embodiments, a primary camera may be selected from a plurality of cameras using object distance estimates, distance error information, and minimum object distances for some or all of the plurality of cameras. In other embodiments, a camera may be configured to use defocus information to obtain an object distance estimate to a target object closer than a minimum object distance of the camera. This object distance estimate may be used to assist in focusing another camera of the multi-camera system.
-
公开(公告)号:US20220237887A1
公开(公告)日:2022-07-28
申请号:US17659377
申请日:2022-04-15
申请人: Apple Inc.
摘要: Various methods for utilizing a saliency heatmaps are described. The methods include obtaining image data corresponding to an image of a scene, obtaining a saliency heatmap for the image of the scene based on a saliency network, wherein the saliency heatmap indicates a likelihood of saliency for a corresponding portion of the scene, and manipulating the image data based on the saliency heatmap. In embodiments, the saliency heatmap may be produced using a trained machine learning model. The saliency heatmap may be used for various image processing tasks, such as determining which portion(s) of a scene to base an image capture device's autofocus, auto exposure, and/or white balance operations upon. According to some embodiments, one or more bounding boxes may be generated based on the saliency heatmap, e.g., using an optimization operation, which bounding box(es) may be used to assist or enhance the performance of various image processing tasks.
-
公开(公告)号:US20180070068A1
公开(公告)日:2018-03-08
申请号:US15697228
申请日:2017-09-06
申请人: Apple Inc.
发明人: Yonghui Zhao , Xuemei Zhang , Yingjun Bai , Gregory Guyomarc'h , Kosta Dabov
CPC分类号: H04N9/735 , H04N5/23212 , H04N5/2357 , H04N5/3572 , H04N5/367 , H04N9/045 , H04N9/68
摘要: Techniques for auto white balancing of captured images based on detection of flicker in ambient light is described. When flicker is detected in ambient light during an image capture event, and the flicker is unchanging during the image capture event, a white point of image data may be estimated according to a first technique. When flicker is detected in ambient light during an image capture event, and the flicker is changing during the image capture event, a white point of image data may be estimated according to a second technique. When flicker is not detected, a white point of image data may be estimated according to a third technique. Image data may be color corrected based on the estimated white point.
-
公开(公告)号:US10897558B1
公开(公告)日:2021-01-19
申请号:US16566017
申请日:2019-09-10
申请人: Apple Inc.
发明人: Wei Sun , Philip G. Lee , Gregory Guyomarc'h , Frederic Cao
摘要: This disclosure relates to the lightweight and efficient synthesis of shallow depth of field (SDOF) renderings. According to some embodiments, coarse focus information and semantic segmentation information may be leveraged to generate SDOF renderings in a “live preview” or “streaming” mode. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Segmentations may include as many classes as are desired by a given implementation (e.g., a ‘foreground’ class and a ‘background’ class). In some embodiments, the rendering of synthetic SDOF images according to the techniques described herein may be completed using only a single camera of a device and without the use of dedicated depth-sensing technology (e.g., structured light cameras, stereo cameras, time-of-flight cameras, etc.), thereby allowing the SDOF rendering process to operate in a fashion that is not unduly time-, processing-, and/or power-intensive.
-
公开(公告)号:US10602111B2
公开(公告)日:2020-03-24
申请号:US15697228
申请日:2017-09-06
申请人: Apple Inc.
发明人: Yonghui Zhao , Xuemei Zhang , Yingjun Bai , Gregory Guyomarc'h , Kosta Dabov
摘要: Techniques for auto white balancing of captured images based on detection of flicker in ambient light is described. When flicker is detected in ambient light during an image capture event, and the flicker is unchanging during the image capture event, a white point of image data may be estimated according to a first technique. When flicker is detected in ambient light during an image capture event, and the flicker is changing during the image capture event, a white point of image data may be estimated according to a second technique. When flicker is not detected, a white point of image data may be estimated according to a third technique. Image data may be color corrected based on the estimated white point.
-
公开(公告)号:US20150304620A1
公开(公告)日:2015-10-22
申请号:US14257161
申请日:2014-04-21
申请人: Apple Inc.
发明人: Gregory Guyomarc'h
CPC分类号: H04N9/735 , H04N5/2256 , H04N5/2354 , H04N17/002
摘要: Systems, methods, and computer readable media to identify the operating characteristics of a multi-LED flash module for use with a image capture device are described. Flash modules having multiple LEDs have been found to exhibit large module-to-module variation in the light spectrum they emit. It has been determined that such variations make defining a “golden module” impractical. To overcome this and other issues, techniques to characterize the operational behavior of a flash module having multiple LEDs using easily obtained measurements are disclosed. Such characterizations permit the characterization of each flash module to account for the particular lighting capability of its specific LEDs during image capture operations.
摘要翻译: 描述用于识别用于图像捕获装置的多LED闪光模块的操作特性的系统,方法和计算机可读介质。 已经发现具有多个LED的闪存模块在它们发射的光谱中表现出大的模块到模块的变化。 已经确定这种变化使得定义“黄金模块”是不切实际的。 为了克服这个和其他问题,公开了使用容易获得的测量来表征具有多个LED的闪存模块的操作行为的技术。 这种特征允许每个闪光灯模块的特性描述在图像捕获操作期间考虑其特定LED的特定照明能力。
-
公开(公告)号:US20230094971A1
公开(公告)日:2023-03-30
申请号:US18061395
申请日:2022-12-02
申请人: Apple Inc.
发明人: Mark N. Gamadia , Abhishek Dhanda , Gregory Guyomarc'h , Andrew D. Fernandez , Moshe Laifenfeld
IPC分类号: H04N5/232
摘要: Various embodiments disclosed herein include techniques for determining autofocus for a camera on a mobile device. In some instances, depth imaging is used to assist in determining a focus position for the camera through an autofocus process. For example, a determination of depth may be used to determine a focus position for the camera. In another example, the determination of depth may be used to assist another autofocus process.
-
公开(公告)号:US20230081349A1
公开(公告)日:2023-03-16
申请号:US17479584
申请日:2021-09-20
申请人: Apple Inc.
摘要: Various embodiments disclosed herein include techniques for operating a multiple camera system. In some embodiments, a primary camera may be selected from a plurality of cameras using object distance estimates, distance error information, and minimum object distances for some or all of the plurality of cameras. In other embodiments, a camera may be configured to use defocus information to obtain an object distance estimate to a target object closer than a minimum object distance of the camera. This object distance estimate may be used to assist in focusing another camera of the multi-camera system.
-
公开(公告)号:US11523043B2
公开(公告)日:2022-12-06
申请号:US17485258
申请日:2021-09-24
申请人: Apple Inc.
发明人: Mark N. Gamadia , Abhishek Dhanda , Gregory Guyomarc'h , Andrew D. Fernandez , Moshe Laifenfeld
IPC分类号: H04N5/232
摘要: Various embodiments disclosed herein include techniques for determining autofocus for a camera on a mobile device. In some instances, depth imaging is used to assist in determining a focus position for the camera through an autofocus process. For example, a determination of depth may be used to determine a focus position for the camera. In another example, the determination of depth may be used to assist another autofocus process.
-
-
-
-
-
-
-
-
-