-
公开(公告)号：US11776141B1
公开(公告)日：2023-10-03
申请号：US17357401
申请日：2021-06-24
Applicant: Apple Inc.
Inventor： Gijesh Varghese , Farhan A. Baqai , Giancarlo Todone , Hao Sun , Richard D. Seely
CPC classification number: G06T7/337 , G06T3/0093 , G06T5/20 , G06T5/50 , G06T2207/20221
Abstract: Devices, methods, and non-transitory program storage devices (NPSDs) for an improved, so-called “hybrid” image registration process are disclosed herein, comprising: obtaining a first set of captured images, wherein the first set of captured images comprises a reference image and one or more bracketed images; and for each of the one or more bracketed images: performing a first (e.g., global) registration operation and a second (e.g., dense, or other localized) registration operation on the bracketed image with respect to the reference image, wherein each of the first and second registration operations produces an output; generating a blend map for the bracketed image, wherein each value in the blend map indicates whether to use the first or second registration operation output for a corresponding one or more pixels when registering the bracketed image with the reference image; and registering the bracketed image with the reference image, according to the generated blend map.
-
公开(公告)号：US10666874B2
公开(公告)日：2020-05-26
申请号：US15979259
申请日：2018-05-14
Applicant: Apple Inc.
Inventor： Hao Sun , Fabio Riccardi , Garrett M. Johnson , Farhan A. Baqai
Abstract: Techniques of reducing or eliminating artifact pixels in high dynamic range (HDR) imaging are described. One embodiment includes obtaining a first image of a scene at a first time with first exposure settings and obtaining a second image of the scene at a second time with second exposure settings that differ from the first exposure settings. The obtained images may be downsampled. The images may be compared to each other to assist with determining a number of potential artifact pixels in the scene. Depending on a relationship between the number of potential artifact pixels and a threshold value, the first image or second image may be selected as a reference image for registering the images with each other. A type of registration performed between the images may depend on which of the two images is the selected reference image. The registered images may be used to generate an HDR image.
-
公开(公告)号：US20180352134A1
公开(公告)日：2018-12-06
申请号：US15979259
申请日：2018-05-14
Applicant: Apple Inc.
Inventor： Hao Sun , Fabio Riccardi , Garrett M. Johnson , Farhan A. Baqai
CPC classification number: H04N5/2356 , H04N5/23232 , H04N5/2355 , H04N5/35581
Abstract: Techniques of reducing or eliminating artifact pixels in high dynamic range (HDR) imaging are described. One embodiment includes obtaining a first image of a scene at a first time with first exposure settings and obtaining a second image of the scene at a second time with second exposure settings that differ from the first exposure settings. The obtained images may be downsampled. The images may be compared to each other to assist with determining a number of potential artifact pixels in the scene. Depending on a relationship between the number of potential artifact pixels and a threshold value, the first image or second image may be selected as a reference image for registering the images with each other. A type of registration performed between the images may depend on which of the two images is the selected reference image. The registered images may be used to generate an HDR image.
-
公开(公告)号：US11113802B1
公开(公告)日：2021-09-07
申请号：US16564573
申请日：2019-09-09
Applicant: Apple Inc.
Inventor： Hao Sun , Giancarlo Todone , Farhan A. Baqai , Gijesh Varghese , Morten Poulsen
Abstract: An adaptive approach to image bracket determination and a more memory-efficient approach to image fusion, which are designed to generate low noise and high dynamic range (HDR) images in a wide variety of capturing conditions, are described. An incoming preview image stream may be obtained from an image capture device. When a capture request is received, an analysis may be performed on an image from the preview image stream that has a predetermined temporal relationship to the image capture request. Based on the analysis, a set of images (and their respective capture parameters, e.g., exposure time) may be determined for the image capture device to capture. As the determined set of images are captured, they may be registered and fused in a memory-efficient manner that, e.g., places an upper limit on the overall memory footprint of the registration and fusion operations—regardless of how many images are captured in total.
-
公开(公告)号：US11094039B1
公开(公告)日：2021-08-17
申请号：US16563410
申请日：2019-09-06
Applicant: Apple Inc.
Inventor： Tak Shing Wong , Gijesh Varghese , Farhan A. Baqai , Wu Cheng , Hao Sun
Abstract: Devices, methods, and computer-readable media describing an adaptive approach for image selection, fusion, and noise reduction, e.g., to generate low noise and high dynamic range (HDR) images with improved motion freezing in a variety of capturing conditions. An incoming image stream may be obtained from an image capture device, wherein the image stream comprises a variety of differently-exposed captures, e.g., EV0 images, EV− images, EV+ images. When a capture request is received, a set of rules may be used to evaluate one or more capture conditions associated with the images from the incoming image stream and determine which two or more images to select for a fusion operation. The fusion operation may be designed to adaptively fuse the selected images, e.g., in a fashion that is determined to be optimal from a noise variance minimization standpoint. A fusion-adaptive noise reduction process may further be performed on the resultant fused image.
-
Patent Agency Ranking
公开(公告)号：US10977778B2
公开(公告)日：2021-04-13
申请号：US16426448
申请日：2019-05-30
Applicant: Apple Inc.
Inventor： Marius Tico , Alok Deshpande , Anita Nariani Schulze , Hao Sun , Jun Hu , Justin Michael Faryabi-Allen , Morten Poulsen , Tak Shing Wong , Wu Cheng
Abstract: Devices, methods, and computer-readable media are disclosed describing an adaptive approach for image bracket selection and fusion, e.g., to generate low noise and high dynamic range (HDR) images in a wide variety of capturing conditions. An incoming image stream may be obtained from an image capture device, wherein the incoming image stream comprises a variety of differently-exposed captures, e.g., EV0 images, EV− images, EV+ images, long exposure (or synthetic long exposure) images, EV0/EV− image pairs, etc., which are received according to a particular pattern. When a capture request is received, a set of rules and/or a decision tree may be used to evaluate one or more capture conditions associated with the images from the incoming image stream and determine which two or more images to select for a fusion operation. A noise reduction process may optionally be performed on the selected images before (or after) the registration and fusion operations.
-
公开(公告)号：US11562470B2
公开(公告)日：2023-01-24
申请号：US17224830
申请日：2021-04-07
Applicant: Apple Inc.
Inventor： Marius Tico , Alok Deshpande , Anita Nariani Schulze , Hao Sun , Jun Hu , Justin Michael Faryabi-Allen , Morten Poulsen , Tak Shing Wong , Wu Cheng
Abstract: Devices, methods, and computer-readable media are disclosed describing an adaptive approach for image bracket selection and fusion, e.g., to generate low noise and high dynamic range (HDR) images in a wide variety of capturing conditions. An incoming image stream may be obtained from an image capture device, wherein the incoming image stream comprises a variety of differently-exposed captures, e.g., EV0 images, EV− images, EV+ images, long exposure (or synthetic long exposure) images, EV0/EV− image pairs, etc., which are received according to a particular pattern. When a capture request is received, a set of rules and/or a decision tree may be used to evaluate one or more capture conditions associated with the images from the incoming image stream and determine which two or more images to select for a fusion operation. A noise reduction process may optionally be performed on the selected images before (or after) the registration and fusion operations.
-
8.发明授权公开(公告)号：US11189017B1
公开(公告)日：2021-11-30
申请号：US16563273
申请日：2019-09-06
Applicant: Apple Inc.
Inventor： Farhan A. Baqai , Gijesh Varghese , Hao Sun , Tak Shing Wong
Abstract: Devices, methods, and computer-readable media describing an adaptive approach for image selection, fusion, and noise reduction, e.g., to generate low noise and high dynamic range (HDR) images with improved motion freezing in a variety of capturing conditions. An incoming image stream may be obtained from an image capture device, wherein the image stream comprises a variety of differently-exposed captures, e.g., EV0 images, EV− images, EV+ images. When a capture request is received, a set of rules may be used to evaluate one or more capture conditions associated with the images from the incoming image stream and determine which two or more images to select for a fusion operation. The fusion operation may be designed to adaptively fuse the selected images, e.g., in a fashion that is determined to be optimal from a noise variance minimization standpoint. A fusion-adaptive noise reduction process may further be performed on the resultant fused image.
-
公开(公告)号：US12058448B1
公开(公告)日：2024-08-06
申请号：US16564548
申请日：2019-09-09
Applicant: Apple Inc.
Inventor： Hao Sun , Gijesh Varghese , Tak Shing Wong , Farhan A. Bagai , Morten Poulsen , Wu Cheng , Su Wang , Alok Deshpande
IPC: H04N23/743 , G06T5/50 , G06T5/92 , H04N23/63 , H04N23/741
CPC classification number: H04N23/743 , G06T5/50 , G06T5/92 , H04N23/631 , H04N23/741 , G06T2207/20208 , G06T2207/20221
Abstract: An adaptive approach to image bracket determination and a more memory-efficient approach to image fusion, which are designed to generate low noise and high dynamic range (HDR) images in a wide variety of capturing conditions, are described. An incoming preview image stream may be obtained from an image capture device. When a capture request is received, an analysis may be performed on an image from the preview image stream that has a predetermined temporal relationship to the image capture request. Based on the analysis, a set of images (and their respective capture parameters, e.g., exposure time) may be determined for the image capture device to capture. As the determined set of images are captured, they may be registered and fused in a memory-efficient manner that, e.g., places an upper limit on the overall memory footprint of the registration and fusion operations—regardless of how many images are captured in total.
-
公开(公告)号：US11102421B1
公开(公告)日：2021-08-24
申请号：US16996375
申请日：2020-08-18
Applicant: Apple Inc.
Inventor： Richard D. Seely , Giancarlo Todone , Hao Sun , Farhan A. Baqai
Abstract: An incoming image stream may be obtained from an image capture device operating in low-light conditions and/or a simulated long exposure image capture mode. As images are obtained, a weighting operation may be performed on the pixels of the captured images to generate and/or update an accumulative weight map, wherein the weighting is based, e.g., on the proximity of the captured pixels' values to the respective image capture device's maximum observable pixel value. As batches of images are obtained, they may be fused, e.g., according to the accumulative weight map, in a memory-efficient manner that places an upper limit on the overall memory footprint of the fusion operations, to simulate an actual long exposure image capture. In some embodiments, the weight map may be stored at a lower resolution than the obtained images and then upscaled, e.g., via the use of guided filters, before being applied in the fusion operations.
-
-
-
-
-
-
-
-
-
Search Results
13
records
(took 0.012 seconds)
