-
21.
公开(公告)号:US20180070015A1
公开(公告)日:2018-03-08
申请号:US15696583
申请日:2017-09-06
Applicant: Apple Inc.
Inventor: Paul M. Hubel , Marius Tico , Ting Chen
Abstract: Techniques are disclosed for managing image capture and processing in a multi-camera imaging system. In such a system, a pair of cameras each may output a sequence of frames representing captured image data. The cameras' output may be synchronized to each other to cause synchronism in the image capture operations of the cameras. The system may assess image quality of frames output from the cameras and, based on the image quality, designate a pair of the frames to serve as a “reference frame pair.” Thus, one frame from the first camera and a paired frame from the second camera will be designated as the reference frame pair. The system may adjust each reference frame in the pair using other frames from their respective cameras. The reference frames also may be processed by other operations within the system, such as image fusion.
-
22.
公开(公告)号:US09860447B1
公开(公告)日:2018-01-02
申请号:US14500688
申请日:2014-09-29
Applicant: Apple Inc.
Inventor: David C. Beard , Paul M. Hubel
CPC classification number: H04N5/23258 , H04N5/2257 , H04N5/23216 , H04N5/23254 , H04N5/23287 , H04N17/002
Abstract: In some embodiments, a plurality of images is captured through an image sensor of a camera during a period of time. The plurality of images is registered to calculate an image-sensor-based measure of movement of the camera during the period of time. The image-sensor-based measure of movement is compared to a motion-sensor-based measure of movement of the camera during the period of time, and a systematic offset between the motion-sensor-based measure of movement and the image-sensor-based measure of movement is calculated.
-
公开(公告)号:US09692995B2
公开(公告)日:2017-06-27
申请号:US15012500
申请日:2016-02-01
Applicant: Apple Inc.
Inventor: Marius Tico , Paul M. Hubel , Frank Doepke , Todd S. Sachs
CPC classification number: H04N5/23238 , G06T5/50 , G06T7/0002 , G06T7/11 , G06T7/174 , G06T7/20 , G06T11/60 , G06T2207/20076 , G06T2207/20221 , G06T2207/30242 , H04N5/14 , H04N5/357 , H04N5/3572
Abstract: Lens flare mitigation techniques determine which pixels in images of a sequence of images are likely to be pixels affected by lens flare. Once the lens flare areas of the images are determined, unwanted lens flare effects may be mitigated by various approaches, including reducing border artifacts along a seam between successive images, discarding entire images of the sequence that contain lens flare areas, and using tone-mapping to reduce the visibility of lens flare.
-
24.
公开(公告)号:US09491360B2
公开(公告)日:2016-11-08
申请号:US13911873
申请日:2013-06-06
Applicant: Apple Inc.
Inventor: Anita Nariani Schulze , Rolf Toft , Paul M. Hubel , Marius Tico , Jianping Zhou , Ralph Brunner , Claus Molgaard
IPC: H04N5/232
CPC classification number: H04N5/23277
Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. A novel combination of image quality and commonality metrics are used to identify a reference frame from a set of commonly captured images which, when the set's other images are combined with it, results in a quality stabilized image. The disclosed image quality and commonality metrics may also be used to optimize the use of a limited amount of image buffer memory during image capture sequences that return more images that the memory may accommodate at one time. Image quality and commonality metrics may also be used to effect the combination of multiple relatively long-exposure images which, when combined with a one or more final (relatively) short-exposure images, yields images exhibiting motion-induced blurring in interesting and visually pleasing ways.
Abstract translation: 描述了用于改善图像稳定操作的系统,方法和计算机可读介质。 使用图像质量和共性度量的新颖组合来从一组共同拍摄的图像中识别参考帧,当集合的其他图像与其组合时,其导致质量稳定的图像。 公开的图像质量和通用性度量还可以用于在图像捕获序列期间优化使用有限量的图像缓冲存储器,从而可以一次返回存储器可以容纳的更多图像。 图像质量和共性度量也可用于影响多个相对较长曝光图像的组合,当与一个或多个最终(相对)短曝光图像组合时,产生显示运动诱导的模糊的图像,其在有趣和视觉上令人满意 方法。
-
公开(公告)号:US20160301873A1
公开(公告)日:2016-10-13
申请号:US15154659
申请日:2016-05-13
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
Abstract translation: 公开了从稳定的图像捕获装置捕捉和融合场景的短曝光和长曝光图像的技术。 更具体地,所公开的技术不仅使用共同拍摄的短曝光图像和长曝光图像之间的单独像素差异,而且使用长曝光图像中的遮挡区域的空间结构(例如,长曝光图像的区域 )呈现由于场景物体运动造成的模糊)。 用于表示长曝光图像的该特征的新型装置是“空间差异图”。空间差异图可以用于识别短和长曝光图像中用于融合的像素,并且在一个实施例中可以是 用于识别来自短曝光图像的像素以过滤融合后的图像,以减少输出图像中的视觉不连续性。
-
公开(公告)号:US20150348242A1
公开(公告)日:2015-12-03
申请号:US14502887
申请日:2014-09-30
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
Abstract translation: 公开了从稳定的图像捕获装置捕捉和融合场景的短曝光和长曝光图像的技术。 更具体地,所公开的技术不仅使用共同拍摄的短曝光图像和长曝光图像之间的单独像素差异,而且使用长曝光图像中的遮挡区域的空间结构(例如,长曝光图像的区域 )呈现由于场景物体运动造成的模糊)。 用于表示长曝光图像的该特征的新型装置是“空间差异图”。空间差异图可以用于识别用于融合的短曝光图像和长曝光图像中的像素,并且在一个实施例中可以是 用于识别来自短曝光图像的像素以过滤融合后的图像,以减少输出图像中的视觉不连续性。
-
27.
公开(公告)号:US20200374461A1
公开(公告)日:2020-11-26
申请号:US16990432
申请日:2020-08-11
Applicant: Apple Inc.
Inventor: Paul M. Hubel , Marius Tico , Ting Chen
Abstract: Techniques are disclosed for managing image capture and processing in a multi-camera imaging system. In such a system, a pair of cameras each may output a sequence of frames representing captured image data. The cameras' output may be synchronized to each other to cause synchronism in the image capture operations of the cameras. The system may assess image quality of frames output from the cameras and, based on the image quality, designate a pair of the frames to serve as a “reference frame pair.” Thus, one frame from the first camera and a paired frame from the second camera will be designated as the reference frame pair. The system may adjust each reference frame in the pair using other frames from their respective cameras. The reference frames also may be processed by other operations within the system, such as image fusion.
-
公开(公告)号:US20180316864A1
公开(公告)日:2018-11-01
申请号:US16030632
申请日:2018-07-09
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/232 , G06T5/00 , G06T5/50 , H04N5/235 , G06T7/20 , H04N5/91 , G06T7/254 , H04N5/355 , G06T11/60 , H04N5/359
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号:US20180070007A1
公开(公告)日:2018-03-08
申请号:US15697224
申请日:2017-09-06
Applicant: Apple Inc.
Inventor: Claus Molgaard , Paul M. Hubel , Ziv Attar , Ilana Volfin
CPC classification number: H04N5/23216 , G06K9/00201 , G06K9/00248 , G06K9/3233 , G06K9/38 , G06K9/46 , G06T7/50 , G06T2207/10028 , H04N5/23219
Abstract: Techniques are described for automated analysis and filtering of image data. Image data is analyzed to identify regions of interest (ROIs) within the image content. The image data also may have depth estimates applied to content therein. One or more of the ROIs may be designated to possess a base depth, representing a depth of image content against which depths of other content may be compared. Moreover, the depth of the image content within a spatial area of an ROI may be set to be a consistent value, regardless of depth estimates that may have been assigned from other sources. Thereafter, other elements of image content may be assigned content adjustment values in gradients based on their relative depth in image content as compared to the base depth and, optionally, based on their spatial distance from the designated ROI. Image content may be adjusted based on the content adjustment values.
-
公开(公告)号:US20180063441A1
公开(公告)日:2018-03-01
申请号:US15797768
申请日:2017-10-30
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
-
-
-
-
-
-
-
-