-
公开(公告)号:US11488374B1
公开(公告)日:2022-11-01
申请号:US16578825
申请日:2019-09-23
Applicant: Apple Inc.
Inventor: Wei Sun , Jun Hu , Marius Tico , Xuemei Zhang
Abstract: The disclosure pertains to techniques for image processing. One such technique comprises a method for image selection, comprising obtaining a sequence of images, detecting one or more objects in one or more images of the sequence of images, determining a location for each detected object in the one or more images, determining a trajectory for each detected object based on a determined location for each respective detected object in two or more images of the sequence of images, determining a trajectory waypoint score for the trajectory of each detected object, determining a set of selected images based on an aggregation of trajectory waypoint scores for each detected object in each respective image, and outputting the set of selected images for presentation.
-
公开(公告)号:US10277820B2
公开(公告)日:2019-04-30
申请号:US16030632
申请日:2018-07-09
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/232 , G06T5/00 , G06T11/60 , H04N5/91 , G06T5/50 , G06T7/20 , H04N5/235 , H04N5/355 , G06T7/254 , H04N5/359
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号:US20180068473A1
公开(公告)日:2018-03-08
申请号:US15257855
申请日:2016-09-06
Applicant: Apple Inc.
Inventor: Marius Tico , Lech J. Szumilas , Xiaoxing Li , Paul M. Hubel , Todd S. Sachs
CPC classification number: G06T11/60 , G06K9/6212 , G06T3/0093 , G06T5/50 , G06T11/00 , G06T2207/20221 , H04N5/247 , H04N5/2621
Abstract: Image fusion techniques hide artifacts that can arise at seams between regions of different image quality. According to these techniques, image registration may be performed on multiple images having at least a portion of image content in common. A first image may be warped to a spatial domain of a second image based on the image registration. A fused image may be generated from a blend of the warped first image and the second image, wherein relative contributions of the warped first image and the second image are weighted according to a distribution pattern based on a size of a smaller of the pair of images. In this manner, contributions of the different images vary at seams that otherwise would appear.
-
公开(公告)号:US09843730B2
公开(公告)日:2017-12-12
申请号:US15587617
申请日:2017-05-05
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
5.
公开(公告)号:US09832378B2
公开(公告)日:2017-11-28
申请号:US13911243
申请日:2013-06-06
Applicant: Apple Inc.
Inventor: Frank Doepke , Marius Tico , Ting Chen , Yongfang Liang
IPC: H04N5/232
CPC classification number: H04N5/23238
Abstract: Special blend operations for wide area-of-view image generation utilizing a “floating auto exposure” scheme are described. Pixel values in the two images being stitched together are blended within a transition band around a “seam.” identified in the overlap region between the images after changes in exposure and/or color saturation are accounted for. In some embodiments, changes in exposure and/or color saturation are accounted for through the use of one or more exposure mapping curves, the selection and use of which are based, at least in part, on a determined “Exposure Ratio” value, i.e., the amount that the camera's exposure settings have deviated from their initial capture settings. In other embodiments, the Exposure Ratio value is also used to determine regions along the seam where either: alpha blending, Poisson blending—or a combination of the two—should be used to blend in the transitional areas on each side of the seam.
-
公开(公告)号:US09681050B2
公开(公告)日:2017-06-13
申请号:US15154659
申请日:2016-05-13
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/228 , H04N5/232 , G06T5/00 , G06T11/60 , H04N5/91 , G06T5/50 , G06T7/20 , H04N5/235 , H04N5/355 , G06T7/254
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号:US20160227137A1
公开(公告)日:2016-08-04
申请号:US15012500
申请日:2016-02-01
Applicant: Apple Inc.
Inventor: Marius Tico , Paul M. Hubel , Frank Doepke , Todd S. Sachs
CPC classification number: H04N5/23238 , G06T5/50 , G06T7/0002 , G06T7/11 , G06T7/174 , G06T7/20 , G06T11/60 , G06T2207/20076 , G06T2207/20221 , G06T2207/30242 , H04N5/14 , H04N5/357 , H04N5/3572
Abstract: Lens flare mitigation techniques determine which pixels in images of a sequence of images are likely to be pixels affected by lens flare. Once the lens flare areas of the images are determined, unwanted lens flare effects may be mitigated by various approaches, including reducing border artifacts along a seam between successive images, discarding entire images of the sequence that contain lens flare areas, and using tone-mapping to reduce the visibility of lens flare.
-
公开(公告)号:US09342871B2
公开(公告)日:2016-05-17
申请号:US14502887
申请日:2014-09-30
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号:US20140363096A1
公开(公告)日:2014-12-11
申请号:US13911793
申请日:2013-06-06
Applicant: Apple Inc.
Inventor: Jianping Zhou , Paul Hubel , Marius Tico , Anita Nariani Schulze , Rolf Toft
IPC: G06T7/00
CPC classification number: G06T7/0028 , G06T7/33 , G06T2207/10016 , G06T2207/20016
Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. A novel approach to pixel-based registration of non-reference images to a reference frame in a set of commonly captured images is disclosed which makes use of pyramid decomposition to more efficiently detect corners. The disclosed pixel-based registration operation may also be combined with motion sensor data-based registration approaches to register non-reference images with respect to the reference frame. When the registered non-reference images are combined with the pre-selected reference image, the resulting image is a quality stabilized image.
Abstract translation: 描述了用于改善图像稳定操作的系统,方法和计算机可读介质。 公开了一种将非参考图像基于像素的注册到一组共同拍摄的图像中的参考帧的新颖方法,其利用金字塔分解来更有效地检测角落。 所公开的基于像素的注册操作还可以与基于运动传感器数据的注册方法组合以便相对于参考帧来注册非参考图像。 当登记的非参考图像与预先选择的参考图像组合时,所得图像是质量稳定图像。
-
公开(公告)号:US10977778B2
公开(公告)日:2021-04-13
申请号:US16426448
申请日:2019-05-30
Applicant: Apple Inc.
Inventor: Marius Tico , Alok Deshpande , Anita Nariani Schulze , Hao Sun , Jun Hu , Justin Michael Faryabi-Allen , Morten Poulsen , Tak Shing Wong , Wu Cheng
Abstract: Devices, methods, and computer-readable media are disclosed describing an adaptive approach for image bracket selection and fusion, e.g., to generate low noise and high dynamic range (HDR) images in a wide variety of capturing conditions. An incoming image stream may be obtained from an image capture device, wherein the incoming image stream comprises a variety of differently-exposed captures, e.g., EV0 images, EV− images, EV+ images, long exposure (or synthetic long exposure) images, EV0/EV− image pairs, etc., which are received according to a particular pattern. When a capture request is received, a set of rules and/or a decision tree may be used to evaluate one or more capture conditions associated with the images from the incoming image stream and determine which two or more images to select for a fusion operation. A noise reduction process may optionally be performed on the selected images before (or after) the registration and fusion operations.
-
-
-
-
-
-
-
-
-