-
公开(公告)号:US20240160088A1
公开(公告)日:2024-05-16
申请号:US18418951
申请日:2024-01-22
Applicant: Apple Inc.
Inventor: Claus Molgaard , Iain A. McAllister
CPC classification number: G03B13/34 , H04N5/2628 , H04N23/45 , H04N23/58 , H04N23/62 , H04N23/635 , H04N23/69 , H04N25/41 , H04N23/55
Abstract: Some embodiments include methods and/or systems for using multiple cameras to provide optical zoom to a user. Some embodiments include a first camera unit of a multifunction device capturing a first image of a first visual field. A second camera unit of the multifunction device simultaneously captures a second image of a second visual field. In some embodiments, the first camera unit includes a first optical package with a first focal length. In some embodiments, the second camera unit includes a second optical package with a second focal length. In some embodiments, the first focal length is different from the second focal length, and the first visual field is a subset of the second visual field. In some embodiments, the first image and the second image are preserved to a storage medium as separate data structures.
-
公开(公告)号:US10277820B2
公开(公告)日:2019-04-30
申请号:US16030632
申请日:2018-07-09
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/232 , G06T5/00 , G06T11/60 , H04N5/91 , G06T5/50 , G06T7/20 , H04N5/235 , H04N5/355 , G06T7/254 , H04N5/359
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号:US09843730B2
公开(公告)日:2017-12-12
申请号:US15587617
申请日:2017-05-05
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号:US09686485B2
公开(公告)日:2017-06-20
申请号:US14292599
申请日:2014-05-30
Applicant: Apple Inc.
Inventor: Gennadiy A. Agranov , Claus Molgaard , Ashirwad Bahukhandi , Chiajen Lee , Xiangli Li
IPC: H04N5/345 , H04N5/347 , H04N5/3745 , H04N9/04
CPC classification number: H04N9/04511 , H04N5/347 , H04N5/37457 , H04N9/045
Abstract: Pixel binning is performed by summing charge from some pixels positioned diagonally in a pixel array. Pixel signals output from pixels positioned diagonally in the pixel array may be combined on the output lines. A signal representing summed charge produces a binned 2×1 cluster. A signal representing combined voltage signals produces a binned 2×1 cluster. A signal representing summed charge and a signal representing combined pixel signals can be combined digitally to produce a binned 2×2 pixel. Orthogonal binning may be performed on other pixels in the pixel array by summing charge on respective common sense regions and then then combining the voltage signals that represent the summed charge on respective output lines.
-
公开(公告)号:US09681050B2
公开(公告)日:2017-06-13
申请号:US15154659
申请日:2016-05-13
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/228 , H04N5/232 , G06T5/00 , G06T11/60 , H04N5/91 , G06T5/50 , G06T7/20 , H04N5/235 , H04N5/355 , G06T7/254
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号:US20170070718A1
公开(公告)日:2017-03-09
申请号:US14872098
申请日:2015-09-30
Applicant: Apple Inc.
Inventor: Farhan A. Baqai , Fabio Riccardi , Russell A. Pflughaupt , Claus Molgaard , Gijesh Varghese
CPC classification number: H04N9/77 , G06K9/40 , G06T5/002 , G06T5/009 , G06T5/20 , G06T5/50 , G06T2207/10024 , G06T2207/20016 , G06T2207/20182 , G06T2207/20208 , G06T2207/20221 , H04N5/208 , H04N5/217 , H04N9/646 , H04N9/67 , H04N9/69 , H04N9/73
Abstract: Techniques for de-noising a digital image using a multi-band noise filter and a unique combination of texture and chroma metrics are described. A novel texture metric may be used during multi-band filter operations on an image's luma channel to determine if a given pixel is associated with a textured/smooth region of the image. A novel chroma metric may be used during the the same multi-band filter operation to determine if the same pixel is associated with a blue/not-blue region of the image. Pixels identified as being associated with a smooth blue region may be aggressively de-noised and conservatively sharpened. Pixels identified as being associated with a textured blue region may be conservatively de-noised and aggressively sharpened. By coupling texture and chroma constraints it has been shown possible to mitigate noise in an image's smooth blue regions without affecting the edges/texture in other blue objects.
Abstract translation: 描述了使用多频带噪声滤波器去噪数字图像和纹理和色度度量的唯一组合的技术。 在图像的亮度信道的多频带滤波操作期间可以使用新的纹理度量,以确定给定像素是否与图像的纹理/平滑区域相关联。 在相同的多频带滤波器操作期间可以使用新的色度度量以确定相同的像素是否与图像的蓝色/非蓝色区域相关联。 被识别为与平滑蓝色区域相关联的像素可能被积极地去噪和保守地削尖。 识别为与纹理蓝色区域相关联的像素可以被保守地去噪和积极地削尖。 通过耦合纹理和色度约束,已经显示可以减轻图像平滑蓝色区域中的噪声,而不会影响其他蓝色对象中的边缘/纹理。
-
公开(公告)号:US09342871B2
公开(公告)日:2016-05-17
申请号:US14502887
申请日:2014-09-30
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号:US10523894B2
公开(公告)日:2019-12-31
申请号:US15266460
申请日:2016-09-15
Applicant: Apple Inc.
Inventor: Brett Keating , Vincent Wong , Todd Sachs , Claus Molgaard , Michael Rousson , Elliott Harris , Justin Titi , Karl Hsu , Jeff Brasket , Marco Zuliani
Abstract: Systems and methods for improving automatic selection of keeper images from a commonly captured set of images are described. A combination of image type identification and image quality metrics may be used to identify one or more images in the set as keeper images. Image type identification may be used to categorize the captured images into, for example, three or more categories. The categories may include portrait, action, or “other.” Depending on the category identified, the images may be analyzed differently to identify keeper images. For portrait images, an operation may be used to identify the best set of faces. For action images, the set may be divided into sections such that keeper images selected from each section tell the story of the action. For the “other” category, the images may be analyzed such that those having higher quality metrics for an identified region of interest are selected.
-
公开(公告)号:US10432861B2
公开(公告)日:2019-10-01
申请号:US16362253
申请日:2019-03-22
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/217 , H04N5/232 , H04N5/235 , G06T5/00 , G06T7/20 , G06T7/254 , H04N5/355 , G06T11/60 , G06T5/50 , H04N5/91 , H04N5/359
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
10.
公开(公告)号:US20190096441A1
公开(公告)日:2019-03-28
申请号:US16199645
申请日:2018-11-26
Applicant: Apple Inc.
Inventor: Claus Molgaard , Brett M. Keating , George E. Williams , Marco Zuliani , Vincent Y. Wong , Frank Doepke , Ethan J. Tira-Thompson
Abstract: The invention relates to systems, methods, and computer readable media for responding to a user snapshot request by capturing anticipatory pre-snapshot image data as well as post-snapshot image data. The captured information may be used, depending upon the embodiment, to create archival image information and image presentation information that is both useful and pleasing to a user. The captured information may automatically be trimmed or edited to facilitate creating an enhanced image, such as a moving still image. Varying embodiments of the invention offer techniques for trimming and editing based upon the following: exposure, brightness, focus, white balance, detected motion of the camera, substantive image analysis, detected sound, image metadata, and/or any combination of the foregoing.
-
-
-
-
-
-
-
-
-