-
公开(公告)号:US20170358101A1
公开(公告)日:2017-12-14
申请号:US15618641
申请日:2017-06-09
Applicant: Apple Inc.
Inventor: Thomas E. Bishop , Benjamin A. Darling , Kevin A. Gross , Marius Tico , Paul M. Hubel , Todd S. Sachs
CPC classification number: H04N5/23287 , G06T7/593 , H04N13/239 , H04N2013/0081
Abstract: Depth determination includes obtaining a first image of a scene captured by a camera at a first position, obtaining a second image of the scene captured by the camera at a second position directed by an optical image stabilization (OIS) actuator, determining a virtual baseline between the camera at the first position and the second position, and determining a depth of the scene based on the first image, the second image, and the virtual baseline.
-
公开(公告)号:US20170237905A1
公开(公告)日:2017-08-17
申请号:US15587617
申请日:2017-05-05
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/232
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号:US20150350509A1
公开(公告)日:2015-12-03
申请号:US14292562
申请日:2014-05-30
Applicant: Apple Inc.
Inventor: Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/2353 , G06T5/50 , G06T2207/10144 , G06T2207/20201 , G06T2207/20221 , H04N5/23277 , H04N5/2355 , H04N5/265
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
34.
公开(公告)号:US20230101548A1
公开(公告)日:2023-03-30
申请号:US17934491
申请日:2022-09-22
Applicant: Apple Inc.
Inventor: Bosheng Zhang , Angelo M. Alaimo , Noah D. Bedard , Kathrin Berkner Cieslicki , Tongbo Chen , Paul M. Hubel , Farhan A. Baqai , Nicolas Pierre Bonnier , Bryan Dang
Abstract: A light source module includes an array of illumination elements and an optional projecting lens. The light source module is configured to receive or generate a control signal for adjusting different ones of the illumination elements to control a light field emitted from the light source module. In some embodiments, the light source module is also configured to adjust the projecting lens responsive to objects in an illuminated scene and a field of view of an imaging device. A controller for a light source module may determine a light field pattern based on various parameters including a field of view of an imaging device, an illumination sensitivity model of the imaging device, depth, ambient illumination and reflectivity of objects, configured illumination priorities including ambient preservation, background illumination and direct/indirect lighting balance, and so forth.
-
公开(公告)号:US20220092749A1
公开(公告)日:2022-03-24
申请号:US17029800
申请日:2020-09-23
Applicant: Apple Inc.
Inventor: Garrett M. Johnson , Paul M. Hubel
Abstract: Devices, methods, and program storage devices for creating and/or displaying backwards-compatible High Dynamic Range (HDR) images are disclosed, comprising: obtaining two or more exposures of a scene; creating a gain map based on at least one of the two or more exposures, wherein the gain map comprises a plurality of pixels each corresponding to a portion of the scene, and wherein values of the pixels in the gain map comprise indications of a brightness level of the corresponding portions of the scene; combining the two or more exposures to form a first image; tone mapping the first image based on a Standard Dynamic Range (SDR) format to generate a first SDR image of the scene; and storing the first SDR image and created gain map in a first enhanced image file. The first enhanced image file may be, e.g., a HEIF, HEIC, PNG, GIF, JPEG, or other suitable file format.
-
36.
公开(公告)号:US10771697B2
公开(公告)日:2020-09-08
申请号:US15696583
申请日:2017-09-06
Applicant: Apple Inc.
Inventor: Paul M. Hubel , Marius Tico , Ting Chen
Abstract: Techniques are disclosed for managing image capture and processing in a multi-camera imaging system. In such a system, a pair of cameras each may output a sequence of frames representing captured image data. The cameras' output may be synchronized to each other to cause synchronism in the image capture operations of the cameras. The system may assess image quality of frames output from the cameras and, based on the image quality, designate a pair of the frames to serve as a “reference frame pair.” Thus, one frame from the first camera and a paired frame from the second camera will be designated as the reference frame pair. The system may adjust each reference frame in the pair using other frames from their respective cameras. The reference frames also may be processed by other operations within the system, such as image fusion.
-
公开(公告)号:US10432861B2
公开(公告)日:2019-10-01
申请号:US16362253
申请日:2019-03-22
Applicant: Apple Inc.
Inventor: Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/217 , H04N5/232 , H04N5/235 , G06T5/00 , G06T7/20 , G06T7/254 , H04N5/355 , G06T11/60 , G06T5/50 , H04N5/91 , H04N5/359
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号:US20180278913A1
公开(公告)日:2018-09-27
申请号:US15936275
申请日:2018-03-26
Applicant: Apple Inc.
Inventor: Ziv Attar , Paul M. Hubel , Ilana Volfin , Sebastien Marineau-Mes
IPC: H04N13/15 , H04N13/257 , H04N13/239 , H04N9/78 , H04N5/232 , H04N9/43
Abstract: Techniques are disclosed for capturing stereoscopic images using one or more high color density or “full color” image sensors and one or more low color density or “sparse color” image sensors. Low color density image sensors, may include substantially fewer color pixels than the sensor's total number of pixels, as well as fewer color pixels than the total number of color pixels on the full color image sensor. More particularly, the mostly-monochrome image captured by the low color density image sensor may be used to reduce noise and increase the spatial resolution of an imaging system's output image. In addition, the color pixels present in the low color density image sensor may be used to identify and fill in color pixel values, e.g., for regions occluded in the image captured using the full color image sensor. Optical Image Stabilization and/or split photodiodes may be employed on one or more sensors.
-
公开(公告)号:US09860446B2
公开(公告)日:2018-01-02
申请号:US15441905
申请日:2017-02-24
Applicant: Apple Inc.
Inventor: Marius Tico , Paul M. Hubel , Frank Doepke , Todd S. Sachs
IPC: H04N5/232 , H04N5/14 , H04N5/357 , G06T7/11 , G06T7/174 , G06T5/50 , G06T7/00 , G06T7/20 , G06T11/60
CPC classification number: H04N5/23238 , G06T5/50 , G06T7/0002 , G06T7/11 , G06T7/174 , G06T7/20 , G06T11/60 , G06T2207/20076 , G06T2207/20221 , G06T2207/30242 , H04N5/14 , H04N5/357 , H04N5/3572
Abstract: Lens flare mitigation techniques determine which pixels in images of a sequence of images are likely to be pixels affected by lens flare. Once the lens flare areas of the images are determined, unwanted lens flare effects may be mitigated by various approaches, including reducing border artifacts along a seam between successive images, discarding entire images of the sequence that contain lens flare areas, and using tone-mapping to reduce the visibility of lens flare.
-
40.
公开(公告)号:US20170359534A1
公开(公告)日:2017-12-14
申请号:US15617503
申请日:2017-06-08
Applicant: Apple Inc.
Inventor: Xiaoxing Li , Paul M. Hubel , Marius Tico , Lech J. Szumilas
CPC classification number: H04N5/3572 , G06T5/50 , G06T2207/20221 , H04N5/2258 , H04N5/23238 , H04N5/265
Abstract: Foreign lighting effects, such as lens flare, are very common in natural images. In a two-camera-system, the two images may be fused together to generate one image of a better quality. However, there are frequently different foreign light patterns in the two images that form the image pair, e.g., due to the difference in lens design, sensor and position, etc. Directly fusing such pairs of images will result in non-photorealistic images, with composed foreign light patterns from both images from the image pair. This disclosure describes a general foreign light mitigation scheme to detect all kinds of foreign light region mismatches. The detected foreign light mismatch regions may be deemphasized or excluded in the fusion step, in order to create a fused image that keeps a natural-looking foreign light pattern that is close to what was seen by the user of an image capture device during an image capture preview mode.
-
-
-
-
-
-
-
-
-