公开(公告)号：US20180316864A1

公开(公告)日：2018-11-01

申请号：US16030632

申请日：2018-07-09

Applicant: Apple Inc.

Inventor： Claus Molgaard ,  Marius Tico ,  Rolf Toft ,  Paul M. Hubel

IPC: H04N5/232 ,  G06T5/00 ,  G06T5/50 ,  H04N5/235 ,  G06T7/20 ,  H04N5/91 ,  G06T7/254 ,  H04N5/355 ,  G06T11/60 ,  H04N5/359

CPC classification number: H04N5/23277 ,  G06T5/002 ,  G06T5/003 ,  G06T5/50 ,  G06T7/20 ,  G06T7/254 ,  G06T11/60 ,  G06T2207/10004 ,  G06T2207/10144 ,  G06T2207/20221 ,  H04N5/23229 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/2355 ,  H04N5/2356 ,  H04N5/35581 ,  H04N5/3597 ,  H04N5/91

Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.

公开(公告)号：US20180063441A1

公开(公告)日：2018-03-01

申请号：US15797768

申请日：2017-10-30

Applicant: Apple Inc.

Inventor： Claus Molgaard ,  Marius Tico ,  Rolf Toft ,  Paul M. Hubel

IPC: H04N5/232 ,  H04N5/359

CPC classification number: H04N5/23277 ,  G06T5/002 ,  G06T5/003 ,  G06T5/50 ,  G06T7/20 ,  G06T7/254 ,  G06T11/60 ,  G06T2207/10004 ,  G06T2207/10144 ,  G06T2207/20221 ,  H04N5/23229 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/2355 ,  H04N5/2356 ,  H04N5/35581 ,  H04N5/3597 ,  H04N5/91

Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.

公开(公告)号：US20170358101A1

公开(公告)日：2017-12-14

申请号：US15618641

申请日：2017-06-09

Applicant: Apple Inc.

Inventor： Thomas E. Bishop ,  Benjamin A. Darling ,  Kevin A. Gross ,  Marius Tico ,  Paul M. Hubel ,  Todd S. Sachs

IPC: G06T7/579 ,  H04N5/232 ,  H04N13/02

CPC classification number: H04N5/23287 ,  G06T7/593 ,  H04N13/239 ,  H04N2013/0081

Abstract: Depth determination includes obtaining a first image of a scene captured by a camera at a first position, obtaining a second image of the scene captured by the camera at a second position directed by an optical image stabilization (OIS) actuator, determining a virtual baseline between the camera at the first position and the second position, and determining a depth of the scene based on the first image, the second image, and the virtual baseline.

公开(公告)号：US20170237905A1

公开(公告)日：2017-08-17

申请号：US15587617

申请日：2017-05-05

Applicant: Apple Inc.

Inventor： Claus Molgaard ,  Marius Tico ,  Rolf Toft ,  Paul M. Hubel

IPC: H04N5/232

CPC classification number: H04N5/23277 ,  G06T5/002 ,  G06T5/003 ,  G06T5/50 ,  G06T7/20 ,  G06T7/254 ,  G06T11/60 ,  G06T2207/10004 ,  G06T2207/10144 ,  G06T2207/20221 ,  H04N5/23229 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/2355 ,  H04N5/2356 ,  H04N5/35581 ,  H04N5/3597 ,  H04N5/91

Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.

公开(公告)号：US20150350509A1

公开(公告)日：2015-12-03

申请号：US14292562

申请日：2014-05-30

Applicant: Apple Inc.

Inventor： Marius Tico ,  Rolf Toft ,  Paul M. Hubel

IPC: H04N5/235 ,  H04N5/265

CPC classification number: H04N5/2353 ,  G06T5/50 ,  G06T2207/10144 ,  G06T2207/20201 ,  G06T2207/20221 ,  H04N5/23277 ,  H04N5/2355 ,  H04N5/265

Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.

公开(公告)号：US20140363087A1

公开(公告)日：2014-12-11

申请号：US13911740

申请日：2013-06-06

Applicant: Apple Inc.

Inventor： Marius Tico ,  Jianping Zhou ,  Anita Nariani Schulze ,  Rolf Toft ,  Paul Hubel ,  Wei Sun

IPC: G06K9/46 ,  G06T5/00 ,  G06K9/62

CPC classification number: G06K9/46 ,  G06K9/6201 ,  G06T5/003 ,  G06T5/10 ,  G06T2207/10016 ,  G06T2207/10144 ,  G06T2207/20016 ,  G06T2207/20201 ,  G06T2207/20208 ,  G06T2207/20221 ,  H04N5/23267

Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. Novel approaches for fusing non-reference images with a pre-selected reference frame in a set of commonly captured images are disclosed. The fusing approach may use a soft transition by using a weighted average for ghost/non-ghost pixels to avoid sudden transition between neighborhood and almost similar pixels. Additionally, the ghost/non-ghost decision can be made based on a set of neighboring pixels rather than independently for each pixel. An alternative approach may involve performing a multi-resolution decomposition of all the captured images, using temporal fusion, spatio-temporal fusion, or combinations thereof, at each level and combining the different levels to generate an output image.

Abstract translation: 描述了用于改善图像稳定操作的系统，方法和计算机可读介质。 公开了一组用于将非参考图像与一组普通捕获图像中的预选参考帧融合的新方法。 融合方法可以通过使用重影/非重像素的加权平均值来使用软转换，以避免邻域和几乎相似像素之间的突然过渡。 此外，可以基于一组相邻像素而不是针对每个像素独立地进行重影/非重影决定。 替代方法可以包括在每个级别上使用时间融合，时空融合或其组合执行所有捕获图像的多分辨率分解，并组合不同的级别以生成输出图像。