-
公开(公告)号：US09979889B2
公开(公告)日：2018-05-22
申请号：US15457377
申请日：2017-03-13
Applicant: Apple Inc.
Inventor： Damien J. Thivent , George E. Williams , Jianping Zhou , Richard L. Baer , Rolf Toft , Sebastien X. Beysserie
CPC classification number: H04N5/23287 , G06T5/20 , H04N5/2254 , H04N5/23254 , H04N5/23258 , H04N5/23267 , H04N5/2328
Abstract: Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.
-
公开(公告)号：US20180063441A1
公开(公告)日：2018-03-01
申请号：US15797768
申请日：2017-10-30
Applicant: Apple Inc.
Inventor： Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号：US20170237905A1
公开(公告)日：2017-08-17
申请号：US15587617
申请日：2017-05-05
Applicant: Apple Inc.
Inventor： Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/232
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号：US20150350509A1
公开(公告)日：2015-12-03
申请号：US14292562
申请日：2014-05-30
Applicant: Apple Inc.
Inventor： Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/2353 , G06T5/50 , G06T2207/10144 , G06T2207/20201 , G06T2207/20221 , H04N5/23277 , H04N5/2355 , H04N5/265
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号：US20140363087A1
公开(公告)日：2014-12-11
申请号：US13911740
申请日：2013-06-06
Applicant: Apple Inc.
Inventor： Marius Tico , Jianping Zhou , Anita Nariani Schulze , Rolf Toft , Paul Hubel , Wei Sun
CPC classification number: G06K9/46 , G06K9/6201 , G06T5/003 , G06T5/10 , G06T2207/10016 , G06T2207/10144 , G06T2207/20016 , G06T2207/20201 , G06T2207/20208 , G06T2207/20221 , H04N5/23267
Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. Novel approaches for fusing non-reference images with a pre-selected reference frame in a set of commonly captured images are disclosed. The fusing approach may use a soft transition by using a weighted average for ghost/non-ghost pixels to avoid sudden transition between neighborhood and almost similar pixels. Additionally, the ghost/non-ghost decision can be made based on a set of neighboring pixels rather than independently for each pixel. An alternative approach may involve performing a multi-resolution decomposition of all the captured images, using temporal fusion, spatio-temporal fusion, or combinations thereof, at each level and combining the different levels to generate an output image.
Abstract translation: 描述了用于改善图像稳定操作的系统，方法和计算机可读介质。 公开了一组用于将非参考图像与一组普通捕获图像中的预选参考帧融合的新方法。 融合方法可以通过使用重影/非重像素的加权平均值来使用软转换，以避免邻域和几乎相似像素之间的突然过渡。 此外，可以基于一组相邻像素而不是针对每个像素独立地进行重影/非重影决定。 替代方法可以包括在每个级别上使用时间融合，时空融合或其组合执行所有捕获图像的多分辨率分解，并组合不同的级别以生成输出图像。
-
Patent Agency Ranking
公开(公告)号：US20140354842A1
公开(公告)日：2014-12-04
申请号：US13903671
申请日：2013-05-28
Applicant: Apple Inc.
Inventor： Russell Pflughaupt , Rolf Toft , Paul Hubel , Anita Nariani Schulze
CPC classification number: H04N5/23267 , G06T5/50 , G06T7/246 , G06T2207/20208 , G06T2207/20221 , H04N5/2355 , H04N5/2356
Abstract: Systems, methods, and computer readable media to improve image stabilization operations and other image processing operations are described. A novel combination of interleaved image capture and image processing operations, e.g., image registration operations, may be employed on a bracketed capture of still images. Such techniques may result in improved camera performance and processing efficiency, as well as decreased shot-to-shot time intervals. In another embodiment, an image fusion portion of an image post-processing pipeline may also be performed in an interleaved fashion, such that each image in the sequence of obtained bracketed images may be incrementally added to an output composite image after it has been aligned with the preceding image or images from the sequence.
Abstract translation: 描述了用于改善图像稳定操作和其他图像处理操作的系统，方法和计算机可读介质。 交织图像捕捉和图像处理操作（例如，图像注册操作）的新颖组合可以用于静止图像的括号捕获。 这样的技术可以导致相机性能和处理效率的提高，并且可以降低镜头到拍摄时间间隔。 在另一个实施例中，图像后处理流水线的图像融合部分也可以以交错方式执行，使得所获得的包围图像的序列中的每个图像可以在与已被对齐的图像对准之后被递增地添加到输出合成图像 先前的图像或序列中的图像。
-
公开(公告)号：US20190222766A1
公开(公告)日：2019-07-18
申请号：US16362253
申请日：2019-03-22
Applicant: Apple Inc.
Inventor： Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
IPC: H04N5/232 , G06T11/60 , G06T5/50 , H04N5/235 , H04N5/91 , G06T5/00 , G06T7/20 , G06T7/254 , H04N5/355
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号：US10033927B2
公开(公告)日：2018-07-24
申请号：US15797768
申请日：2017-10-30
Applicant: Apple Inc.
Inventor： Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short- and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
-
公开(公告)号：US09491360B2
公开(公告)日：2016-11-08
申请号：US13911873
申请日：2013-06-06
Applicant: Apple Inc.
Inventor： Anita Nariani Schulze , Rolf Toft , Paul M. Hubel , Marius Tico , Jianping Zhou , Ralph Brunner , Claus Molgaard
IPC: H04N5/232
CPC classification number: H04N5/23277
Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. A novel combination of image quality and commonality metrics are used to identify a reference frame from a set of commonly captured images which, when the set's other images are combined with it, results in a quality stabilized image. The disclosed image quality and commonality metrics may also be used to optimize the use of a limited amount of image buffer memory during image capture sequences that return more images that the memory may accommodate at one time. Image quality and commonality metrics may also be used to effect the combination of multiple relatively long-exposure images which, when combined with a one or more final (relatively) short-exposure images, yields images exhibiting motion-induced blurring in interesting and visually pleasing ways.
Abstract translation: 描述了用于改善图像稳定操作的系统，方法和计算机可读介质。 使用图像质量和共性度量的新颖组合来从一组共同拍摄的图像中识别参考帧，当集合的其他图像与其组合时，其导致质量稳定的图像。 公开的图像质量和通用性度量还可以用于在图像捕获序列期间优化使用有限量的图像缓冲存储器，从而可以一次返回存储器可以容纳的更多图像。 图像质量和共性度量也可用于影响多个相对较长曝光图像的组合，当与一个或多个最终（相对）短曝光图像组合时，产生显示运动诱导的模糊的图像，其在有趣和视觉上令人满意 方法。
-
公开(公告)号：US20160301873A1
公开(公告)日：2016-10-13
申请号：US15154659
申请日：2016-05-13
Applicant: Apple Inc.
Inventor： Claus Molgaard , Marius Tico , Rolf Toft , Paul M. Hubel
CPC classification number: H04N5/23277 , G06T5/002 , G06T5/003 , G06T5/50 , G06T7/20 , G06T7/254 , G06T11/60 , G06T2207/10004 , G06T2207/10144 , G06T2207/20221 , H04N5/23229 , H04N5/23254 , H04N5/23267 , H04N5/2355 , H04N5/2356 , H04N5/35581 , H04N5/3597 , H04N5/91
Abstract: Techniques to capture and fuse short- and long-exposure images of a scene from a stabilized image capture device are disclosed. More particularly, the disclosed techniques use not only individual pixel differences between co-captured short- and long-exposure images, but also the spatial structure of occluded regions in the long-exposure images (e.g., areas of the long-exposure image(s) exhibiting blur due to scene object motion). A novel device used to represent this feature of the long-exposure image is a “spatial difference map.” Spatial difference maps may be used to identify pixels in the short-and long-exposure images for fusion and, in one embodiment, may be used to identify pixels from the short-exposure image(s) to filter post-fusion so as to reduce visual discontinuities in the output image.
Abstract translation: 公开了从稳定的图像捕获装置捕捉和融合场景的短曝光和长曝光图像的技术。 更具体地，所公开的技术不仅使用共同拍摄的短曝光图像和长曝光图像之间的单独像素差异，而且使用长曝光图像中的遮挡区域的空间结构（例如，长曝光图像的区域 ）呈现由于场景物体运动造成的模糊）。 用于表示长曝光图像的该特征的新型装置是“空间差异图”。空间差异图可以用于识别短和长曝光图像中用于融合的像素，并且在一个实施例中可以是 用于识别来自短曝光图像的像素以过滤融合后的图像，以减少输出图像中的视觉不连续性。
-
-
-
-
-
-
-
-
-
Search Results
32
records
(took 0.021 seconds)
