-
公开(公告)号:US20140363096A1
公开(公告)日:2014-12-11
申请号:US13911793
申请日:2013-06-06
Applicant: Apple Inc.
Inventor: Jianping Zhou , Paul Hubel , Marius Tico , Anita Nariani Schulze , Rolf Toft
IPC: G06T7/00
CPC classification number: G06T7/0028 , G06T7/33 , G06T2207/10016 , G06T2207/20016
Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. A novel approach to pixel-based registration of non-reference images to a reference frame in a set of commonly captured images is disclosed which makes use of pyramid decomposition to more efficiently detect corners. The disclosed pixel-based registration operation may also be combined with motion sensor data-based registration approaches to register non-reference images with respect to the reference frame. When the registered non-reference images are combined with the pre-selected reference image, the resulting image is a quality stabilized image.
Abstract translation: 描述了用于改善图像稳定操作的系统,方法和计算机可读介质。 公开了一种将非参考图像基于像素的注册到一组共同拍摄的图像中的参考帧的新颖方法,其利用金字塔分解来更有效地检测角落。 所公开的基于像素的注册操作还可以与基于运动传感器数据的注册方法组合以便相对于参考帧来注册非参考图像。 当登记的非参考图像与预先选择的参考图像组合时,所得图像是质量稳定图像。
-
公开(公告)号:US09357130B2
公开(公告)日:2016-05-31
申请号:US13909700
申请日:2013-06-04
Applicant: Apple Inc.
Inventor: Todd Sachs , Marius Tico , Rolf Toft , Paul Hubel , George Williams
CPC classification number: H04N5/23267 , H04N5/23254 , H04N5/23258 , H04N5/2356
Abstract: Techniques are disclosed for selectively capturing, retaining, and combining multiple sub-exposure images or brackets to yield a final image having diminished motion-induced blur and good noise characteristics. More specifically, after or during the capture of N brackets, the M best may be identified for combining into a single output image, (N>M). As used here, the term “best” means those brackets that exhibit the least amount of relative motion with respect to one another—with one caveat: integer pixel shifts may be preferred over sub-pixel shifts.
Abstract translation: 公开了用于选择性地捕获,保留和组合多个次曝光图像或括号以产生具有减小的运动引起的模糊和良好噪声特性的最终图像的技术。 更具体地说,在捕获N个括号之后或期间,可以识别M最佳以组合成单个输出图像(N> M)。 如这里所使用的,术语“最佳”是指相对于彼此表现出最小量的相对运动的括号 - 一个值得注意的是:整数像素偏移可能优于子像素位移。
-
公开(公告)号:US09262684B2
公开(公告)日:2016-02-16
申请号:US13911740
申请日:2013-06-06
Applicant: Apple Inc.
Inventor: Marius Tico , Jianping Zhou , Anita Nariani Schulze , Rolf Toft , Paul Hubel , Wei Sun
CPC classification number: G06K9/46 , G06K9/6201 , G06T5/003 , G06T5/10 , G06T2207/10016 , G06T2207/10144 , G06T2207/20016 , G06T2207/20201 , G06T2207/20208 , G06T2207/20221 , H04N5/23267
Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. Novel approaches for fusing non-reference images with a pre-selected reference frame in a set of commonly captured images are disclosed. The fusing approach may use a soft transition by using a weighted average for ghost/non-ghost pixels to avoid sudden transition between neighborhood and almost similar pixels. Additionally, the ghost/non-ghost decision can be made based on a set of neighboring pixels rather than independently for each pixel. An alternative approach may involve performing a multi-resolution decomposition of all the captured images, using temporal fusion, spatio-temporal fusion, or combinations thereof, at each level and combining the different levels to generate an output image.
Abstract translation: 描述了用于改善图像稳定操作的系统,方法和计算机可读介质。 公开了一组用于将非参考图像与一组普通捕获图像中的预选参考帧融合的新方法。 融合方法可以通过使用重影/非重像素的加权平均值来使用软转换,以避免邻域和几乎相似像素之间的突然过渡。 此外,可以基于一组相邻像素而不是针对每个像素独立地进行重影/非重影决定。 替代方法可以包括在每个级别上使用时间融合,时空融合或其组合执行所有捕获图像的多分辨率分解,并组合不同的级别以生成输出图像。
-
公开(公告)号:US10791273B1
公开(公告)日:2020-09-29
申请号:US16584693
申请日:2019-09-26
Applicant: Apple Inc.
Inventor: Behkish J. Manzari , Alok Deshpande , Alan C. Dye , Craig M. Federighi , Paul Hubel , Nicholas Lupinetti , Jonathan McCormack , Grant Paul , William A. Sorrentino, III , Andre Souza Dos Santos
IPC: H04N5/232
Abstract: Media user interfaces are described, including user interfaces for capturing media (e.g., capturing a photo, recording a video), displaying media (e.g., displaying a photo, playing a video), editing media (e.g., modifying a photo, modifying a video), accessing media controls or settings (e.g., accessing controls or settings to capture photos or videos to capture videos), and automatically adjusting media (e.g., automatically modifying a photo, automatically modifying a video).
-
公开(公告)号:US10735643B1
公开(公告)日:2020-08-04
申请号:US16584100
申请日:2019-09-26
Applicant: Apple Inc.
Inventor: Behkish J. Manzari , Alok Deshpande , Alan C. Dye , Craig M. Federighi , Paul Hubel , Nicholas Lupinetti , Jonathan McCormack , Grant Paul , William A. Sorrentino, III , Andre Souza Dos Santos
Abstract: Media user interfaces are described, including user interfaces for capturing media (e.g., capturing a photo, recording a video), displaying media (e.g., displaying a photo, playing a video), editing media (e.g., modifying a photo, modifying a video), accessing media controls or settings (e.g., accessing controls or settings to capture photos or videos to capture videos), and automatically adjusting media (e.g., automatically modifying a photo, automatically modifying a video).
-
公开(公告)号:US10715727B2
公开(公告)日:2020-07-14
申请号:US15978128
申请日:2018-05-12
Applicant: Apple Inc.
Inventor: Sebastien Marineau-Mes , Charles A. Mezak , Arwen Bradley , Alex T. Nelson , Douglas P. Mitchell , Claus Moelgaard , Jason Klivington , Rudolph van der Merwe , Zahra Sadeghipoor Kermani , Farhan Baqai , Todd Sachs , Paul Hubel
Abstract: In various implementations a method includes obtaining a plurality of source images, stabilizing the plurality of source images to generate a plurality of stabilized images, and averaging the plurality of stabilized image to generate a synthetic long exposure image. In various implementations, stabilizing the plurality of source images includes: selecting one of the plurality of source images to serve as a reference frame; and registering others of the plurality of source images to the reference frame by applying a perspective transformation to others of the plurality of the source images.
-
公开(公告)号:US20140267802A1
公开(公告)日:2014-09-18
申请号:US13909700
申请日:2013-06-04
Applicant: Apple Inc.
Inventor: Todd Sachs , Marius Tico , Rolf Toft , Paul Hubel , George Williams
CPC classification number: H04N5/23267 , H04N5/23254 , H04N5/23258 , H04N5/2356
Abstract: Techniques are disclosed for selectively capturing, retaining, and combining multiple sub-exposure images or brackets to yield a final image having diminished motion-induced blur and good noise characteristics. More specifically, after or during the capture of N brackets, the M best may be identified for combining into a single output image, (N>M). As used here, the term “best” means those brackets that exhibit the least amount of relative motion with respect to one another—with one caveat: integer pixel shifts may be preferred over sub-pixel shifts.
Abstract translation: 公开了用于选择性地捕获,保留和组合多个次曝光图像或括号以产生具有减小的运动引起的模糊和良好噪声特性的最终图像的技术。 更具体地说,在捕获N个括号之后或期间,可以识别M最佳以组合成单个输出图像(N> M)。 如这里所使用的,术语“最佳”是指相对于彼此表现出最小量的相对运动的括号 - 一个值得注意的是:整数像素偏移可能优于子像素位移。
-
公开(公告)号:US20180338086A1
公开(公告)日:2018-11-22
申请号:US15978128
申请日:2018-05-12
Applicant: Apple Inc.
Inventor: Sebastien Marineau-Mes , Charles A. Mezak , Arwen Bradley , Alex T. Nelson , Douglas P. Mitchell , Claus Moelgaard , Jason Klivington , Rudolph van der Merwe , Zahra Sadeghipoor Kermani , Farhan Baqai , Todd Sachs , Paul Hubel
Abstract: In various implementations a method includes obtaining a plurality of source images, stabilizing the plurality of source images to generate a plurality of stabilized images, and averaging the plurality of stabilized image to generate a synthetic long exposure image. In various implementations, stabilizing the plurality of source images includes: selecting one of the plurality of source images to serve as a reference frame; and registering others of the plurality of source images to the reference frame by applying a perspective transformation to others of the plurality of the source images.
-
公开(公告)号:US20140363087A1
公开(公告)日:2014-12-11
申请号:US13911740
申请日:2013-06-06
Applicant: Apple Inc.
Inventor: Marius Tico , Jianping Zhou , Anita Nariani Schulze , Rolf Toft , Paul Hubel , Wei Sun
CPC classification number: G06K9/46 , G06K9/6201 , G06T5/003 , G06T5/10 , G06T2207/10016 , G06T2207/10144 , G06T2207/20016 , G06T2207/20201 , G06T2207/20208 , G06T2207/20221 , H04N5/23267
Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. Novel approaches for fusing non-reference images with a pre-selected reference frame in a set of commonly captured images are disclosed. The fusing approach may use a soft transition by using a weighted average for ghost/non-ghost pixels to avoid sudden transition between neighborhood and almost similar pixels. Additionally, the ghost/non-ghost decision can be made based on a set of neighboring pixels rather than independently for each pixel. An alternative approach may involve performing a multi-resolution decomposition of all the captured images, using temporal fusion, spatio-temporal fusion, or combinations thereof, at each level and combining the different levels to generate an output image.
Abstract translation: 描述了用于改善图像稳定操作的系统,方法和计算机可读介质。 公开了一组用于将非参考图像与一组普通捕获图像中的预选参考帧融合的新方法。 融合方法可以通过使用重影/非重像素的加权平均值来使用软转换,以避免邻域和几乎相似像素之间的突然过渡。 此外,可以基于一组相邻像素而不是针对每个像素独立地进行重影/非重影决定。 替代方法可以包括在每个级别上使用时间融合,时空融合或其组合执行所有捕获图像的多分辨率分解,并组合不同的级别以生成输出图像。
-
10.
公开(公告)号:US20140354842A1
公开(公告)日:2014-12-04
申请号:US13903671
申请日:2013-05-28
Applicant: Apple Inc.
Inventor: Russell Pflughaupt , Rolf Toft , Paul Hubel , Anita Nariani Schulze
CPC classification number: H04N5/23267 , G06T5/50 , G06T7/246 , G06T2207/20208 , G06T2207/20221 , H04N5/2355 , H04N5/2356
Abstract: Systems, methods, and computer readable media to improve image stabilization operations and other image processing operations are described. A novel combination of interleaved image capture and image processing operations, e.g., image registration operations, may be employed on a bracketed capture of still images. Such techniques may result in improved camera performance and processing efficiency, as well as decreased shot-to-shot time intervals. In another embodiment, an image fusion portion of an image post-processing pipeline may also be performed in an interleaved fashion, such that each image in the sequence of obtained bracketed images may be incrementally added to an output composite image after it has been aligned with the preceding image or images from the sequence.
Abstract translation: 描述了用于改善图像稳定操作和其他图像处理操作的系统,方法和计算机可读介质。 交织图像捕捉和图像处理操作(例如,图像注册操作)的新颖组合可以用于静止图像的括号捕获。 这样的技术可以导致相机性能和处理效率的提高,并且可以降低镜头到拍摄时间间隔。 在另一个实施例中,图像后处理流水线的图像融合部分也可以以交错方式执行,使得所获得的包围图像的序列中的每个图像可以在与已被对齐的图像对准之后被递增地添加到输出合成图像 先前的图像或序列中的图像。
-
-
-
-
-
-
-
-
-