公开(公告)号：US11158026B1

公开(公告)日：2021-10-26

申请号：US16825550

申请日：2020-03-20

Applicant: Apple Inc.

Inventor： Ahmed Tashrif Kamal ,  Florian Ciurea ,  Jianping Zhou ,  Paul Hubel

IPC: G06T3/40 ,  G06T5/00 ,  H04N13/239 ,  G06T3/00

Abstract: Electronic devices, computer readable storage media, and related methods are disclosed herein that are configured to stitch together images captured by multiple image capture devices of an image capture system. In particular, various techniques are employed to intelligently extend (and, optionally, smooth) the correspondence mapping between first and second images captured by image capture devices having different fields of view, e.g., fields of view that are at least partially overlapping and at least partially non-overlapping. The techniques may also include determining a “transitional” correspondence in a transitional region between the overlapping and non-overlapping regions of the fields of view, as well as performing one or more appearance correction operations to account for the different properties of the different image capture devices used to capture the first and second images. The techniques described herein may be employed to produce enhanced output images in either the still image or the video context.

公开(公告)号：US10735642B1

公开(公告)日：2020-08-04

申请号：US16584044

申请日：2019-09-26

Applicant: Apple Inc.

Inventor： Behkish J. Manzari ,  Alok Deshpande ,  Alan C. Dye ,  Craig M. Federighi ,  Paul Hubel ,  Nicholas Lupinetti ,  Jonathan McCormack ,  Grant Paul ,  William A. Sorrentino, III ,  Andre Souza Dos Santos

IPC: H04N5/232 ,  H04N5/262 ,  H04M1/725

Abstract: Media user interfaces are described, including user interfaces for capturing media (e.g., capturing a photo, recording a video), displaying media (e.g., displaying a photo, playing a video), editing media (e.g., modifying a photo, modifying a video), accessing media controls or settings (e.g., accessing controls or settings to capture photos or videos to capture videos), and automatically adjusting media (e.g., automatically modifying a photo, automatically modifying a video).

公开(公告)号：US09384552B2

公开(公告)日：2016-07-05

申请号：US13911793

申请日：2013-06-06

Applicant: Apple Inc.

Inventor： Jianping Zhou ,  Paul Hubel ,  Marius Tico ,  Anita Nariani Schulze ,  Rolf Toft

IPC: G06T7/00

CPC classification number: G06T7/0028 ,  G06T7/33 ,  G06T2207/10016 ,  G06T2207/20016

Abstract: Systems, methods, and computer readable media to improve image stabilization operations are described. A novel approach to pixel-based registration of non-reference images to a reference frame in a set of commonly captured images is disclosed which makes use of pyramid decomposition to more efficiently detect corners. The disclosed pixel-based registration operation may also be combined with motion sensor data-based registration approaches to register non-reference images with respect to the reference frame. When the registered non-reference images are combined with the pre-selected reference image, the resulting image is a quality stabilized image.

Abstract translation: 描述了用于改善图像稳定操作的系统，方法和计算机可读介质。 公开了一种将非参考图像基于像素的注册到一组共同拍摄的图像中的参考帧的新颖方法，其利用金字塔分解来更有效地检测角落。 所公开的基于像素的注册操作还可以与基于运动传感器数据的注册方法组合以便相对于参考帧来注册非参考图像。 当登记的非参考图像与预先选择的参考图像组合时，所得图像是质量稳定图像。

公开(公告)号：US09350916B2

公开(公告)日：2016-05-24

申请号：US13903671

申请日：2013-05-28

Applicant: Apple Inc.

Inventor： Russell Pflughaupt ,  Rolf Toft ,  Paul Hubel ,  Anita Nariani Schulze

IPC: H04N5/262 ,  H04N5/232 ,  G06T5/50 ,  G06T7/20 ,  H04N5/235

CPC classification number: H04N5/23267 ,  G06T5/50 ,  G06T7/246 ,  G06T2207/20208 ,  G06T2207/20221 ,  H04N5/2355 ,  H04N5/2356

Abstract: Systems, methods, and computer readable media to improve image stabilization operations and other image processing operations are described. A novel combination of interleaved image capture and image processing operations, e.g., image registration operations, may be employed on a bracketed capture of still images. Such techniques may result in improved camera performance and processing efficiency, as well as decreased shot-to-shot time intervals. In another embodiment, an image fusion portion of an image post-processing pipeline may also be performed in an interleaved fashion, such that each image in the sequence of obtained bracketed images may be incrementally added to an output composite image after it has been aligned with the preceding image or images from the sequence.

Abstract translation: 描述了用于改善图像稳定操作和其他图像处理操作的系统，方法和计算机可读介质。 交织图像捕捉和图像处理操作（例如，图像注册操作）的新颖组合可以用于静止图像的括号捕获。 这样的技术可以导致相机性能和处理效率的提高，并且可以降低镜头到拍摄时间间隔。 在另一个实施例中，图像后处理流水线的图像融合部分也可以以交错方式执行，使得所获得的包围图像的序列中的每个图像可以在与已被对齐的图像对准之后被递增地添加到输出合成图像 先前的图像或序列中的图像。