STILL IMAGE STABILIZATION/OPTICAL IMAGE STABILIZATION SYNCHRONIZATION IN MULTI-CAMERA IMAGE CAPTURE

    公开(公告)号:US20200374461A1

    公开(公告)日:2020-11-26

    申请号:US16990432

    申请日:2020-08-11

    Applicant: Apple Inc.

    Abstract: Techniques are disclosed for managing image capture and processing in a multi-camera imaging system. In such a system, a pair of cameras each may output a sequence of frames representing captured image data. The cameras' output may be synchronized to each other to cause synchronism in the image capture operations of the cameras. The system may assess image quality of frames output from the cameras and, based on the image quality, designate a pair of the frames to serve as a “reference frame pair.” Thus, one frame from the first camera and a paired frame from the second camera will be designated as the reference frame pair. The system may adjust each reference frame in the pair using other frames from their respective cameras. The reference frames also may be processed by other operations within the system, such as image fusion.

    Modeless video and still frame capture using interleaved frames of video and still resolutions
    2.
    发明授权
    Modeless video and still frame capture using interleaved frames of video and still resolutions 有权
    无模式视频和静态帧捕获使用视频和静止分辨率的交错帧

    公开(公告)号:US09344626B2

    公开(公告)日:2016-05-17

    申请号:US14082390

    申请日:2013-11-18

    Applicant: Apple Inc.

    Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture, but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.

    Abstract translation: 在一个实施例中,电子设备可以被配置为在视频捕获期间捕获静止帧,但是可以以比4×3宽高比和高于16×9宽高比视频帧的分辨率捕获静止帧。 该装置可以在视频序列中交错高分辨率,4×3帧和较低分辨率的16×9帧,并且当用户指示拍摄静止帧时可以捕获最近的较高分辨率,4×3帧。 或者,设备可以在视频序列中显示16×9帧,然后当按下快门按钮时,扩展为4×3帧。 该装置可以捕获静止帧并响应于快门按钮的释放而返回到16×9视频帧。

    Dual parallel processing of frames of raw image data
    3.
    发明授权
    Dual parallel processing of frames of raw image data 有权
    原始图像数据帧的双重并行处理

    公开(公告)号:US08988563B2

    公开(公告)日:2015-03-24

    申请号:US13705122

    申请日:2012-12-04

    Applicant: Apple Inc.

    Abstract: Systems, methods, and devices for dual processing of raw image data by main image processing and alternative image processing capabilities of an electronic device are provided. According to an embodiment, alternative image processing may analyze a first copy of a frame of raw image data before a second copy of the frame of raw image data is processed by main image processing. Thereafter, the main image processing may process the second copy of the frame of raw image. The main image processing may be calibrated based at least in part on the analysis of the first copy of the frame of raw image data.

    Abstract translation: 提供了通过主要图像处理和替代图像处理能力对原始图像数据进行双重处理的系统,方法和装置。 根据实施例,替代图像处理可以在通过主图像处理处理原始图像数据的帧的第二副本之前分析原始图像数据的帧的第一副本。 此后,主图像处理可以处理原始图像的帧的第二副本。 可以至少部分地基于原始图像数据的帧的第一副本的分析来校准主图像处理。

    Dual Processing of Raw Image Data
    4.
    发明申请
    Dual Processing of Raw Image Data 审中-公开
    原始图像数据的双重处理

    公开(公告)号:US20130342739A1

    公开(公告)日:2013-12-26

    申请号:US13705122

    申请日:2012-12-04

    Applicant: APPLE INC.

    Abstract: Systems, methods, and devices for dual processing of raw image data by main image processing and alternative image processing capabilities of an electronic device are provided. According to an embodiment, alternative image processing may analyze a first copy of a frame of raw image data before a second copy of the frame of raw image data is processed by main image processing. Thereafter, the main image processing may process the second copy of the frame of raw image. The main image processing may be calibrated based at least in part on the analysis of the first copy of the frame of raw image data.

    Abstract translation: 提供了通过主要图像处理和替代图像处理能力对原始图像数据进行双重处理的系统,方法和装置。 根据实施例,替代图像处理可以在通过主图像处理处理原始图像数据的帧的第二副本之前分析原始图像数据的帧的第一副本。 此后,主图像处理可以处理原始图像的帧的第二副本。 可以至少部分地基于原始图像数据的帧的第一副本的分析来校准主图像处理。

    Still image stabilization/optical image stabilization synchronization in multi-camera image capture

    公开(公告)号:US10771697B2

    公开(公告)日:2020-09-08

    申请号:US15696583

    申请日:2017-09-06

    Applicant: Apple Inc.

    Abstract: Techniques are disclosed for managing image capture and processing in a multi-camera imaging system. In such a system, a pair of cameras each may output a sequence of frames representing captured image data. The cameras' output may be synchronized to each other to cause synchronism in the image capture operations of the cameras. The system may assess image quality of frames output from the cameras and, based on the image quality, designate a pair of the frames to serve as a “reference frame pair.” Thus, one frame from the first camera and a paired frame from the second camera will be designated as the reference frame pair. The system may adjust each reference frame in the pair using other frames from their respective cameras. The reference frames also may be processed by other operations within the system, such as image fusion.

    Exposure Mapping and Dynamic Thresholding for Blending of Multiple Images Using Floating Exposure
    7.
    发明申请
    Exposure Mapping and Dynamic Thresholding for Blending of Multiple Images Using Floating Exposure 有权
    使用浮动曝光混合多个图像的曝光映射和动态阈值

    公开(公告)号:US20140362173A1

    公开(公告)日:2014-12-11

    申请号:US13911243

    申请日:2013-06-06

    Applicant: Apple Inc.

    CPC classification number: H04N5/23238

    Abstract: Special blend operations for wide area-of-view image generation utilizing a “floating auto exposure” scheme are described. Pixel values in the two images being stitched together are blended within a transition band around a “seam.” identified in the overlap region between the images after changes in exposure and/or color saturation are accounted for. In some embodiments, changes in exposure and/or color saturation are accounted for through the use of one or more exposure mapping curves, the selection and use of which are based, at least in part, on a determined “Exposure Ratio” value, i.e., the amount that the camera's exposure settings have deviated from their initial capture settings. In other embodiments, the Exposure Ratio value is also used to determine regions along the seam where either: alpha blending, Poisson blending—or a combination of the two—should be used to blend in the transitional areas on each side of the seam.

    Abstract translation: 描述利用“浮动自动曝光”方案的广视野图像生成的特殊混合操作。 缝合在一起的两个图像中的像素值被混合在围绕在曝光和/或色彩饱和度变化之后的图像之间的重叠区域中识别的“接缝”周围的过渡带内。 在一些实施方案中,通过使用一个或多个暴露映射曲线来考虑暴露和/或色彩饱和度的变化,其选择和使用至少部分地基于确定的“曝光比”值,即 相机曝光设置的偏移量与其初始拍摄设置有偏差。 在其他实施例中,曝光比值也用于确定沿着接缝的区域,其中:α混合,泊松混合或两者的组合应当用于在接缝的每一侧上的过渡区域中混合。

    Modeless video and still frame capture

    公开(公告)号:US10911673B2

    公开(公告)日:2021-02-02

    申请号:US16673173

    申请日:2019-11-04

    Applicant: Apple Inc.

    Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.

    Modeless Video and Still Frame Capture
    10.
    发明申请

    公开(公告)号:US20200068129A1

    公开(公告)日:2020-02-27

    申请号:US16673173

    申请日:2019-11-04

    Applicant: Apple Inc.

    Abstract: In an embodiment, an electronic device may be configured to capture still frames during video capture but may capture the still frames in the 4×3 aspect ratio and at higher resolution than the 16×9 aspect ratio video frames. The device may interleave high resolution, 4×3 frames and lower resolution 16×9 frames in the video sequence, and may capture the nearest higher resolution, 4×3 frame when the user indicates the capture of a still frame. Alternatively, the device may display 16×9 frames in the video sequence, and then expand to 4×3 frames when a shutter button is pressed. The device may capture the still frame and return to the 16×9 video frames responsive to a release of the shutter button.

Patent Agency Ranking