VIDEO ROLLING SHUTTER CORRECTION FOR LENS MOVEMENT IN OPTICAL IMAGE STABILIZATION CAMERAS
    1.
    发明申请
    VIDEO ROLLING SHUTTER CORRECTION FOR LENS MOVEMENT IN OPTICAL IMAGE STABILIZATION CAMERAS 有权
    光学图像稳定摄像机镜头运动的视频滚动快门校正

    公开(公告)号:US20150350550A1

    公开(公告)日:2015-12-03

    申请号:US14547107

    申请日:2014-11-18

    申请人: Apple Inc.

    IPC分类号: H04N5/232 H04N5/225

    摘要: In some embodiments, a method for compensating for lens motion includes estimating a starting position of a lens assembly associated with captured pixel data. The captured pixel data is captured from an image sensor. In some embodiments, the method further includes calculating from the starting position and position data received from the one or more position sensors lens movement associated with the captured pixel data. The lens movement is mapped into pixel movement associated with the captured pixel data. A transform matrix is adjusted to reflect at least the pixel movement. A limit factor associated with the position data is calculated. The captured pixel data is recalculated using the transform matrix and the limit factor.

    摘要翻译: 在一些实施例中,用于补偿透镜运动的方法包括估计与捕获的像素数据相关联的透镜组件的起始位置。 从图像传感器捕获捕获的像素数据。 在一些实施例中,该方法还包括从与所捕获的像素数据相关联的一个或多个位置传感器透镜运动接收到的起始位置和位置数据进行计算。 透镜移动被映射到与捕获的像素数据相关联的像素运动。 调整变换矩阵以至少反映像素移动。 计算与位置数据相关联的极限因子。 使用变换矩阵和极限因子重新计算捕获的像素数据。

    Combined Optical And Electronic Image Stabilization

    公开(公告)号:US20170280059A1

    公开(公告)日:2017-09-28

    申请号:US15457377

    申请日:2017-03-13

    申请人: Apple Inc.

    IPC分类号: H04N5/232 G06T5/20

    摘要: Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.

    Video Image Stabilization
    3.
    发明申请
    Video Image Stabilization 有权
    视频图像稳定

    公开(公告)号:US20150350548A1

    公开(公告)日:2015-12-03

    申请号:US14467987

    申请日:2014-08-25

    申请人: Apple Inc.

    IPC分类号: H04N5/232 G06T7/00 G06T5/00

    摘要: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.

    摘要翻译: 呈现允许数字图像捕获设备实时(视频捕获操作期间)稳定视频流的技术。 通常,公开了用于使用过扫描区域稳定视频图像的技术,以及通过在生成第一稳定视频输出帧之前缓冲多个视频输入帧而启用的先行技术。 (捕获比所显示的图像更大的图像在图像的边缘周围产生像素的缓冲器;过扫描是给予该像素缓冲器的术语。)更具体地,公开了用于缓冲​​初始数量的输入帧的技术, 当前“帧可以使用来自”过去“和”未来“帧的运动数据来调整稳定度量值的强度,以便将当前帧保持在其过扫描内。 这种前瞻性和后仰能力允许更平稳的稳定方案,具有较少的突然调整。

    Parallax Depth Rendering
    4.
    发明申请
    Parallax Depth Rendering 审中-公开
    视差深度渲染

    公开(公告)号:US20150235408A1

    公开(公告)日:2015-08-20

    申请号:US14181343

    申请日:2014-02-14

    申请人: Apple Inc.

    IPC分类号: G06T15/00 G06T7/00 G06T3/00

    摘要: A pseudo-three dimensional image may be created from a two dimensional image by segmenting the two dimensional image, adjusting the scale of individual segments of the two dimensional image, then superimposing the scaled segment as layers of the pseudo-three dimensional image. By detecting changes in relative orientation of an observer and a programmable device displaying the pseudo-three dimensional image, then translating the scaled segments according to the orientation change, parallax effects may be simulated, enhancing the view of the pseudo-three dimensional image.

    摘要翻译: 可以通过分割二维图像,调整二维图像的各个段的比例,然后将缩放的段叠加成伪三维图像的层,从二维图像创建伪三维图像。 通过检测观察者和显示伪三维图像的可编程装置的相对取向的变化,然后根据取向变化平移缩放的段,可以模拟视差效应,增强伪三维图像的视图。

    Video Image Stabilization
    5.
    发明申请

    公开(公告)号:US20160337589A1

    公开(公告)日:2016-11-17

    申请号:US15218405

    申请日:2016-07-25

    申请人: Apple Inc.

    IPC分类号: H04N5/232

    摘要: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.

    Video image stabilization
    6.
    发明授权
    Video image stabilization 有权
    视频图像稳定

    公开(公告)号:US09413963B2

    公开(公告)日:2016-08-09

    申请号:US14467987

    申请日:2014-08-25

    申请人: Apple Inc.

    IPC分类号: H04N5/232 G06T5/00 G06T7/00

    摘要: Techniques to permit a digital image capture device to stabilize a video stream in real-time (during video capture operations) are presented. In general, techniques are disclosed for stabilizing video images using an overscan region and a look-ahead technique enabled by buffering a number of video input frames before generating a first stabilized video output frame. (Capturing a larger image than is displayed creates a buffer of pixels around the edge of an image; overscan is the term given to this buffer of pixels.) More particularly, techniques are disclosed for buffering an initial number of input frames so that a “current” frame can use motion data from both “past” and “future” frames to adjust the strength of a stabilization metric value so as to keep the current frame within its overscan. This look-ahead and look-behind capability permits a smoother stabilizing regime with fewer abrupt adjustments.

    摘要翻译: 呈现允许数字图像捕获设备实时(视频捕获操作期间)稳定视频流的技术。 通常,公开了用于使用过扫描区域稳定视频图像的技术,以及通过在生成第一稳定视频输出帧之前缓冲多个视频输入帧而启用的先行技术。 (捕获比所显示的图像更大的图像在图像的边缘周围产生像素的缓冲器;过扫描是给予该像素缓冲器的术语。)更具体地,公开了用于缓冲​​初始数量的输入帧的技术, 当前“帧可以使用来自”过去“和”未来“帧的运动数据来调整稳定度量值的强度,以便将当前帧保持在其过扫描内。 这种前瞻性和后仰能力允许更平稳的稳定方案,具有较少的突然调整。

    Video rolling shutter correction for lens movement in optical image stabilization cameras
    7.
    发明授权
    Video rolling shutter correction for lens movement in optical image stabilization cameras 有权
    视频滚动快门校正用于光学防抖相机中的镜头移动

    公开(公告)号:US09357132B2

    公开(公告)日:2016-05-31

    申请号:US14547107

    申请日:2014-11-18

    申请人: Apple Inc.

    IPC分类号: H04N5/228 H04N5/232 H04N5/225

    摘要: In some embodiments, a method for compensating for lens motion includes estimating a starting position of a lens assembly associated with captured pixel data. The captured pixel data is captured from an image sensor. In some embodiments, the method further includes calculating from the starting position and position data received from the one or more position sensors lens movement associated with the captured pixel data. The lens movement is mapped into pixel movement associated with the captured pixel data. A transform matrix is adjusted to reflect at least the pixel movement. A limit factor associated with the position data is calculated. The captured pixel data is recalculated using the transform matrix and the limit factor.

    摘要翻译: 在一些实施例中,用于补偿透镜运动的方法包括估计与捕获的像素数据相关联的透镜组件的起始位置。 从图像传感器捕获捕获的像素数据。 在一些实施例中,该方法还包括从与所捕获的像素数据相关联的一个或多个位置传感器透镜运动接收到的起始位置和位置数据进行计算。 透镜移动被映射到与捕获的像素数据相关联的像素运动。 调整变换矩阵以至少反映像素运动。 计算与位置数据相关联的极限因子。 使用变换矩阵和极限因子重新计算捕获的像素数据。

    Camera voice coil motor driver circuit with variable power supply input voltage

    公开(公告)号:US10187573B2

    公开(公告)日:2019-01-22

    申请号:US14798005

    申请日:2015-07-13

    申请人: Apple Inc.

    IPC分类号: H04N5/228 H04N5/232

    摘要: In a portable camera device, a variable voltage regulator produces a power supply voltage of a VCM driver circuit that conducts the coil current of a VCM actuator as part of an optical image stabilization (OIS) mechanism. A processor signals the variable voltage regulator to increase the power supply voltage when the camera device transitions from still capture mode or preview mode to video capture mode, where the increase causes an increase in stroke of the VCM OIS actuator. Other embodiments are also described and claimed.

    Combined optical and electronic image stabilization
    10.
    发明授权
    Combined optical and electronic image stabilization 有权
    组合光学和电子图像稳定

    公开(公告)号:US09596411B2

    公开(公告)日:2017-03-14

    申请号:US14864709

    申请日:2015-09-24

    申请人: Apple Inc.

    IPC分类号: H04N5/232 H04N5/225

    摘要: Techniques to improve a digital image capture device's ability to stabilize a video stream are presented. According to some embodiments, improved stabilization of captured video frames is provided by intelligently harnessing the complementary effects of both optical image stabilization (OIS) and electronic image stabilization (EIS). In particular, OIS may be used to remove intra-frame motion blur that is typically lower in amplitude and dominates with longer integration times, while EIS may be used to remove residual unwanted frame-to-frame motion that is typically larger in amplitude. The techniques disclosed herein may also leverage information provided from the image capture device's OIS system to perform improved motion blur-aware video stabilization strength modulation, which permits better video stabilization performance in low light conditions, where integration times tend to be longer, thus leading to a greater amount of motion blurring in the output stabilized video.

    摘要翻译: 介绍了提高数字图像采集设备稳定视频流能力的技术。 根据一些实施例,通过智能地利用光学图像稳定(OIS)和电子图像稳定(EIS)的补充效果来提供捕获的视频帧的改进的稳定性。 特别地,OIS可以用于去除通常在幅度上较低的帧内运动模糊并且以更长的积分时间为主,而EIS可用于去除通常较大振幅的残留的不希望的帧到帧运动。 本文公开的技术还可以利用从图像捕获设备的OIS系统提供的信息来执行改进的运动模糊感知视频稳定强度调制,其允许在低光条件下更好的视频稳定性能,其中集成时间趋于更长,从而导致 输出稳定视频中的运动模糊量更大。