Real-time video stabilization for mobile devices based on on-board motion sensing

    公开(公告)号:US10027893B2

    公开(公告)日:2018-07-17

    申请号:US15151379

    申请日:2016-05-10

    Abstract: Real-time video stabilization for mobile devices based on on-board motion sensing. In accordance with a method embodiment of the present invention, a first image frame from a camera at a first time is accessed. A second image frame from the camera at a subsequent time is accessed. A crop polygon around scene content common to the first image frame and the second image frame is identified. Movement information describing movement of the camera in an interval between the first time and the second time is accessed. The crop polygon is warped to remove motion distortions of the second image frame is warped using the movement information. The warping may include defining a virtual camera that remains static when the movement of the camera is below a movement threshold. The movement information may describe the movement of the camera at each scan line of the second image frame.

    REAL-TIME VIDEO STABILIZATION FOR MOBILE DEVICES BASED ON ON-BOARD MOTION SENSING

    公开(公告)号:US20170332018A1

    公开(公告)日:2017-11-16

    申请号:US15151379

    申请日:2016-05-10

    Abstract: Real-time video stabilization for mobile devices based on on-board motion sensing. In accordance with a method embodiment of the present invention, a first image frame from a camera at a first time is accessed. A second image frame from the camera at a subsequent time is accessed. A crop polygon around scene content common to the first image frame and the second image frame is identified. Movement information describing movement of the camera in an interval between the first time and the second time is accessed. The crop polygon is warped to remove motion distortions of the second image frame is warped using the movement information. The warping may include defining a virtual camera that remains static when the movement of the camera is below a movement threshold. The movement information may describe the movement of the camera at each scan line of the second image frame.

    Interaction with and display of photographic images in an image stack
    3.
    发明授权
    Interaction with and display of photographic images in an image stack 有权
    在图像堆叠中与摄影图像的相互作用和显示

    公开(公告)号:US09412042B2

    公开(公告)日:2016-08-09

    申请号:US13870901

    申请日:2013-04-25

    Abstract: A number of images of a scene are captured and stored. The images are captured over a range of values for an attribute (e.g., a camera setting). One of the images is displayed. A location of interest in the displayed image is identified. Regions that correspond to the location of interest are identified in each of the images. Those regions are evaluated to identify which of the regions is rated highest with respect to the attribute relative to the other regions. The image that includes the highest-rated region is then displayed.

    Abstract translation: 捕获并存储场景的许多图像。 图像被捕获在属性值范围(例如,相机设置)上。 其中一个图像被显示。 识别显示图像中感兴趣的位置。 在每个图像中识别对应于感兴趣位置的区域。 对这些区域进行评估,以确定哪个区域相对于其他区域的属性的额定值最高。 然后显示包含最高等级区域的图像。

    UNIFIED OPTIMIZATION METHOD FOR END-TO-END CAMERA IMAGE PROCESSING FOR TRANSLATING A SENSOR CAPTURED IMAGE TO A DISPLAY IMAGE
    4.
    发明申请
    UNIFIED OPTIMIZATION METHOD FOR END-TO-END CAMERA IMAGE PROCESSING FOR TRANSLATING A SENSOR CAPTURED IMAGE TO A DISPLAY IMAGE 有权
    用于将传感器捕获的图像转换为显示图像的端到端相机图像处理的统一优化方法

    公开(公告)号:US20150206504A1

    公开(公告)日:2015-07-23

    申请号:US14600507

    申请日:2015-01-20

    Abstract: A computer implemented method of determining a latent image from an observed image is disclosed. The method comprises implementing a plurality of image processing operations within a single optimization framework, wherein the single optimization framework comprises solving a linear minimization expression. The method further comprises mapping the linear minimization expression onto at least one non-linear solver. Further, the method comprises using the non-linear solver, iteratively solving the linear minimization expression in order to extract the latent image from the observed image, wherein the linear minimization expression comprises: a data term, and a regularization term, and wherein the regularization term comprises a plurality of non-linear image priors.

    Abstract translation: 公开了一种从观察图像确定潜像的计算机实现方法。 该方法包括在单个优化框架内实现多个图像处理操作,其中单个优化框架包括求解线性最小化表达式。 该方法还包括将线性最小化表达映射到至少一个非线性求解器上。 此外,该方法包括使用非线性求解器,迭代地求解线性最小化表达以从观察图像中提取潜像,其中线性最小化表达式包括:数据项和正则化项,其中正则化 术语包括多个非线性图像先验。

    Techniques for registering and warping image stacks
    5.
    发明授权
    Techniques for registering and warping image stacks 有权
    注册和整理图像堆栈的技术

    公开(公告)号:US08929683B2

    公开(公告)日:2015-01-06

    申请号:US13874357

    申请日:2013-04-30

    CPC classification number: G06T5/50 G06T5/005 G06T2207/20208 G06T2207/20221

    Abstract: A set of images is processed to modify and register the images to a reference image in preparation for blending the images to create a high-dynamic range image. To modify and register a source image to a reference image, a processing unit generates correspondence information for the source image based on a global correspondence algorithm, generates a warped source image based on the correspondence information, estimates one or more color transfer functions for the source image, and fills the holes in the warped source image. The holes in the warped source image are filled based on either a rigid transformation of a corresponding region of the source image or a transformation of the reference image based on the color transfer functions.

    Abstract translation: 处理一组图像以将图像修改并注册到参考图像,以准备混合图像以创建高动态范围图像。 为了将源图像修改并注册到参考图像,处理单元基于全局对应算法生成源图像的对应信息,基于对应信息生成翘曲源图像,估计源的一个或多个颜色传递函数 图像,并填充翘曲的源图像中的孔。 基于源图像的相应区域的刚性变换或基于颜色传递函数的参考图像的变换来填充翘曲源图像中的孔。

    Technique for deblurring images
    9.
    发明授权

    公开(公告)号:US09767538B2

    公开(公告)日:2017-09-19

    申请号:US14018362

    申请日:2013-09-04

    Inventor: Kari Pulli

    CPC classification number: G06T5/003 G06T7/215 G06T2207/20201

    Abstract: An image capture application captures a sequence of images via a digital camera. The sequence of images may have undesirable levels of blurriness due to the motion of objects in the field of view of the digital camera or due to movement of the digital camera itself. A deblur engine within the image capture application generates image segments within one of the captured images, where a given image segment includes pixel values that move coherently between different images in the sequence. The deblur engine then deblurs each image segment based on the coherent motion of each different image segment and combines the resultant, deblurred image segments into a deblurred image. Advantageously, blurriness caused by the combined effects of moving objects and camera motion may be reduced, thereby improving the ability of a digital camera to provide high-quality images. As such, the user experience of digital photography may be enhanced.

    SUPERRESOLUTION DISPLAY USING CASCADED PANELS
    10.
    发明申请
    SUPERRESOLUTION DISPLAY USING CASCADED PANELS 有权
    使用镶嵌板的超级显示屏

    公开(公告)号:US20150310798A1

    公开(公告)日:2015-10-29

    申请号:US14660637

    申请日:2015-03-17

    Abstract: System and method of displaying images in temporal superresolution by multiplicative superposition of cascaded display layers integrated in a display device. Using an original video with a target temporal resolution as a priori, a factorization process is performed to derive respective image data for presentation on each display layer. The multiple layers are refreshed in staggered intervals to synthesize a video with an effective refresh rate exceeding that of each individual display layer, e.g., by a factor equal to the number of layers. Further optically averaging neighboring pixels can minimize artifacts.

    Abstract translation: 通过在显示装置中集成的级联显示层的乘法叠加在时间超分辨率中显示图像的系统和方法。 使用具有目标时间分辨率的原始视频作为先验,执行因式分解处理以导出用于在每个显示层上呈现的各个图像数据。 多层以交错的间隔刷新以合成具有超过每个单独显示层的有效刷新率的视频,例如等于层数的因子。 进一步光学平均相邻像素可以最小化伪像。

Patent Agency Ranking