Motion trajectory tracking for action detection

    公开(公告)号:US11488374B1

    公开(公告)日:2022-11-01

    申请号:US16578825

    申请日:2019-09-23

    申请人: Apple Inc.

    摘要: The disclosure pertains to techniques for image processing. One such technique comprises a method for image selection, comprising obtaining a sequence of images, detecting one or more objects in one or more images of the sequence of images, determining a location for each detected object in the one or more images, determining a trajectory for each detected object based on a determined location for each respective detected object in two or more images of the sequence of images, determining a trajectory waypoint score for the trajectory of each detected object, determining a set of selected images based on an aggregation of trajectory waypoint scores for each detected object in each respective image, and outputting the set of selected images for presentation.

    Adaptive Focus Sweep Techniques For Foreground/Background Separation

    公开(公告)号:US20170358094A1

    公开(公告)日:2017-12-14

    申请号:US15620131

    申请日:2017-06-12

    申请人: Apple Inc.

    IPC分类号: G06T7/194 G06T7/174

    摘要: Adaptive focus sweep (AFS) techniques for image processing are described. For one technique, an AFS logic/module can obtain an AFS representing a scene, where the AFS is a sequence of images representing the scene that includes: (i) a first image representing the scene captured at a first focus position; and (ii) a second image representing the scene captured at a second focus position that differs from the first focus position. The first focus position can be associated with a first depth of field (DOField) that is determined based on an autofocus technique. The second focus position can be associated with a second DOField, where the second focus position is at least two DOFields away from the first focus position. The AFS logic/module can detect a foreground of the scene in the first image based on information acquired from the first and second images. Other embodiments are described.

    Methods of image fusion for image stabilization
    3.
    发明授权
    Methods of image fusion for image stabilization 有权
    用于图像稳定的图像融合方法

    公开(公告)号:US09262684B2

    公开(公告)日:2016-02-16

    申请号:US13911740

    申请日:2013-06-06

    申请人: Apple Inc.

    摘要: Systems, methods, and computer readable media to improve image stabilization operations are described. Novel approaches for fusing non-reference images with a pre-selected reference frame in a set of commonly captured images are disclosed. The fusing approach may use a soft transition by using a weighted average for ghost/non-ghost pixels to avoid sudden transition between neighborhood and almost similar pixels. Additionally, the ghost/non-ghost decision can be made based on a set of neighboring pixels rather than independently for each pixel. An alternative approach may involve performing a multi-resolution decomposition of all the captured images, using temporal fusion, spatio-temporal fusion, or combinations thereof, at each level and combining the different levels to generate an output image.

    摘要翻译: 描述了用于改善图像稳定操作的系统,方法和计算机可读介质。 公开了一组用于将非参考图像与一组普通捕获图像中的预选参考帧融合的新方法。 融合方法可以通过使用重影/非重像素的加权平均值来使用软转换,以避免邻域和几乎相似像素之间的突然过渡。 此外,可以基于一组相邻像素而不是针对每个像素独立地进行重影/非重影决定。 替代方法可以包括在每个级别上使用时间融合,时空融合或其组合执行所有捕获图像的多分辨率分解,并组合不同的级别以生成输出图像。

    Shallow depth of field (SDOF) rendering

    公开(公告)号:US10897558B1

    公开(公告)日:2021-01-19

    申请号:US16566017

    申请日:2019-09-10

    申请人: Apple Inc.

    摘要: This disclosure relates to the lightweight and efficient synthesis of shallow depth of field (SDOF) renderings. According to some embodiments, coarse focus information and semantic segmentation information may be leveraged to generate SDOF renderings in a “live preview” or “streaming” mode. Semantic segmentation may be defined as a process of creating a mask over an image, wherein pixels are segmented into a predefined set of semantic classes. Segmentations may include as many classes as are desired by a given implementation (e.g., a ‘foreground’ class and a ‘background’ class). In some embodiments, the rendering of synthetic SDOF images according to the techniques described herein may be completed using only a single camera of a device and without the use of dedicated depth-sensing technology (e.g., structured light cameras, stereo cameras, time-of-flight cameras, etc.), thereby allowing the SDOF rendering process to operate in a fashion that is not unduly time-, processing-, and/or power-intensive.

    Methods of Image Fusion for Image Stabilization
    5.
    发明申请
    Methods of Image Fusion for Image Stabilization 有权
    图像融合的图像稳定方法

    公开(公告)号:US20140363087A1

    公开(公告)日:2014-12-11

    申请号:US13911740

    申请日:2013-06-06

    申请人: Apple Inc.

    IPC分类号: G06K9/46 G06T5/00 G06K9/62

    摘要: Systems, methods, and computer readable media to improve image stabilization operations are described. Novel approaches for fusing non-reference images with a pre-selected reference frame in a set of commonly captured images are disclosed. The fusing approach may use a soft transition by using a weighted average for ghost/non-ghost pixels to avoid sudden transition between neighborhood and almost similar pixels. Additionally, the ghost/non-ghost decision can be made based on a set of neighboring pixels rather than independently for each pixel. An alternative approach may involve performing a multi-resolution decomposition of all the captured images, using temporal fusion, spatio-temporal fusion, or combinations thereof, at each level and combining the different levels to generate an output image.

    摘要翻译: 描述了用于改善图像稳定操作的系统,方法和计算机可读介质。 公开了一组用于将非参考图像与一组普通捕获图像中的预选参考帧融合的新方法。 融合方法可以通过使用重影/非重像素的加权平均值来使用软转换,以避免邻域和几乎相似像素之间的突然过渡。 此外,可以基于一组相邻像素而不是针对每个像素独立地进行重影/非重影决定。 替代方法可以包括在每个级别上使用时间融合,时空融合或其组合执行所有捕获图像的多分辨率分解,并组合不同的级别以生成输出图像。