Robust Image Feature Based Video Stabilization and Smoothing

    公开(公告)号:US20170126977A1

    公开(公告)日:2017-05-04

    申请号:US15012106

    申请日:2016-02-01

    Applicant: Apple Inc.

    Abstract: A method of removing unwanted camera motion from a video sequence is provided. The method matches a group of feature points between each pair of consecutive video frames in the video sequence. The method calculates the motion of each matched feature point between the corresponding pair of consecutive video frames. The method calculates a set of historical metrics for each feature point. The method, for each pair of consecutive video frames, identifies a homography that defines a dominant motion between the pair of consecutive frames. The homography is identified by performing a geometrically biased historically weighted RANSAC on the calculated motion of the feature points. The geometrically biased historically weighted RANSAC gives a weight to the calculated motion of each feature point based on the historical metrics calculated for the feature point. The method removes the unwanted camera motion from the video sequence using the identified homographies.

    Efficient machine-readable object detection and tracking
    12.
    发明授权
    Efficient machine-readable object detection and tracking 有权
    高效的机器可读对象检测和跟踪

    公开(公告)号:US09542585B2

    公开(公告)日:2017-01-10

    申请号:US13911983

    申请日:2013-06-06

    Applicant: Apple Inc.

    Abstract: A method to improve the efficiency of the detection and tracking of machine-readable objects is disclosed. The properties of image frames may be pre-evaluated to determine whether a machine-readable object, even if present in the image frames, would be likely to be detected. After it is determined that one or more image frames have properties that may enable the detection of a machine-readable object, image data may be evaluated to detect the machine-readable object. When a machine-readable object is detected, the location of the machine-readable object in a subsequent frame may be determined based on a translation metric between the image frame in which the object was identified and the subsequent frame rather than a detection of the object in the subsequent frame. The translation metric may be identified based on an evaluation of image data and/or motion sensor data associated with the image frames.

    Abstract translation: 公开了一种提高机器可读对象检测和跟踪效率的方法。 可以预先评估图像帧的属性,以确定即使存在于图像帧中的机器可读对象是否可能被检测到。 在确定一个或多个图像帧具有能够检测机器可读对象的属性之后,可以评估图像数据以检测机器可读对象。 当检测到机器可读对象时,可以基于在其中识别对象的图像帧与后续帧之间的转换度量而不是对象的检测来确定随后帧中的机器可读对象的位置 在后续的框架。 可以基于与图像帧相关联的图像数据和/或运动传感器数据的评估来识别翻译度量。

    Efficient Machine-Readable Object Detection and Tracking
    14.
    发明申请
    Efficient Machine-Readable Object Detection and Tracking 有权
    高效的机器可读对象检测和跟踪

    公开(公告)号:US20140363044A1

    公开(公告)日:2014-12-11

    申请号:US13911983

    申请日:2013-06-06

    Applicant: Apple Inc.

    Abstract: A method to improve the efficiency of the detection and tracking of machine-readable objects is disclosed. The properties of image frames may be pre-evaluated to determine whether a machine-readable object, even if present in the image frames, would be likely to be detected. After it is determined that one or more image frames have properties that may enable the detection of a machine-readable object, image data may be evaluated to detect the machine-readable object. When a machine-readable object is detected, the location of the machine-readable object in a subsequent frame may be determined based on a translation metric between the image frame in which the object was identified and the subsequent frame rather than a detection of the object in the subsequent frame. The translation metric may be identified based on an evaluation of image data and/or motion sensor data associated with the image frames.

    Abstract translation: 公开了一种提高机器可读对象检测和跟踪效率的方法。 可以预先评估图像帧的属性,以确定即使存在于图像帧中的机器可读对象是否可能被检测到。 在确定一个或多个图像帧具有能够检测机器可读对象的属性之后,可以评估图像数据以检测机器可读对象。 当检测到机器可读对象时,可以基于在其中识别对象的图像帧与后续帧之间的转换度量而不是对象的检测来确定随后帧中的机器可读对象的位置 在后续的框架。 可以基于与图像帧相关联的图像数据和/或运动传感器数据的评估来识别翻译度量。

    FEDERATED MOBILE DEVICE POSITIONING
    15.
    发明申请
    FEDERATED MOBILE DEVICE POSITIONING 有权
    联邦移动设备定位

    公开(公告)号:US20140247280A1

    公开(公告)日:2014-09-04

    申请号:US13783082

    申请日:2013-03-01

    Applicant: APPLE INC.

    CPC classification number: G06T19/006 G06F3/011

    Abstract: A user interface enables a user to calibrate the position of a three dimensional model with a real-world environment represented by that model. Using a device's sensor suite, the device's location and orientation is determined. A video image of the device's environment is displayed on the device's display. The device overlays a representation of an object from a virtual reality model on the video image. The position of the overlaid representation is determined based on the device's location and orientation. In response to user input, the device adjusts a position of the overlaid representation relative to the video image.

    Abstract translation: 用户界面使得用户能够用由该模型表示的现实环境来校准三维模型的位置。 使用设备的传感器套件,确定设备的位置和方向。 设备的环境的视频图像显示在设备的显示屏上。 该设备在视频图像上覆盖来自虚拟现实模型的对象的表示。 重叠表示的位置是根据设备的位置和方向来确定的。 响应于用户输入,设备调整相对于视频图像的重叠表示的位置。

    Registration between actual mobile device position and environmental model

    公开(公告)号:US10909763B2

    公开(公告)日:2021-02-02

    申请号:US16248677

    申请日:2019-01-15

    Applicant: Apple Inc.

    Abstract: A user interface enables a user to calibrate the position of a three dimensional model with a real-world environment represented by that model. Using a device's sensor, the device's location and orientation is determined. A video image of the device's environment is displayed on the device's display. The device overlays a representation of an object from a virtual reality model on the video image. The position of the overlaid representation is determined based on the device's location and orientation. In response to user input, the device adjusts a position of the overlaid representation relative to the video image.

    REGISTRATION BETWEEN ACTUAL MOBILE DEVICE POSITION AND ENVIRONMENTAL MODEL

    公开(公告)号:US20190147662A1

    公开(公告)日:2019-05-16

    申请号:US16248677

    申请日:2019-01-15

    Applicant: Apple Inc.

    Abstract: A user interface enables a user to calibrate the position of a three dimensional model with a real-world environment represented by that model. Using a device's sensor, the device's location and orientation is determined. A video image of the device's environment is displayed on the device's display. The device overlays a representation of an object from a virtual reality model on the video image. The position of the overlaid representation is determined based on the device's location and orientation. In response to user input, the device adjusts a position of the overlaid representation relative to the video image.

Patent Agency Ranking