Keypoint detection and feature descriptor computation

    公开(公告)号:US12236631B2

    公开(公告)日:2025-02-25

    申请号:US17484601

    申请日:2021-09-24

    Abstract: Systems and techniques are described herein for processing frames. The systems and techniques can be implemented by various types of systems, such as by an extended reality (XR) system or device. In some cases, a process can include obtaining feature information associated with a feature in a current frame, wherein the feature information is based on one or more previous frames; determining an estimated pose of the apparatus associated with the current frame; obtaining a distance associated with the feature in the current frame; and determining an estimated scale of the feature in the current frame based on the feature information associated with the feature, the estimated pose, and the distance associated with the feature.

    Occlusion handling for computer vision
    3.
    发明授权
    Occlusion handling for computer vision 有权
    计算机视觉遮挡处理

    公开(公告)号:US09412034B1

    公开(公告)日:2016-08-09

    申请号:US14609371

    申请日:2015-01-29

    Abstract: Disclosed are a system, apparatus, and method for performing occlusion handling for simultaneous localization and mapping. Occluded map points may be detected according to a depth-mask created according to an image keyframe. Dividing a scene into sections may optimize the depth-mask. Size of depth-mask points may be adjusted according to intensity. Visibility may be verified with an optimized subset of possible map points. Visibility may be propagated to nearby points in response to determining an initial visibility of a first point's surrounding image patch. Visibility may also be organized and optimized according to a grid.

    Abstract translation: 公开了一种用于执行同时定位和映射的遮挡处理的系统,装置和方法。 可以根据根据图像关键帧创建的深度掩模来检测闭合的地图点。 将场景划分为多个部分可以优化深度掩码。 深度屏蔽点的大小可以根据强度进行调整。 可以通过可能的地图点的优化子集验证可见性。 响应于确定第一点的周围图像块的初始可视性,可见性可以传播到附近点。 还可以根据网格组织和优化可见性。

    Motion blur aware visual pose tracking
    4.
    发明授权
    Motion blur aware visual pose tracking 有权
    运动模糊感知视觉姿态跟踪

    公开(公告)号:US09152874B2

    公开(公告)日:2015-10-06

    申请号:US13801601

    申请日:2013-03-13

    Abstract: Various methods, apparatuses and/or articles of manufacture are provided which may be implemented for use by an electronic device to track objects across two or more digital images. For example, an electronic device may generate a plurality of warped patches corresponding to a reference patch of a reference image, and combine two or more warped patches to form a blurred warped patch corresponding to the reference patch with a motion blur effect applied to a digital representation corresponding to a keypoint of an object to be tracked.

    Abstract translation: 提供了各种方法,装置和/或制造品,其可以被实现为由电子设备用于跟踪跨越两个或更多个数字图像的物体。 例如,电子设备可以生成与参考图像的参考图像相对应的多个翘曲的斑块,并且组合两个或更多个扭曲的斑块以形成与参考斑块相对应的模糊的弯曲斑块,其中运动模糊效应被应用于数字 对应于要跟踪的对象的关键点的表示。

    HYPOTHESES LINE MAPPING AND VERIFICATION FOR 3D MAPS
    7.
    发明申请
    HYPOTHESES LINE MAPPING AND VERIFICATION FOR 3D MAPS 有权
    用于3D MAPS的线性映射和验证

    公开(公告)号:US20170004377A1

    公开(公告)日:2017-01-05

    申请号:US14791205

    申请日:2015-07-02

    Abstract: Disclosed are a device, apparatus, and method for performing line mapping. A three-dimensional (3D) map that includes at least a first and a second 3D line corresponding to an aspect of a real world environment may be obtained. One or more images of the aspect may also be obtained and hypotheses 3D lines may be determined. The hypothesis 3D lines may be verified with the one or more images and the 3D map may be updated. The determination and verification of the hypothesis 3D lines may include creating a plane in 3D space and using co-planarity or orthogonality assumptions.

    Abstract translation: 公开了一种用于执行线映射的装置,装置和方法。 可以获得包括对应于真实世界环境的方面的至少第一和第二3D线的三维(3D)地图。 也可以获得该方面的一个或多个图像,并且可以确定3D线。 可以利用一个或多个图像验证假设3D线,并且可以更新3D地图。 假设3D线的确定和验证可以包括在3D空间中创建平面并使用共平面性或正交性假设。

    OCCLUSION HANDLING FOR COMPUTER VISION
    8.
    发明申请
    OCCLUSION HANDLING FOR COMPUTER VISION 有权
    对计算机视觉的处理

    公开(公告)号:US20160224856A1

    公开(公告)日:2016-08-04

    申请号:US14609371

    申请日:2015-01-29

    Abstract: Disclosed are a system, apparatus, and method for performing occlusion handling for simultaneous localization and mapping. Occluded map points may be detected according to a depth-mask created according to an image keyframe. Dividing a scene into sections may optimize the depth-mask. Size of depth-mask points may be adjusted according to intensity. Visibility may be verified with an optimized subset of possible map points. Visibility may be propagated to nearby points in response to determining an initial visibility of a first point's surrounding image patch. Visibility may also be organized and optimized according to a grid.

    Abstract translation: 公开了一种用于执行同时定位和映射的遮挡处理的系统,装置和方法。 可以根据根据图像关键帧创建的深度掩模来检测闭合的地图点。 将场景划分为多个部分可以优化深度掩码。 深度屏蔽点的大小可以根据强度进行调整。 可以通过可能的地图点的优化子集验证可见性。 响应于确定第一点的周围图像块的初始可视性,可见性可以传播到附近点。 还可以根据网格组织和优化可见性。

    METHOD AND APPARATUS FOR IMAGE PROCESSING IN AUGMENTED REALITY SYSTEMS
    9.
    发明申请
    METHOD AND APPARATUS FOR IMAGE PROCESSING IN AUGMENTED REALITY SYSTEMS 有权
    在现实系统中进行图像处理的方法和装置

    公开(公告)号:US20160171768A1

    公开(公告)日:2016-06-16

    申请号:US14569549

    申请日:2014-12-12

    Abstract: Disclosed are a system, apparatus, and method for depth and color camera image synchronization. Depth and color camera input images are received or otherwise obtained unsynchronized and without associated creation timestamps. An image of one type is compared with an image of a different type to determine a match for synchronization. Matches may be determined according to edge detection or depth coordinate detection. When a match is determined a synchronized pair is formed for processing within an augmented reality output. Optionally the synchronized pair may be transformed to improve the match between the image pair.

    Abstract translation: 公开了用于深度和彩色相机图像同步的系统,装置和方法。 深度和彩色相机输入图像被接收或以其他方式获得不同步并且没有关联的创建时间戳。 将一种类型的图像与不同类型的图像进行比较以确定用于同步的匹配。 可以根据边缘检测或深度坐标检测来确定匹配。 当确定匹配时,形成用于在增强现实输出中进行处理的同步对。 可选地,可以变换同步对以改善图像对之间的匹配。

    MOTION BLUR AWARE VISUAL POSE TRACKING

    公开(公告)号:US20140270348A1

    公开(公告)日:2014-09-18

    申请号:US13801601

    申请日:2013-03-13

    Abstract: Various methods, apparatuses and/or articles of manufacture are provided which may be implemented for use by an electronic device to track objects across two or more digital images. For example, an electronic device may generate a plurality of warped patches corresponding to a reference patch of a reference image, and combine two or more warped patches to form a blurred warped patch corresponding to the reference patch with a motion blur effect applied to a digital representation corresponding to a keypoint of an object to be tracked.

    Abstract translation: 提供了各种方法,装置和/或制造品,其可以被实现为由电子设备用于跟踪跨越两个或更多个数字图像的物体。 例如,电子设备可以生成与参考图像的参考图像相对应的多个翘曲的斑块,并且组合两个或更多个扭曲的斑块以形成与参考斑块相对应的模糊的弯曲斑块,其中运动模糊效应被应用于数字 对应于要跟踪的对象的关键点的表示。

Patent Agency Ranking