Point tracking using a trained network

    公开(公告)号:US11080884B2

    公开(公告)日:2021-08-03

    申请号:US16413102

    申请日:2019-05-15

    申请人: Matterport, Inc.

    摘要: A trained network for point tracking includes an input layer configured to receive an encoding of an image. The image is of a locale or object on which the network has been trained. The network also includes a set of internal weights which encode information associated with the locale or object, and a tracked point therein or thereon. The network also includes an output layer configured to provide an output based on the image as received at the input layer and the set of internal weights. The output layer includes a point tracking node that tracks the tracked point in the image. The point tracking node can track the point by generating coordinates for the tracked point in an input image of the locale or object. Methods of specifying and training the network using a three-dimensional model of the locale or object are also disclosed.

    ARBITRARY VISUAL FEATURES AS FIDUCIAL ELEMENTS

    公开(公告)号:US20220058414A1

    公开(公告)日:2022-02-24

    申请号:US17246422

    申请日:2021-04-30

    申请人: Matterport, Inc.

    IPC分类号: G06K9/20 G06K7/14 G06K9/62

    摘要: Systems and methods for registering arbitrary visual features for use as fiducial elements are disclosed. An example method includes aligning a geometric reference object and a visual feature and capturing an image of the reference object and feature. The method also includes identifying, in the image of the object and the visual feature, a set of at least four non-colinear feature points in the visual feature. The method also includes deriving, from the image, a coordinate system using the geometric object. The method also comprises providing a set of measures to each of the points in the set of at least four non-colinear feature points using the coordinate system. The measures can then be saved in a memory to represent the registered visual feature and serve as the basis for using the registered visual feature as a fiducial element.

    Arbitrary visual features as fiducial elements

    公开(公告)号:US10997448B2

    公开(公告)日:2021-05-04

    申请号:US16412784

    申请日:2019-05-15

    申请人: Matterport, Inc.

    摘要: Systems and methods for registering arbitrary visual features for use as fiducial elements are disclosed. An example method includes aligning a geometric reference object and a visual feature and capturing an image of the reference object and feature. The method also includes identifying, in the image of the object and the visual feature, a set of at least four non-colinear feature points in the visual feature. The method also includes deriving, from the image, a coordinate system using the geometric object. The method also comprises providing a set of measures to each of the points in the set of at least four non-colinear feature points using the coordinate system. The measures can then be saved in a memory to represent the registered visual feature and serve as the basis for using the registered visual feature as a fiducial element.