JOINT CAMERA AND INERTIAL MEASUREMENT UNIT CALIBRATION

    公开(公告)号:US20230377197A1

    公开(公告)日:2023-11-23

    申请号:US18028176

    申请日:2021-09-15

    CPC classification number: G06T7/80

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for calibrating an augmented reality device using camera and inertial measurement unit data. In some implementations, a bundle adjustment process jointly optimizes or estimates states of the augmented reality device. The process can use, as input, visual and inertial measurements as well as factory-calibrated sensor extrinsic parameters. The process performs bundle adjustment and uses non-linear optimization of estimated states constrained by the measurements and the factory calibrated extrinsic parameters. The process can jointly optimize inertial constraints, IMU calibration, and camera calibrations. Output of the process can include most likely estimated states, such as data for a 3D map of an environment, a trajectory of the device, and/or updated extrinsic parameters of the visual and inertial sensors (e.g., cameras and IMUs).

    CONCURRENT CAMERA CALIBRATION AND BUNDLE ADJUSTMENT

    公开(公告)号:US20240046521A1

    公开(公告)日:2024-02-08

    申请号:US18245816

    申请日:2021-08-17

    CPC classification number: G06T7/85 G06T19/00 G06T2207/30244 G06T2207/10012

    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for camera calibration during bundle adjustment. One of the methods includes maintaining a three-dimensional model of an environment and a plurality of image data clusters that each include data generated from images captured by two or more cameras included in a device. The method includes jointly determining, for a three-dimensional point represented by an image data cluster (i) the newly estimated coordinates for the three-dimensional point for an update to the three-dimensional model or a trajectory of the device, and (ii) the newly estimated calibration data that represents the spatial relationship between the two or more cameras.

Patent Agency Ranking