SENSOR-BASED CAMERA MOTION DETECTION FOR UNCONSTRAINED SLAM
    1.
    发明申请
    SENSOR-BASED CAMERA MOTION DETECTION FOR UNCONSTRAINED SLAM 有权
    基于传感器的摄像机运动检测用于不受限制的SLAM

    公开(公告)号:US20150262029A1

    公开(公告)日:2015-09-17

    申请号:US14645675

    申请日:2015-03-12

    Abstract: Techniques are presented for monocular visual simultaneous localization and mapping (SLAM) based on detecting a translational motion in the movement of the camera using at least one motion sensor, while the camera is performing panoramic SLAM, and initializing a three dimensional map for tracking of finite features. Motion sensors may include one or more sensors, including inertial (gyroscope, accelerometer), magnetic (compass), vision (camera) or any other sensors built into mobile devices.

    Abstract translation: 针对单目视觉同步定位和映射(SLAM)提出了基于使用至少一个运动传感器检测相机运动中的平移运动的技术,而相机正在执行全景SLAM,以及初始化用于跟踪有限的三维图 特征。 运动传感器可以包括一个或多个传感器,包括惯性(陀螺仪,加速度计),磁(罗盘),视觉(摄像机)或内置于移动设备中的任何其他传感器。

    Scalable 3D mapping system
    2.
    发明授权

    公开(公告)号:US10185775B2

    公开(公告)日:2019-01-22

    申请号:US14862050

    申请日:2015-09-22

    Abstract: Disclosed are a system, apparatus, and method for multiple client simultaneous localization and mapping. Tracking and mapping may be performed locally and independently by each of a plurality of clients. At configurable points in time map data may be sent to a server for stitching and fusion. In response to successful stitching and fusion to one or more maps known to the server, updated position and orientation information relative to the server's maps may be sent back to the clients. Clients may update their local map data with the received server location data. Clients may receive additional map data from the server, which can be used for extending their maps. Clients may send queries to the server for 3D maps, and the queries may include metadata.

    MONOCULAR VISUAL SLAM WITH GENERAL AND PANORAMA CAMERA MOVEMENTS
    3.
    发明申请
    MONOCULAR VISUAL SLAM WITH GENERAL AND PANORAMA CAMERA MOVEMENTS 有权
    具有一般和全景相机运动的单眼视觉SLAM

    公开(公告)号:US20140320593A1

    公开(公告)日:2014-10-30

    申请号:US14151776

    申请日:2014-01-09

    CPC classification number: H04N13/289 G06T7/579 H04N5/23238

    Abstract: Disclosed are a system, apparatus, and method for monocular visual simultaneous localization and mapping that handles general 6DOF and panorama camera movements. A 3D map of an environment containing features with finite or infinite depth observed in regular or panorama keyframes is received. The camera is tracked in 6DOF from finite, infinite, or mixed feature sets. Upon detection of a panorama camera movement towards unmapped scene regions, a reference panorama keyframe with infinite features is created and inserted into the 3D map. When panoramic camera movement extends toward unmapped scene regions, the reference keyframe is extended with further dependent panorama keyframes. Panorama keyframes are robustly localized in 6DOF with respect to finite 3D map features. Localized panorama keyframes contain 2D observations of infinite map features that are matched with 2D observations in other localized keyframes. 2D-2D correspondences are triangulated, resulting in new finite 3D map features.

    Abstract translation: 公开了用于单目视觉同时定位和映射的系统,装置和方法,其处理一般的6DOF和全景照相机移动。 接收包含在常规或全景关键帧中观察到的具有有限或无限深度的特征的环境的3D地图。 相机以6DOF从有限,无限或混合特征集进行跟踪。 一旦检测到全景照相机向未映射的场景区域移动,就会创建具有无限特征的参考全景关键帧并将其插入到3D地图中。 当全景相机移动延伸到未映射的场景区域时,参考关键帧将被扩展,并具有进一步的相关全景关键帧。 相对于有限的3D地图特征,全景关键帧在6DOF中稳健地定位。 本地化全景关键帧包含与其他局部关键帧中的2D观测相匹配的无限地图特征的2D观察。 2D-2D对应被三角测量,导致新的有限3D地图特征。

    SCALABLE 3D MAPPING SYSTEM
    4.
    发明申请
    SCALABLE 3D MAPPING SYSTEM 审中-公开
    可扩展3D映射系统

    公开(公告)号:US20160179830A1

    公开(公告)日:2016-06-23

    申请号:US14862050

    申请日:2015-09-22

    Abstract: Disclosed are a system, apparatus, and method for multiple client simultaneous localization and mapping. Tracking and mapping may be performed locally and independently by each of a plurality of clients. At configurable points in time map data may be sent to a server for stitching and fusion. In response to successful stitching and fusion to one or more maps known to the server, updated position and orientation information relative to the server's maps may be sent back to the clients. Clients may update their local map data with the received server location data. Clients may receive additional map data from the server, which can be used for extending their maps. Clients may send queries to the server for 3D maps, and the queries may include metadata.

    Abstract translation: 公开了一种用于多客户端同时定位和映射的系统,装置和方法。 跟踪和映射可以由多个客户端中的每一个本地且独立地执行。 在可配置的时间点地图数据可以发送到服务器进行缝合和融合。 响应于针对服务器已知的一个或多个映射的成功的拼接和融合,相对于服务器的映射的更新的位置和取向信息可以被发送回客户端。 客户端可以使用接收到的服务器位置数据来更新其本地地图数据。 客户端可以从服务器接收附加的地图数据,可用于扩展其地图。 客户端可以向服务器发送查询用于3D地图,并且查询可以包括元数据。

    ZERO-BASELINE 3D MAP INITIALIZATION
    5.
    发明申请

    公开(公告)号:US20150371440A1

    公开(公告)日:2015-12-24

    申请号:US14743990

    申请日:2015-06-18

    Abstract: A computer-implemented method, apparatus, computer readable medium and mobile device for initializing a 3-Dimensional (3D) map may include obtaining, from a camera, a single image of an urban outdoor scene and estimating an initial pose of the camera. An untextured model of a geographic region may be obtained. Line features from the single image may be extracted and the orientation may be determined with respect to the untextured model and using the extracted line features, the orientation of the camera in 3 Degrees of Freedom (3DOF). In response to determining the orientation of the camera, a translation in 3DOF with respect to the untextured model may be determined using the extracted line features. The 3D map may be initialized based on the determined orientation and translation.

    Abstract translation: 用于初始化三维(3D)地图的计算机实现的方法,装置,计算机可读介质和移动装置可以包括从相机获取城市户外场景的单个图像并估计相机的初始姿态。 可以获得地理区域的非纹理模型。 可以提取来自单个图像的线特征,并且可以相对于未纹理模型确定取向,并且使用提取的线特征,相机在3自由度(3DOF)中的取向。 响应于确定相机的取向,可以使用提取的线特征来确定相对于未纹理模型的3DOF中的平移。 可以基于确定的取向和平移来初始化3D地图。

    Monocular visual SLAM with general and panorama camera movements

    公开(公告)号:US09674507B2

    公开(公告)日:2017-06-06

    申请号:US14151776

    申请日:2014-01-09

    CPC classification number: H04N13/289 G06T7/579 H04N5/23238

    Abstract: Disclosed are a system, apparatus, and method for monocular visual simultaneous localization and mapping that handles general 6DOF and panorama camera movements. A 3D map of an environment containing features with finite or infinite depth observed in regular or panorama keyframes is received. The camera is tracked in 6DOF from finite, infinite, or mixed feature sets. Upon detection of a panorama camera movement towards unmapped scene regions, a reference panorama keyframe with infinite features is created and inserted into the 3D map. When panoramic camera movement extends toward unmapped scene regions, the reference keyframe is extended with further dependent panorama keyframes. Panorama keyframes are robustly localized in 6DOF with respect to finite 3D map features. Localized panorama keyframes contain 2D observations of infinite map features that are matched with 2D observations in other localized keyframes. 2D-2D correspondences are triangulated, resulting in new finite 3D map features.

    Sensor-based camera motion detection for unconstrained slam
    7.
    发明授权
    Sensor-based camera motion detection for unconstrained slam 有权
    基于传感器的相机运动检测,无约束弹射

    公开(公告)号:US09390344B2

    公开(公告)日:2016-07-12

    申请号:US14645675

    申请日:2015-03-12

    Abstract: Techniques are presented for monocular visual simultaneous localization and mapping (SLAM) based on detecting a translational motion in the movement of the camera using at least one motion sensor, while the camera is performing panoramic SLAM, and initializing a three dimensional map for tracking of finite features. Motion sensors may include one or more sensors, including inertial (gyroscope, accelerometer), magnetic (compass), vision (camera) or any other sensors built into mobile devices.

    Abstract translation: 针对单目视觉同步定位和映射(SLAM)提出了基于使用至少一个运动传感器检测相机运动中的平移运动的技术,而相机正在执行全景SLAM,以及初始化用于跟踪有限的三维图 特征。 运动传感器可以包括一个或多个传感器,包括惯性(陀螺仪,加速度计),磁(罗盘),视觉(摄像机)或内置于移动设备中的任何其他传感器。

    WIDE AREA LOCALIZATION FROM SLAM MAPS
    8.
    发明申请
    WIDE AREA LOCALIZATION FROM SLAM MAPS 审中-公开
    从SLAM MAPS的广域局部化

    公开(公告)号:US20140323148A1

    公开(公告)日:2014-10-30

    申请号:US14139856

    申请日:2013-12-23

    CPC classification number: H04W4/029 G01C21/005 G01V3/38

    Abstract: Exemplary methods, apparatuses, and systems for performing wide area localization from simultaneous localization and mapping (SLAM) maps are disclosed. A mobile device can select a first keyframe based SLAM map of the local environment with one or more received images. A respective localization of the mobile device within the local environment can be determined, and the respective localization may be based on the keyframe based SLAM map. The mobile device can send the first keyframe to a server and receive a first global localization response representing a correction to a local map on the mobile device. The first global localization response can include rotation, translation, and scale information. A server can receive keyframes from a mobile device, and localize the keyframes within a server map by matching keyframe features received from the mobile device to server map features.

    Abstract translation: 公开了用于从同时定位和映射(SLAM)映射执行广域定位的示例性方法,装置和系统。 移动设备可以使用一个或多个接收到的图像来选择本地环境的基于关键帧的第一基于SLAM映射。 可以确定移动设备在本地环境中的相应定位,并且相应的定位可以基于基于关键帧的SLAM映射。 移动设备可以将第一关键帧发送到服务器并且接收表示对移动设备上的本地地图的校正的第一全局定位响应。 第一个全球本地化响应可以包括旋转,翻译和缩放信息。 服务器可以从移动设备接收关键帧,并通过将从移动设备接收到的关键帧功能与服务器映射功能进行匹配来本地化服务器映射中的关键帧。

Patent Agency Ranking