Abstract:
An augmented reality-based hand interaction apparatus and method using image information. The augmented reality-based hand interaction apparatus using image information includes an object recognition module configured to extract feature points from an input color image, recognize an object which is a target of interest based on the extracted feature points, and estimate a three-dimensional (3D) posture of the recognized object, and an interaction module configured to extract 3D mesh information from an input depth image, match 3D coordinates of the extracted 3D mesh information with 3D coordinates of the object recognized by the object recognition module to extract 3D position information of the recognized object in 3D space, and detect whether or not an augmented 3D object and the recognized object collide with each other based on relative positional relationship information between the recognized object and the augmented 3D object.
Abstract:
An augmented reality-based hand interaction apparatus and method using image information. The augmented reality-based hand interaction apparatus using image information includes an object recognition module configured to extract feature points from an input color image, recognize an object which is a target of interest based on the extracted feature points, and estimate a three-dimensional (3D) posture of the recognized object, and an interaction module configured to extract 3D mesh information from an input depth image, match 3D coordinates of the extracted 3D mesh information with 3D coordinates of the object recognized by the object recognition module to extract 3D position information of the recognized object in 3D space, and detect whether or not an augmented 3D object and the recognized object collide with each other based on relative positional relationship information between the recognized object and the augmented 3D object.
Abstract:
An augmented reality device based on recognition of a spatial structure includes: a point cloud normal vector extracting unit extracting a normal vector for a point cloud from image data input from a camera; a plane object segmenting unit segmenting a plane in the image data by using the extracted normal vector; a representative plane selecting unit selecting a representative plane among the segmented planes; a spatial structure extracting unit recognizing a spatial structure by using the representative plane; and a virtual object matching unit matching a virtual object in the recognized spatial structure.