Provided is a method of providing an augmented reality interaction service, the method including: generating reference coordinates based on a 3-dimensional (3D) image including depth information obtained through a camera; segmenting a region corresponding to a pre-set object from the 3D image including the depth information obtained through the camera, based on depth information of the pre-set object and color space conversion; segmenting a sub-object having a motion component from the pre-set object in the segmented region, and detecting a feature point by modeling the sub-object and a palm region linked to the sub-object based on a pre-set algorithm; and controlling a 3D object for use of an augmented reality service by estimating a posture of the sub-object based on joint information of the pre-set object provided through a certain user interface (UI).