A user terminal device is provided. The user terminal device includes a plurality of different types of sensors, a storage unit configured to store object information, and a controller configured to acquire sensing results of the plurality of sensors, determine a plurality of object categories respectively corresponding to the sensing results, and compare objects belonging to the plurality of object categories to estimate an object commonly belonging to the object categories as a recognition result.