Disclosed is a depth image processing apparatus based on a camera pose conversion, which includes: a depth image obtaining unit for obtaining depth images; a camera pose converting unit for converting camera poses of the depth images into a camera pose of a reference depth image; and a depth image filtering unit for filtering the reference depth image based on the depth images with converted camera poses.