A user viewpoint related image processing apparatus includes: a sensor unit configured to sense a viewpoint change of a user and generate motion data, a communication interface unit configured to receive an image package including image data from a media server, a scene constructing unit configured to, using the image package, place a virtual camera in a virtual space and construct a scene for the image data, and a virtual camera pose changing unit configured to, using the motion data, change a pose of the placed virtual camera to respond to the viewpoint change of the user.