A view extrapolation apparatus and a view extrapolation method to generate images at a plurality of virtual points using a relatively small number of input images are disclosed. The view extrapolation apparatus and the view extrapolation method output a view at a reference point, the view at the reference point being formed of frames according to time, generating the frames of the view at the reference point to generate a resized frame, and generating an extrapolated view at a virtual point using the resized frame.