An image processing apparatus and method for zooming in on a partial area in a three-dimensional (3D) image selects a zoom mode from among a two-dimensional (2D) zoom mode, a 3D zoom mode, and an intermediate dimensional zoom mode between the 2D zoom mode and the 3D zoom mode. The image processing apparatus may include a mode selecting unit to select a zoom mode to be applied to a zoom area in a color image and a depth image among the 2D zoom mode, the 3D zoom mode, and the intermediate dimensional zoom mode between the 2D zoom mode and the 3D zoom mode, and a scaling unit to scale the zoom area using a zoom factor indicating magnification or minification of the zoom area and the selected zoom mode.