An apparatus and a method for acquiring depth information are disclosed. To acquire depth information, illumination light of which an amount of light has been modulated by a modulation signal is emitted towards a subject, and an image is captured using an image sensor. An image signal is sequentially acquired from a plurality of rows while shifting a phase of the illumination light at a start exposure time of a row belonging to an intermediate region of a pixel array region of the image sensor. Depth information is calculated from image signals acquired during a plurality of frames while shifting a phase of the modulation signal.