A vibratory actuator includes a piezoelectric element, a driver element provided on the piezoelectric element and a movable body supported by the driver element. A control unit supplies a first voltage and a second voltage at the same frequency to the piezoelectric element. By supplying the first voltage and the second voltage having a difference phase from a phase of the first voltage by 90°, the piezoelectric element is lead to composite vibration of stretching and bending, thereby causing the driver to make an elliptical motion by the vibration and move the movable body. The control unit switches, during a fine mode, a phase difference between the first voltage and the second voltage between 90° and 0°.