The present invention provides a lens shifter in which a rack transmission member is used as a power transfer mechanism for transmitting a moving force in a horizontal direction or a vertical direction, and a projection type image display device with the lens shifter, which improves strength of the rack transmission member and restrains increase of sliding resistance. The lens shifter of the invention comprises the following components: a fixed base component which is fixed to a body frame; a movable base component which is provided with a projection lens and is configured to move in a vertical direction, a left-and-right direction or both directions relatively to the fixed base component; and a driving mechanism part which causes the movement of the movable base component relatively to the fixed base component. The driving mechanism part comprises the following components: a driving part which is used for performing driving operation to the driving mechanism part; a gear mechanism part which transfers a force applied by the driving part; and a rack transmission member (60) which receives the force from the gear mechanism part. In the rack transmission member (60), a contact surface (62) which transfers power is only formed on a part in a tooth direction of the tooth surfaces (61a,61b).