A vehicle control device includes a sleep depth estimation unit that estimates a sleep depth of an occupant seated in a seat provided in a vehicle, and a control unit that controls the vehicle such that a magnitude of the external force to be applied to at least one of a plurality of the occupants is equal to or less than a first threshold value when the estimated sleep depth of the occupant is equal to or lower than a predetermined reference depth or when the occupant is awake, and that controls the vehicle such that the magnitude of the external force to be applied to each of all the occupants is equal to or less than a second threshold value larger than the first threshold value when the sleep depth of each of the occupants is greater than the reference depth.