A vehicle control device includes a scene determination unit determining whether or not a current traveling scene is a traveling-restricted scene, an order setting unit setting priorities corresponding to a restriction with respect to driving behaviors previously classified for different purposes in a case where it is determined that the traveling scene is the traveling-restricted scene and setting priorities with respect to the plurality of driving behaviors in a case where it is not determined that the traveling scene is the traveling-restricted scene, a traveling plan generating unit generating traveling plans corresponding to the plurality of priority-set driving behaviors, an executability determination unit determining executability of each of the plurality of generated driving behaviors, a traveling plan selection unit selecting the traveling plan corresponding to the driving behavior with the highest priority, and a traveling control unit controlling the traveling of the host vehicle based on the traveling plan.