Command determination for controlling a vehicle, such as an autonomous vehicle, is described. In an example, individual requests for controlling the vehicle relative to each of multiple objects or conditions in an environment are received (substantially simultaneously) and based on the request type and/or additional information associated with a request, command controllers can determine control commands (e.g., different accelerations, steering angles, steering rates, and the like) associated with each of the one or more requests. The command controllers may have different controller gains (which may be based on functions of distance, distance ratios, time to estimated collisions, etc.) for determining the controls and a control command may be determined based on the all such determined controls.