A vehicular driving assist system includes a data processor module that receives and processes image data provided by a plurality of video sensors and sensor data provided by a plurality of non-video sensors. The video sensors include at least five cameras disposed at respective locations of the vehicle and having respective fields of view exterior the vehicle. The data processor module communicates with other vehicle systems via a vehicle bus of the vehicle. Received image data and received sensor data are processed at the data processor module for at least one of (i) object tracking of objects present exterior of the vehicle, (ii) object identification of objects present exterior of the vehicle and (iii) object classification of objects present exterior of the vehicle. Responsive at least in part to processing of image data and sensor data at the data processor module, a driving assistance system of the vehicle is controlled.