A vehicular driver assistance system includes a front camera module (FCM) disposed at a vehicle. The system, responsive to processing captured image data, generates FCM lane information including information regarding a traffic lane the vehicle is currently traveling along. An e-Horizon module (EHM) generates EHM lane information including information regarding the traffic lane the vehicle is currently traveling along. The vehicular driver assistance system determines an FCM correlation using the FCM lane information and sensor data captured by at least one exterior sensor. The vehicular driver assistance system determines an EHM correlation using the EHM lane information and the sensor data captured by the at least one exterior sensor. Responsive to determining the FCM correlation and the EHM correlation, the system controls lateral movement of the vehicle based on one selected from the group consisting of (i) the FCM lane information and (ii) the EHM lane information.