A vehicular control system includes a camera having an exterior field of view at least rearward of the vehicle and operable to capture image data. A trailer is attached to the vehicle and image data captured by the camera includes image data captured when the vehicle is maneuvered with the trailer at an angle relative to the vehicle. The vehicular control system determines a path of the trailer responsive at least to a steering angle of the vehicle. The vehicular control system detects an object present exterior of the vehicle during maneuvering of the vehicle and the trailer and based at least in part on image processing of captured image data. The vehicular control system plans a driving path for the vehicle that avoids the detected object so that the vehicle and the trailer do not run over or contact the detected object.