A vehicular trailer hitching assist system includes a camera disposed at a rear portion of a vehicle and viewing a trailer hitch disposed at the vehicle. Responsive to processing at an electronic control unit (ECU) of frames of image data captured by the camera, a feature of the trailer hitch is detected. The system, at least in part via processing at the ECU of at least one frame of image data captured by the camera, determines a ground location at the ground below the detected feature of the trailer hitch, and determines a location of the trailer hitch at the vehicle. The vehicle is maneuvered toward a trailer for hitching the trailer to the trailer hitch of the vehicle based at least in part on (i) the determined location of the trailer hitch and (ii) the height of the detected feature of the trailer hitch above the ground location.