A vehicle, system and method of detecting an object. The system includes an image network, a radar network and a head. The image network receives image data and proposes a boundary box from the image data and an object proposal. The radar network receives radar data and the boundary box and generates a fused set of data including the radar data and the image data. The head determines a parameter of the object from the object proposal and the fused set of data.