Example aspects of the present disclosure are directed to computing systems and methods that perform whole person association with face screening and/or face hallucination. In particular, one aspect of the present disclosure is directed to a multi-headed person and face detection model that performs both face and person detection in one model. Each of the face and person detection can find landmarks or other pose information and also a confidence score. The pose information for the face and person detections can be used to select certain face and person detections to associate together as a whole person detection, which can be referred to as an “appearance.”