Disclosed are an apparatus and a method of controlling an eye-to-eye contact function, which provide a natural eye-to-eye contact by controlling an eye-to-eye contact function based on gaze information about a local participant and position information about a remote participant on a screen when providing the eye-to-eye contact function by using an image combination method and the like in a teleconference system, thereby improving absorption to a teleconference.