To present relevant information about an object of interest to a viewer in an appropriate timing based on the display state of objects that appear in a video image. A video image processing apparatus 10 processes the additional information including content data and relevant information about the respective objects. A display feature information calculation unit 107 acquires frame data indicating the display state of an object to be displayed in each frame constituting video data and calculates display feature information about the object to be displayed in each frame. A frame evaluation unit 108 evaluates a frame using an evaluation criteria relating to the degree of attention of the object within a frame based on the calculated display feature information. A display timing determination unit 109 determines a frame at which displaying relevant information about the object is to be started in accordance with the frame evaluation result. A display data generation unit 110 generates data for displaying relevant information about an object, and a superimpose unit 104 superimposes the data with video data, and output the superimposed data to a display unit 105.