A video data processing apparatus includes a reading unit reading video data from a video data file recorded on a randomly accessible storage medium in response to a first control signal, and reading position data indicating a frame position of the video data in the video data file from the video data file recorded on the storage medium in response to a second control signal, a memory storing the position data read by the reading unit, and a controller controlling the reading unit by outputting the second control signal before the outputting of the first control signal, and controlling the reading unit by outputting the first control signal with a designation of particular video data to be read indicated by the position data stored in the memory, in response to a request to execute a process to the video data file.