According to one embodiment, a video processing apparatus includes a viewer detector that acquires position information of a viewer from video photographed by a camera, a viewer selector that selects, when a plurality of the viewers are present, a viewer considered to have the highest viewing desire out of the plural viewers taking into account the current time of day and/or information concerning a program being viewed, a viewing area information calculator that calculates, using position information of the selected viewer, a control parameter for setting a viewing area in which the selected viewer is set, a viewing area controller that controls the viewing area according to the control parameter, a display that displays plural parallax images that the viewer present in the viewing area can observe as a stereoscopic video, and an apertural area controller that outputs the plural parallax images displayed on the display in a predetermined direction.