There is provided a video encoding method for encoding a plurality of images into one video. The method includes: a reference parallax information setting step used when encoding information to be encoded for a predetermined position in a first image, for setting reference parallax information indicating a shift of viewpoint between the first image and the second image which has been encoded; a corresponding position setting step for setting a corresponding position correlated to the predetermined position in the second image by using the reference parallax information; a code table setting step for setting a code table corresponding to the information to be encoded in the corresponding position; and a information-to-be-encoded encoding step for encoding the information to be encoded in the first image.