A surround signal generating device includes: a surround signal generating unit which subtracts a sound signal obtained by multiplying a first gain by an inputted sound signal of a right channel from an inputted sound signal of a left channel so as to generate a surround signal of the left channel, and which subtracts a sound signal obtained by multiplying a second gain by the inputted sound signal of the left channel from the inputted sound signal of the right channel so as to generate a surround signal of the right channel; and a gain setting unit which sets the first gain and the second gain so that a correlation between the surround signal of the left channel and the surround signal of the right channel which are generated by the surround signal generating unit realizes a correlation between surround signals of an actual content having a surround sound.