A signal processing apparatus includes: an audio image localization processing unit performing audio image localization processing on a sound signal of each frequency band for each channel of the sound signal based on information used to determine an audio image localization position of each frequency band; and a mixing unit mixing the sound signals of the respective channels subjected to the audio image localization processing by the audio image localization processing unit.