A method of controlling a wireless audio signal in order to avoid frequency interference between a display apparatus with a multi-view function and glasses with a function of receiving a wireless audio signal is provided.The method of controlling a wireless audio signal in a wireless audio signal transmitting device includes: pairing with a wireless audio signal receiving device using a first frequency band; detecting frequency interference by an external device other than the paired wireless audio signal receiving device; scanning a frequency when frequency interference is detected; determining whether a frequency change is needed using information related to the scanned frequency; and changing an audio signal transmitting frequency when frequency change is needed.