A conversation support device includes: a speaker; a microphone; a noise source acquisition unit that acquires a noise signal indicating noise; a first calculator that calculates a transfer characteristic of a secondary path between the speaker and the microphone; an echo cancellation unit that cancels an echo by using the transfer characteristic of the secondary path; a second calculator that calculates a coefficient of an adaptive filter, based on the transfer characteristic of the secondary path and the noise signal; and an active noise cancellation controller that generates a noise cancelling signal by using the coefficient of the adaptive filter and the noise signal. The noise cancelling signal is for controlling cancellation of the noise.