An echo canceller, in which an adder adds a pseudo echo generated by an adaptive filter to an echo, so that the echo and the pseudo echo are canceled to each other, includes: a subband filter (8, 14) and a sampling converter (9, 15) for downsampling an audio signal; a selector switch (10, 16) which appropriately switches between a side performing the downsampling and another side performing fullband echo cancellation; and a tap arrangement controller (19) which optimizes a tap arrangement by using coefficients which are updated using a downsampled signal by the adaptive filter (11), the tap arrangement controller outputting the optimized tap arrangement to the adaptive filter (11) at time of the fullband echo cancellation.