The invention discloses a voice signal processing method and device. The voice signal processing method includes acquiring energy distribution characteristics of a voice signal frame; judging whether the voice signal frame is a noise frame or not according to the energy distribution characteristics. By the voice signal processing method and device, the problem of poor judgment effect on unstable noise fast in changing in the prior art is solved, and judgment accuracy of the noise frame in the voice signal is improved.