A method performing automatic gain control (AGC) using an accelerometer in a headset starts with an accelerometer-based voice activity detector (VADa) generating a VADa output based on (i) acoustic signals received from at least one microphone included in a pair of earbuds and (ii) data output by at least one accelerometer that is included in the pair of earbuds. The at least one accelerometer detects vibration of the user's vocal chords. The headset includes the pair of earbuds. An AGC controller then performs automatic gain control (AGC) on the acoustic signals from the at least one microphone based on the VADa output. Other embodiments are also described.