A voice processing device includes a memory; and a processor configured to execute a plurality of instructions stored in the memory, the instructions includes acquiring a transmitted voice; first detecting a first utterance segment of the transmitted voice; second detecting a response segment from the first utterance segment; determining a frequency of the response segment included in the transmitted voice; and estimating an utterance time period of a received voice on a basis of the frequency.