A speech recognition server and method are provided. The speech recognition server includes: a network connector configured to connect to terminals through a communication network, and a processor configured to calculate times of arrival of a speech sound at each of the terminals using the speech signals received from each of the terminals, calculate distances between a user and the terminals based on the times of arrival of the speech sound to each of the terminals, and recognize a command to control a target by integrating speech recognition results obtained from the speech signals using a weighted value determined based on the distances.