A sound field control apparatus includes a microphone configured to receive an utterance of a user, an output interface configured to output at least one of a sound signal and image data, and one or more processors configured to cancel a sound signal in a specific area around the microphone, obtain room impulse response information based on a user utterance position when the utterance of the user is received, and output a sound signal for providing an independent sound field to the user based on the room impulse response information.