A method at an electronic device with one or more microphones and a speaker includes receiving a first freeform voice input; comparing the first voice input to a set of voice models associated with a plurality of users associated with the electronic device, where the voice models are trained to the electronic device; based on the comparing, determining that the first voice input corresponds to a first user of the plurality of users; and presenting a response in accordance with the determination.