A system for selecting a user speech profile for a device in a vehicle includes a control module having a speech recognition system and a memory. The speech recognition system is configured to process audio signals and includes a speaker enrollment function configured to create a user speech profile for at least one user. The memory is configured to store a plurality of user speech profiles created by the speaker enrollment function. The system may include an external device configured to transmit a control signal to the vehicle including an identifier. Alternatively, the system may include a user input device configured to receive an input command from a user that includes an identifier. The control module uses the identifier to select a user speech profile from the plurality of user speech profiles and the speech recognition system uses the selected user speech profile to process audio signals from the user.