An address book sharing system includes a vehicle, a short-range enabled in-vehicle telematics unit embedded in the vehicle, and a short-range enabled wireless device. The short-range enabled wireless device is configured to be paired with the short-range enabled in-vehicle telematics unit when positioned in the vehicle, and to download an address book to the short-range enabled in-vehicle telematics unit in response to an address book request trigger generated by the short-range enabled in-vehicle telematics unit. Methods for non-verbally adding address book contents using the address book sharing system are also disclosed herein.