An earbud set includes a first earbud and second earbud that each include a speaker and a wireless radio wirelessly coupled to a companion information handling system. At least one of the first or second earbud includes a processor, a memory device, and a magnetometer. The earbud set may include a relative mapping system to determine an earbud fixed compass orientation a front-facing assigned alignment direction for the first earbud and the second earbud and determine an angular alignment difference between the earbud fixed compass orientation and a magnetic earth field compass direction of the companion information handling system. The relative mapping system to use wireless or ultrasonic signals to determine distance from the first and second earbud to the companion information handling system. The processor uses distance measurements and a difference between the distances to determine a distance and a direction to the companion information handling system.