An exercise system including an exercise device at a user location includes a controller at the user location for controlling the exercise device. A control location remote from the user location and a communication system for transmitting information between the exercise device and the control location are provided. A sensor at the user location determines user location information and applies the user location information to the communication system for transmission to the control location. Control information is applied to the communication system by the control location in response to the user location information for transmission to the controller to control the exercise device according to the control information. Thus, the present invention is an interactive fitness system for permitting a user of a programmable exercise device to interact with a fitness server device while the user is in a location remote from the fitness server device. For example, the user can interact with the fitness server device from the home of the user. Using the system of the present invention the user can download new fitness equipment programs for controlling the exercise equipment. The user can also interact with fitness experts on-line and provide exercise information and receive control information wherein the received control information can permit interaction between the fitness server device and the user.