Methods and apparatus for controlling any aspect of a virtual environment in a mobile or wearable device are described, where the user is performing a gait activity such as walking, jogging or running, and the controlling is performed leveraging the gait characteristics of the user. For example, the gait characteristics may include velocity and stride length, and the sensors utilized to obtain any contextual information may be accelerometers.