Various aspects include approaches for controlling audio playback based upon a detected user sleep state. In one implementation, a computer-implemented method of controlling playback of an audio file at a wearable audio device includes: receiving a first indicator about movement or a position of an audio gateway over a period; receiving a second indicator about movement or position of the wearable audio device over the period, wherein the wearable audio device is separate from the audio gateway; and in response to the first indicator deviating from the second indicator by less than a threshold for the period, inserting a marker in the audio file that enables a user to revert back to the playback at a time of the marker.