Methods, systems, and media for modifying the presentation of video content on a user device based on a consumption mode of the user device are provided. In some embodiments, a computer-implemented method comprises: receiving, from a user device, a request to present a video content item, wherein the video content item includes an audio portion; identifying a segment of the audio portion as including a particular type of audio content (e.g., silent content, music content, speech content, theatrical content, non-musical content, etc.); determining a consumption mode associated with the user device; generating a modified video content item based on the consumption mode associated with the user device by removing a portion of the video content item that corresponds to the segment of the audio portion identified as including the particular type of audio content; and causing the modified video content item to be presented on the user device.