Systems and methods are described for modifying a fast-forwarding speed based on a reaction time of a user when a frame of interest is detected. A media guidance application may receive a command from a user to fast-forward through a media asset and may execute a fast-forwarding operation through frames of the media asset. The media guidance application may detect that the fast-forwarding operation is approaching a frame of interest to the viewer. The media guidance application may reduce the fast-forwarding speed to a second speed slower than the first speed, where the second speed is determined based on an estimated reaction time of the user. The media guidance application may receive a command to resume playback from the user while the fast-forwarding operation is occurring at the second speed and may play back the media asset at a default playback speed from a point corresponding to a moment when the command was received.