One embodiment of the present invention sets forth a technique for detecting a shot change in a video. The technique includes calculating a first plurality of difference values for pixel blocks included in a first video frame and a second video frame and calculating a first cumulative distribution function (CDF) based on the first plurality of difference values. The technique further includes calculating a second plurality of difference values for pixel blocks included in a first plurality of video frames that is contiguous with the first video frame and calculating a second CDF based on the second plurality of difference values. The technique further includes comparing the first CDF to the second CDF to detect a shot change.