Techniques are generally described for discontinuity detection. A first and second frame of video data representing a portion of a physical environment are received. The first and second frames are divided into first and second blocks of pixels, respectively. A set of matching blocks are determined by matching each block of the first blocks with a corresponding block of the second blocks. A difference value is determined for each pair of matching blocks of the set of matching blocks. A mean difference value for the set of matching blocks. The mean difference value is convolved with a convolution kernel. A determination is made that a result of the convolving the mean difference value with the convolution kernel exceeds a mean threshold value. A determination is made that a discontinuity between the first frame and the second frame is not due to motion in the physical environment.