Techniques related to temporal noise reduction in captured video are discussed. Such techniques include performing motion estimation on a portion of a downsampled current frame performed during the downsampling of the current frame, replacing one or more of the resultant motion vectors based on confidence scores of the resultant motion vector, and blending the current frame and a temporally previous frame to generate a temporally filtered current frame. The temporally filtered current frame may be displayed to a user and/or encoded to generate a bitstream.