A confidence map for optical flow gradients is constructed calculating a set of gradients for each pixel of an image, filtering said gradients and extracting confidence values from said gradients using a plurality of decision tree classifiers. A confidence map is then generated from said confidence values.