The present invention relates to an image processing device and method, a program, and a recording medium whereby the evaluation regarding the reliability of a motion vector can be performed even in the case of an average brightness level between frames changing greatly. On a frame t+1, a block B1 at the position shifted from a pixel p1 to which a pixel p0 on a frame t corresponds by the vector quantity of a correct motion vector v1, and a block B2 at the position shifted from the pixel p1 to which the pixel p0 corresponds by the vector quantity of an incorrect motion vector v2 are shown. Here, the movement of a light source or the like is performed upon the block B1 alone, and even if the brightness level of the block B1 decreases as a whole, determination is made that the evaluation value of the block B1 is high in reliability as compared with the evaluation value of the block B2 by employing the sum of squared brightness values from which the average brightness value within a computation block is subtracted for each frame as an offset. The present invention can be applied to a signal processing device for performing frame frequency conversion processing from a 24P signal to a 60P signal.