A disparity estimation method performed by a processor includes extracting a first image patch comprising a reference pixel from a first image, extracting a second image patch comprising a target pixel corresponding to the reference pixel from a second image, and estimating a residual of an initial disparity between the reference pixel and the target pixel from the first image patch and the second image patch using a residual model, the residual being an estimated difference between the initial disparity and an actual disparity between the reference pixel and the target pixel.