The disclosure relates to an image processing apparatus for determining a depth of a pixel of a reference image of a plurality of images representing a visual scene relative to a plurality of locations, wherein the plurality of locations define a two-dimensional grid with rows and columns and wherein the location of the reference image is associated with a reference row and a reference column of the grid. The image processing apparatus comprises a depth determiner configured to determine a first depth estimate on the basis of the reference image and a first subset of the plurality of images for determining the depth of the pixel of the reference image, wherein the images of the first subset are associated with locations being associated with a row of the grid different than the reference row and with a column of the grid different than the reference column.