A system and method of providing motion estimation is disclosed. A recursive motion estimation module works in conjunction with a non-recursive motion estimation module to provide candidate motion vectors to a selection module. The selection module determines which of the candidates is more likely to yield a desirable result and selects that candidate accordingly.