This relates to a method for image segmentation and video object tracking. While conventional methods rely on the motion homogeneity of the objects to be tracked, the present method is based on a concept of partition projection in which both spatial and motion information are now exploited, and implemented by means of a modified double partition approach, including a re-segmentation of a first partition followed by a projection step of the obtained fine partition into the current frame. Objects presenting non-homogeneous motion, static objects, and parts of an object with homogeneous motion can thus be tracked.