A method and system of stitching a plurality of image views of a scene, including grouping matched points of interest in a plurality of groups, and determining a similarity transformation with smallest rotation angle for each grouping of the matched points. The method further includes generating virtual matching points on non-overlapping area of the plurality of image views and generating virtual matching points on overlapping area for each of the plurality of image views.