A method for selection of a marker in an augmented reality (AR) environment is provided. The method includes capturing a scene in the augmented reality environment; extracting a set of region of interest from the scene captured; identifying a text in the region of interest or from a document associated to the region of interest; determining a set of phrase-action pairs from the text; generating a representation of a set of region of interest and a representation of a set of phrase-action pairs; calculating inter model similarity using the set of region of interest and the set of phrase-action pairs in common embedding space; computing intra model similarity by comparing the extracted ROI with a generated ROI and the extracted phrase-action with generated phrase actions; and selecting a phrase-action-ROI tuple having the highest intra modal similarity as the marker.