The present invention discloses a position mapping-based augmented reality modeling experience system and method. The position mapping-based augmented reality modeling experience system comprises an HoloLens display unit used for displaying a three dimensional scene; an actual position feedback unit for feeding back the coordinates of the AR users in an HoloLens coordinate system received by a sensor built in the HoloLens display unit to a data transmission control unit; the data transmission control unit used for transmitting the positions of the AR users to an AR scene modification unit and also transmitting the scene modification data of the AR scene modification unit to the HoloLens display unit; the AR scene modification unit for providing the planar graphs and the three-dimensional views of the AR scenes for the users modifying the AR scenes, displaying the positions of the users in the scenes in the planar graphs and the three-dimensional views, and providing a visual operation interface to operate the virtual objects in the AR scenes. The system and the method of the present invention model the walls based on the position mapping, also can provide an AR experience effect of the real-time intervention, and model the walls of the virtual scenes automatically by the scene two dimensional planar graphs obtained in advance.