An object in 3D extended reality (XR), such as a virtual reality (VR) environment, is dynamically labelled based on the viewpoint of a main camera for a user. Labels may be created based on the viewing axis of the user from the camera with respect to the object, the size of the object, and the distance of the object from the camera. The dynamically labelled object can be rotated or walked around with labels of information dynamically being generated around visible points of interest that are referenced to the user in an organized and non-overlapping manner.