A method includes receiving sensor data from one or more sensors that corresponds to a location of a stylus device and determining that a tip of the stylus device is in contact with a physical surface based on the sensor data. While in contact, the method includes determining a new location of the tip of the stylus device based on the location data, mitigating a tracking error of the determined new location of the tip of the stylus device by translating the new location from a 3D space domain to a 2D space domain that corresponds to the physical surface and adjusting the new location based on a comparison of the new location and historical locations. The stylus device can further ascertain surface characteristics through sensor data and simulate surface characteristics via haptic feedback effects.