A system and method for unifying hotspot subject to non-linear transformation and interpolation in heterogeneous media representations includes a content creator for creating Rich Media, e.g. stills, animation, panorama and a delivery system including an action handler for responding to a hotspot in the Rich Media when selected by a user interacting with a projected image display. The hotspot is expressed in the media as an area defined in terms of a Euclidean, rectangular coordinate system for transformation and mapping of the media image hotspot coordinates into corresponding coordinates of a hotspot location in the projected image display. Unfortunately, the image coordinates in the media do not necessarily map directly into corresponding coordinates in the projected image. Flat media images can be linearly transformed to projected image coordinates. However, panorama media require non-linear transformation of media coordinated to projected image coordinates. The coordinates for the media hotspot are stored in a centralized action handler independent of the non-linearities in the media. As a result of a user selecting or picking a hotspot in the projected image, the pick may fall outside of the corresponding hotspot in the case of non-linear media. The hotspot in the media and the projected image may be unified by increasing the number of points in the area geometry which makes more reliable that a pick in the projected image hotspot will fall within the hotspot area in the media. When the projected image hotspot is picked by a mouse or other input device, a signal is transmitted to the media indicating the coordinates of the input device with respect to the media. The media transforms the input coordinates and queries the action handler for a stored hotspot at the location of the input device. The action handler returns the hotspot, if any at the queried location The media displays the hotspot, if any at the location and the input device location on the media. When the pick falls within the media hotspot area and is actuated, the action handler initiates events associated with the picked hotspot in the projected image.