A system that analyzes an image of a gaming area, identifies an object depicted in the image and generates a virtual mask that conforms to a shape of the object. The system further maps the virtual mask to locations in a virtual scene that correspond to pixels in the image that correspond to the outer shape of the object. The system renders content in the virtual scene relative to a boundary of the mask based on the relevance of the physical object to the game state. The system instructs a projector to project the rendered image in relation to the physical object according to the content rendered relative to the mask.