A gaming system for interacting with a wagering game in 3D space includes sensors positioned to define a 3D volume within which things may be introduced to make gestures that are detected in the 3D volume and associated with wagering-game functions Different 3D gestures cause different wagering-game functions to be earned out One gesture browses among selections involved in the game outcome while another gesture selects a wagering-game element 3D gestures change virtual camera angles to view hidden surfaces 3D wagering-game objects Gestures include throwing physical dice that transition to virtual dice whereupon the game software takes over to depict a randomly selected game outcome RFID-tagged chips are placed on tables to determine their value and location A fishing game detects a hook attached to a fishing rod held by the player and displays a virtual representation of the hook on four video displays