Various techniques are described for controlling a wager-based game played at a gaming system. In one embodiment the gaming system may include a gesture input interface device operable to detect movements gestures associated with one or more persons, and a gesture interpretation component operable to identify selected movements or gestures detected by the gesture input interface device. In at least one embodiment, the gesture interpretation component may also be operable to generate gesture interpretation information relating to interpretation of the selected movements or gestures. In at least one embodiment, the gaming system may be operable to automatically detect a gesture by a player participating in a game session at the gaming system; interpret the gesture with respect to a set of criteria; generate gesture interpretation information relating to the interpretation of the gesture; and advance a state of the game session using at least a portion of the gesture interpretation information. In at least one embodiment, the system may include a handheld device which is operable to perform one or more of the functions relating to gesture recognition and/or interpretation.