Methods, systems, and computer programs for playing browser based game with alternative controls and interfaces are presented. One method includes an operation for receiving a definition of native inputs defined for causing actions in the game. The native inputs are tied to game actions through a native device. When a gesture recognition system, lacking some capability to play the game, is detected, at least some of the actions in the game associated with the native inputs are mapped to gesture inputs detected by the gesture recognition system. This enables game play with the gesture recognition system. Further, the alternate gesture inputs are translated to corresponding actions in the game according to the mapping during game play.