A system for associating between a computerized model of multimodal human interaction and application functions, comprising: (a) An interface for receiving instructions from a programmer defining one or more application functions. (b) A memory storing hand gestures each defined by a dataset of discrete pose values and discrete motion values. (c) A code store storing a code. (d) One or more processors coupled to the interface, the memory and the code store for executing the stored code which comprises: (1) Code instructions to define a logical sequence of user input per instructions of the programmer. The logical sequence combines hand gestures with non-gesture user input. (2) Code instructions to associate the logical sequence with the application function(s) for initiating an execution of the application function(s) during runtime of the application in response to detection of the logical sequence by analyzing a captured data depicting a user during runtime.