The present approach employs a context-aware simulation platform to facilitate control of a robot remote from an operator. Such a platform may use the prior domain/task knowledge along with the sensory feedback from the remote robot to infer context and may use inferred context to dynamically change one or both of simulation parameters and a robot-environment-task state being simulated. In some implementations, the simulator instances make forward predictions of their state based on task and robot constraints. In accordance with this approach, an operator may therefore issue a general command or instruction to a robot and based on this generalized guidance, the actions taken by the robot may be simulated, and the corresponding results visually presented to the operator prior to evaluate prior to the action being taken.