Methods and systems for automating user patterns on a user device are described. A user device receives data representing inputs to a user interface (UI) of the user device and system data associated with each of the inputs, wherein the system data comprises information describing an environment of the user device when the input to the UI was received. The user device then determines that a subset of the inputs to the UI and the system data associated with the subset of the inputs exceeds a threshold probability of matching a pattern of previously-identified UI inputs and system data associated with the previously-identified UI inputs. The user device then executes additional inputs to the UI to complete the matched pattern.