公开(公告)号：US11055568B2

公开(公告)日：2021-07-06

申请号：US16522710

申请日：2019-07-26

Applicant: VMWARE, INC.

Inventor： Lan Vu ,  Uday Kurkure ,  Hari Sivaraman ,  Aravind Kumar Rao Bappanadu ,  Mohit Mangal

IPC: G06K9/62 ,  G06F11/34 ,  G06F11/30 ,  G06N3/08

Abstract: The current document is directed to methods and systems that employ image-recognition and machine learning to directly measure application-program response time from changes in a user interface displayed by the application program in much the same way that application-program users perceive response times when manually issuing commands through the user interface. The currently disclosed methods and systems involve building recognition models, training the recognition models to recognize application-program states from changes in the user interface displayed by the application program, and using the recognition models to monitor the user interface displayed by an application program to detect and assign timestamps to application-program state changes, from which the elapsed time for various different operations is computed. This approach mirrors the methods by which users perceive application-program response time when users initiate operations through the application-program-provided user interface and visually monitor progress of the operations as reflected in changes to the displayed application-program user interface.