Using mouseover to scan a graphical user interface to improve accuracy of graphical object recognition

    公开(公告)号:US12130996B2

    公开(公告)日:2024-10-29

    申请号:US17881300

    申请日:2022-08-04

    申请人: MICRO FOCUS LLC

    摘要: An area of a graphical user interface that potentially comprises an actionable graphical object is identified. An actional graphical object is an object that generates an event when clicked on. For example, an actional graphical object may be a button, a menu, a menu item, a check box, a text field, a text area, a tab, and/or the like. A cursor movement is generated in the area of the graphical user interface (e.g., using a grid). The cursor movement uses a scanning process to a detect a change in a cursor type (e.g., from an arrow cursor to a link cursor). In response to detecting the change in the cursor type, the actionable graphical object is identified in the area of the graphical interface. The actionable graphical object may then be integrated into a testing process to validate the graphical user interface.

    MACHINE LEARNING BASED ON FUNCTIONAL TESTING

    公开(公告)号:US20230075004A1

    公开(公告)日:2023-03-09

    申请号:US17461301

    申请日:2021-08-30

    申请人: MICRO FOCUS LLC

    IPC分类号: G06F11/36 G06N20/00 G06F9/54

    摘要: An image of a graphical user interface is captured. A process is started to record identification of a graphical object (e.g., a text field) in the image of the graphical user interface. Recording identification of the graphical object in the image of the graphical user interface is based on machine learning. An end to the process to record identification of the graphical object in the image of the graphical user interface is identified. A machine learned software object is updated. For example, the machine learned software object is updated with a location of the graphical object. The updated machine learned software object then is used to test the graphical object. For example, to automatically fill in the text field using a test script.

    Automated identification of input elements in a graphical user interface

    公开(公告)号:US12072791B2

    公开(公告)日:2024-08-27

    申请号:US17312279

    申请日:2018-12-28

    申请人: MICRO FOCUS LLC

    摘要: A computing device includes a processor and a medium storing instructions. The instructions are executable by the processor to: identify, based on a blob detection analysis, a plurality of potential input elements in a graphical user interface (GUI); determine a set of rows including potential input elements that are in a horizontal alignment and in a same size range; determine a set of columns including potential input elements that are in a vertical alignment and in a same size range; determine a set of input elements comprising multiple potential input elements that are located at intersections of the identified set of rows and the identified set of columns; and perform automated testing of the GUI using the determined set of input elements.

    Recommending programmatic descriptions for test objects

    公开(公告)号:US11698851B2

    公开(公告)日:2023-07-11

    申请号:US17046198

    申请日:2018-04-28

    申请人: MICRO FOCUS LLC

    IPC分类号: G06F11/36 G06F8/33 G06N5/02

    CPC分类号: G06F11/3684 G06F8/33 G06N5/02

    摘要: A technique includes receiving, by a computer, user input representing creation of a first programmatic description of a first test object of source code to be tested. The technique includes, in response to receiving the user input, determining, by the computer, based on other programmatic descriptions of other test objects, a recommendation of a parameter to be used in the first programmatic description to identify the first test object. The technique includes causing, by the computer, a display of the recommendation.

    Systems and methods of automatically identifying a date in a graphical user interface

    公开(公告)号:US11995291B2

    公开(公告)日:2024-05-28

    申请号:US17843576

    申请日:2022-06-17

    申请人: MICRO FOCUS LLC

    IPC分类号: G06F3/0482

    CPC分类号: G06F3/0482

    摘要: Systems and methods include determining a target date; detecting a calendar in a graphical user interface; recognizing a month name in the detected calendar; recognizing one or more date numbers in the detected calendar; identifying a week start day for the detected calendar; identifying a position in the detected calendar associated with the target date based on the identified week start day for the detected calendar and the recognized one or more date numbers in the detected calendar; and automatically selecting the position in the detected calendar associated with the target date.

    AUTOMATED APPLICATION TESTING OF MUTABLE INTERFACES

    公开(公告)号:US20220292011A1

    公开(公告)日:2022-09-15

    申请号:US17201320

    申请日:2021-03-15

    申请人: MICRO FOCUS LLC

    摘要: Applications under test (AUT) may be tested by automated testing systems utilizing machine vision to recognize visual elements presented by the AUT and apply inputs to graphical elements, just as a human would. By utilizing the smallest image patch available, processing demands of the testing system are minimized. However, the image patch used to identify a portion of an AUT must be identifiable to the automated system. By selecting image patches that comprise the smallest size, but can be identified in an AUT by an automated system using machine vision, even as the AUT display is resized, reproportioned, noisy, or otherwise altered from the testing platform that was utilized for training.