公开(公告)号：US12046019B2

公开(公告)日：2024-07-23

申请号：US17157392

申请日：2021-01-25

Applicant: SAP SE

Inventor： Mithilesh Kumar Singh ,  Anubhav Sadana ,  Deepak Pandian ,  Raghavendra D ,  Satyadeep Dey ,  Philippe Long

IPC: G06V30/40 ,  G06F9/451 ,  G06F18/22 ,  G06V10/75 ,  G06V20/62 ,  G06V30/10

CPC classification number: G06V10/751 ,  G06F9/451 ,  G06F18/22 ,  G06V20/62 ,  G06V30/10

Abstract: Disclosed herein are system, method, and computer program product embodiments for surface automation in black box environments. An embodiment operates by determining scenarios of an application for automation; detecting the scenario during an execution of an application; capturing and storing one or more user interface screenshots of the scenario; identifying and storing user interface information from the user interface screenshot; implementing a sequential set of instructions comprising at least one textual element detection technique and at least one non-textual element detection technique; and executing the sequential set of instructions.

公开(公告)号：US20220237404A1

公开(公告)日：2022-07-28

申请号：US17157392

申请日：2021-01-25

Applicant: SAP SE

Inventor： Mithilesh Kumar Singh ,  Anubhav Sadana ,  Deepak Pandian ,  Raghavendra D ,  Satyadeep Dey ,  Phillippe Long

IPC: G06K9/62 ,  G06K9/78 ,  G06K9/54 ,  G06K9/32 ,  G06F9/451

Abstract: Disclosed herein are system, method, and computer program product embodiments for surface automation in black box environments. An embodiment operates by determining scenarios of an application for automation; detecting the scenario during an execution of an application; capturing and storing one or more user interface screenshots of the scenario; identifying and storing user interface information from the user interface screenshot; implementing a sequential set of instructions comprising at least one textual element detection technique and at least one non-textual element detection technique; and executing the sequential set of instructions.