公开(公告)号：US20230185867A1

公开(公告)日：2023-06-15

申请号：US17550228

申请日：2021-12-14

Applicant: SAP SE

Inventor： Satyadeep Dey ,  Vinay Kumar ,  Sharmika Parmar ,  Sudha Karanam Narasimha Murthy ,  Chandrakanth S. ,  Mithilesh Kumar Singh ,  Suvajit Dutta

IPC: G06F16/958 ,  G06F9/54 ,  G06F3/0482

CPC classification number: G06F16/958 ,  G06F9/542 ,  G06F9/547 ,  G06F3/0482

Abstract: Provided are systems and methods for converting user interface events that occur in a software application developed via a WebGUI framework into activity descriptions and into a bot software program. In one example, a method may include recording events transmitted between a user interface of a web application open within a web browser on a client device and a back-end of the web application on a server, identifying codes associated with user interface elements which are assigned to the recorded events, converting the identified codes assigned to the recorded events into a human-readable descriptions of the recorded events based on a predefined mapping between the codes and the human-readable descriptions stored in the predefined mapping, and displaying the human-readable descriptions of the recorded events based on the identified order among the recorded events.

公开(公告)号：US20230185586A1

公开(公告)日：2023-06-15

申请号：US17550156

申请日：2021-12-14

Applicant: SAP SE

Inventor： Satyadeep Dey ,  Vinay Kumar ,  Sharmika Parmar ,  Sudha Karanam Narasimha Murthy ,  Gagan K. ,  Chandrakanth S. ,  Mithilesh Kumar Singh ,  Suvajit Dutta

IPC: G06F9/445 ,  G06F11/36

CPC classification number: G06F9/44589 ,  G06F11/3612

Abstract: Provided are systems and methods for batching instructions of a bot during execution/runtime of the bot. The bot may be a software program that is designed to perform user interface interactions (e.g., button clicks, opening/closing pages, text entry, etc.) in place of a human. In one example, a method may include receiving a request to execute a bot program configured to perform a sequence of actions on a user interface of a software application, identifying a plurality of actions of the bot program that can be batched, assembling a plurality of instructions for performing the plurality of actions of the bot program into a batched payload, and transmitting an automation request with the batched payload to a back-end of the application on a server.

公开(公告)号：US11809512B2

公开(公告)日：2023-11-07

申请号：US17550228

申请日：2021-12-14

Applicant: SAP SE

Inventor： Satyadeep Dey ,  Vinay Kumar ,  Sharmika Parmar ,  Sudha Karanam Narasimha Murthy ,  Chandrakanth S ,  Mithilesh Kumar Singh ,  Suvajit Dutta

IPC: G06F16/958 ,  G06F3/0482 ,  G06F9/54

CPC classification number: G06F16/958 ,  G06F3/0482 ,  G06F9/542 ,  G06F9/547

Abstract: Provided are systems and methods for converting user interface events that occur in a software application developed via a WebGUI framework into activity descriptions and into a bot software program. In one example, a method may include recording events transmitted between a user interface of a web application open within a web browser on a client device and a back-end of the web application on a server, identifying codes associated with user interface elements which are assigned to the recorded events, converting the identified codes assigned to the recorded events into a human-readable descriptions of the recorded events based on a predefined mapping between the codes and the human-readable descriptions stored in the predefined mapping, and displaying the human-readable descriptions of the recorded events based on the identified order among the recorded events.

公开(公告)号：US12046019B2

公开(公告)日：2024-07-23

申请号：US17157392

申请日：2021-01-25

Applicant: SAP SE

Inventor： Mithilesh Kumar Singh ,  Anubhav Sadana ,  Deepak Pandian ,  Raghavendra D ,  Satyadeep Dey ,  Philippe Long

IPC: G06V30/40 ,  G06F9/451 ,  G06F18/22 ,  G06V10/75 ,  G06V20/62 ,  G06V30/10

CPC classification number: G06V10/751 ,  G06F9/451 ,  G06F18/22 ,  G06V20/62 ,  G06V30/10

Abstract: Disclosed herein are system, method, and computer program product embodiments for surface automation in black box environments. An embodiment operates by determining scenarios of an application for automation; detecting the scenario during an execution of an application; capturing and storing one or more user interface screenshots of the scenario; identifying and storing user interface information from the user interface screenshot; implementing a sequential set of instructions comprising at least one textual element detection technique and at least one non-textual element detection technique; and executing the sequential set of instructions.

公开(公告)号：US20230188591A1

公开(公告)日：2023-06-15

申请号：US17550263

申请日：2021-12-14

Applicant: SAP SE

Inventor： Satyadeep Dey ,  Vinay Kumar ,  Sharmika Parmar ,  Sudha Karanam Narasimha Murthy ,  Chandrakanth S ,  Mithilesh Kumar Singh ,  Suvajit Dutta ,  Arno Esser

IPC: H04L67/01 ,  H04L67/141 ,  H04L67/143 ,  H04L67/02 ,  H04L41/22

CPC classification number: H04L67/42 ,  H04L67/141 ,  H04L67/143 ,  H04L67/02 ,  H04L41/22

Abstract: Provided are systems and methods for recording user interface events that occur in a software application developed via a WebGUI framework. In one example, a method may include establishing a session between a front-end of a web application open within a web browser on a client device and a back-end of the web application hosted on a server, activating a recorder via a web extension of the web browser of the client device based on attributes of the established session, capturing user interface events transmitted between the front-end of the application within the web browser on the client device and the back-end of the application hosted on the server via the activated recorder, and recording the captured user interface events in a file.

公开(公告)号：US20220237404A1

公开(公告)日：2022-07-28

申请号：US17157392

申请日：2021-01-25

Applicant: SAP SE

Inventor： Mithilesh Kumar Singh ,  Anubhav Sadana ,  Deepak Pandian ,  Raghavendra D ,  Satyadeep Dey ,  Phillippe Long

IPC: G06K9/62 ,  G06K9/78 ,  G06K9/54 ,  G06K9/32 ,  G06F9/451

Abstract: Disclosed herein are system, method, and computer program product embodiments for surface automation in black box environments. An embodiment operates by determining scenarios of an application for automation; detecting the scenario during an execution of an application; capturing and storing one or more user interface screenshots of the scenario; identifying and storing user interface information from the user interface screenshot; implementing a sequential set of instructions comprising at least one textual element detection technique and at least one non-textual element detection technique; and executing the sequential set of instructions.