LEARNED COMPUTER CONTROL USING POINTING DEVICE AND KEYBOARD ACTIONS

    公开(公告)号:US20250093970A1

    公开(公告)日:2025-03-20

    申请号:US18967935

    申请日:2024-12-04

    Abstract: A computer-implemented method for controlling a particular computer to execute a task is described. The method includes receiving a control input comprising a visual input, the visual input including one or more screen frames of a computer display that represent at least a current state of the particular computer; processing the control input using a neural network to generate one or more control outputs that are used to control the particular computer to execute the task, in which the one or more control outputs include an action type output that specifies at least one of a pointing device action or a keyboard action to be performed to control the particular computer; determining one or more actions from the one or more control outputs; and executing the one or more actions to control the particular computer.

    Learned computer control using pointing device and keyboard actions

    公开(公告)号:US12189870B2

    公开(公告)日:2025-01-07

    申请号:US18103309

    申请日:2023-01-30

    Abstract: A computer-implemented method for controlling a particular computer to execute a task is described. The method includes receiving a control input comprising a visual input, the visual input including one or more screen frames of a computer display that represent at least a current state of the particular computer; processing the control input using a neural network to generate one or more control outputs that are used to control the particular computer to execute the task, in which the one or more control outputs include an action type output that specifies at least one of a pointing device action or a keyboard action to be performed to control the particular computer; determining one or more actions from the one or more control outputs; and executing the one or more actions to control the particular computer.

    LEARNED COMPUTER CONTROL USING POINTING DEVICE AND KEYBOARD ACTIONS

    公开(公告)号:US20230244325A1

    公开(公告)日:2023-08-03

    申请号:US18103309

    申请日:2023-01-30

    CPC classification number: G06F3/033 G06F3/023 G06F40/284

    Abstract: A computer-implemented method for controlling a particular computer to execute a task is described. The method includes receiving a control input comprising a visual input, the visual input including one or more screen frames of a computer display that represent at least a current state of the particular computer; processing the control input using a neural network to generate one or more control outputs that are used to control the particular computer to execute the task, in which the one or more control outputs include an action type output that specifies at least one of a pointing device action or a keyboard action to be performed to control the particular computer; determining one or more actions from the one or more control outputs; and executing the one or more actions to control the particular computer.

Patent Agency Ranking