公开(公告)号：US20220404956A1

公开(公告)日：2022-12-22

申请号：US17875083

申请日：2022-07-27

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Inkwon CHOI ,  Jungmin KWON ,  Chiyoun PARK ,  Youngchul SOHN ,  Byeongcheol KANG ,  Ilgu KANG ,  Jeongseop KIM ,  Hyunseo PARK ,  Juyong SONG ,  Kangwook LEE ,  Joohyung LEE ,  Dongjae LIM ,  Donguk JU ,  Sunghyun CHOI ,  Gyujeong HWANG

IPC: G06F3/04842 ,  G06F3/16

Abstract: Provided are an electronic device for navigating an application screen, and an operating method thereof. The method may include receiving a user input; determining, based on the user input, a user intent for controlling the electronic device; determining a command for performing a control operation corresponding to the user intent as a goal; identifying elements of a user interface on the screen of the application; determining, based on the user intent and the elements of the user interface, at least one sub-goal for executing the command; and executing the command by performing at least one task corresponding to the at least one sub-goal, wherein the at least one sub-goal is changeable based on a validation of an operation of navigating the application for executing the command, and the at least one task includes units of action for navigating the application.

公开(公告)号：US20230205556A1

公开(公告)日：2023-06-29

申请号：US18146592

申请日：2022-12-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Jungmin KWON ,  Chiyoun PARK ,  Byeongcheol KANG ,  Hyunseo PARK ,  Youngchul SOHN ,  Juyong SONG

IPC: G06F9/451 ,  G06F18/231

CPC classification number: G06F9/451 ,  G06F18/231 ,  G06F2123/02

Abstract: A method of analyzing an application screen is provided. The method includes generating a plurality of links for a plurality of user interface (UI) elements included in the application screen, generating a UI map for each of at least one primitive action, which is a user input for navigating the application screen, based on the plurality of links, and identifying a position of a focus indicating a UI element with which a user is to interact among the plurality of UI elements. The UI map includes a route via which the position of the focus moves between the plurality of UI elements by the at least one primitive action.