公开(公告)号：US11468881B2

公开(公告)日：2022-10-11

申请号：US16370497

申请日：2019-03-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Sandeep Nama ,  Hongxia Jin

IPC: G10L15/06 ,  G06F16/901 ,  G10L15/30

Abstract: A method includes receiving, at an electronic device, a command directed to a first application operated by the electronic device. Features presented by the first application in response to interactions with the first application are captured at the electronic device. Data communicated with the first application via the interactions with the first application are captured at the electronic device. A task is learned based on the captured features and communicated data.

公开(公告)号：US20200312299A1

公开(公告)日：2020-10-01

申请号：US16370497

申请日：2019-03-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Sandeep Nama ,  Hongxia Jin

IPC: G10L15/06 ,  G10L15/30 ,  G06F16/901

Abstract: A method includes receiving, at an electronic device, a command directed to a first application operated by the electronic device. Features presented by the first application in response to interactions with the first application are captured at the electronic device. Data communicated with the first application via the interactions with the first application are captured at the electronic device. A task is learned based on the captured features and communicated data.

公开(公告)号：US20200311210A1

公开(公告)日：2020-10-01

申请号：US16370411

申请日：2019-03-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Sandeep Nama ,  Hongxia Jin

IPC: G06F17/27 ,  G10L15/18 ,  G06F3/16

Abstract: A method for learning a task includes capturing first information associated with at least one application executed by an electronic device. A sequence of user interface interactions for the at least one application is recorded. Second information are extracted from the sequence of user interface interactions. Events, action or a combination thereof are filtered from the second information using the first information. Recognition is performed on each element from the first information to generate a semantic ontology. An executable sequential event task bytecode is generated from each element of the semantic ontology and the filtered second information.

公开(公告)号：US20220147843A1

公开(公告)日：2022-05-12

申请号：US17096316

申请日：2020-11-12

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Dalkandura Arachchige Kalpa Shashika Silva Gunaratna ,  Vijay Srinivasan ,  Sandeep Nama ,  Christian Koehler ,  Hongxia Jin

IPC: G06N5/02 ,  G06T7/11 ,  G06F40/284 ,  G06F40/211 ,  G06N7/00 ,  H04N19/176

Abstract: Computer-based content understanding can include segmenting an image into a plurality of blocks, wherein each block includes textual information from the image. For each block of the plurality of blocks, encoded feature data is generated by encoding visual information of the block and visual information of one or more neighboring blocks from the plurality of blocks and encoded textual data is generated by encoding the textual information of the block and the textual information of the one or more neighboring blocks. Further, using an entity class prediction model, one or more tokens of the block are classified into one or more entity classes based on a combination of the encoded textual data and the encoded feature data. A plurality of entities can be extracted from the image based on the entity classes of the plurality of blocks.

公开(公告)号：US11093715B2

公开(公告)日：2021-08-17

申请号：US16370411

申请日：2019-03-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Sandeep Nama ,  Hongxia Jin

IPC: G06F40/30 ,  G10L15/18 ,  G06F3/16 ,  G06F40/205 ,  G06F40/289 ,  G10L15/08

Abstract: A method for learning a task includes capturing first information associated with at least one application executed by an electronic device. A sequence of user interface interactions for the at least one application is recorded. Second information are extracted from the sequence of user interface interactions. Events, action or a combination thereof are filtered from the second information using the first information. Recognition is performed on each element from the first information to generate a semantic ontology. An executable sequential event task bytecode is generated from each element of the semantic ontology and the filtered second information.