-
公开(公告)号:US11437017B2
公开(公告)日:2022-09-06
申请号:US16937342
申请日:2020-07-23
发明人: Jeffrey Owen Kephart , Hui Su , Maira Gatti de Bayser , Melina de Vasconcelos Alberio Guerra , Rahul Divekar , Matthew Peveler , Xiangyang Mou , Lisha Chen
摘要: Human speech signals that are uttered within an environment are transcribed; the environment includes one or more avatars representing one or more software agents; the human speech signals are directed to at least one of the avatars. At least one non-speech behavioral trace is obtained within the environment; the trace is representative of non-speech behavior directed to the at least one of the avatars. The transcribed human speech signals and the at least one non-speech behavioral trace are forwarded to the one or more software agents. A proposed act is obtained from at least one of the agents; responsive thereto, a command is issued to cause the avatar corresponding to the software agent from which the proposed act is obtained to emit synthesized speech and to act visually in accordance with the proposed act.
-
公开(公告)号:US11442991B2
公开(公告)日:2022-09-13
申请号:US16520929
申请日:2019-07-24
发明人: Jeffrey Owen Kephart , Hui Su , Matthew Peveler
IPC分类号: G06F16/9032 , G06F16/9532 , G06F16/954 , G06F3/16 , G06F40/30
摘要: A computer-implemented method for multi-modal interaction with structured web page data includes automatically injecting event monitoring code into a web page. One or more event streams generated by the injected event monitoring code are received. A request to perform an operation on data displayed on the web page is received from a user. A command is generated that has one or more parameters based at least in part on one or more mappings between the received request and the received one or more event streams. The command to fulfil the received request is executed by interacting with the web page.
-
公开(公告)号:US20220028366A1
公开(公告)日:2022-01-27
申请号:US16937342
申请日:2020-07-23
发明人: Jeffrey Owen Kephart , Hui Su , Maira Gatti de Bayser , Melina de Vasconcelos Alberio Guerra , Rahul Divekar , Matthew Peveler , Xiangyang Mou , Lisha Chen
摘要: Human speech signals that are uttered within an environment are transcribed; the environment includes one or more avatars representing one or more software agents; the human speech signals are directed to at least one of the avatars. At least one non-speech behavioral trace is obtained within the environment; the trace is representative of non-speech behavior directed to the at least one of the avatars. The transcribed human speech signals and the at least one non-speech behavioral trace are forwarded to the one or more software agents. A proposed act is obtained from at least one of the agents; responsive thereto, a command is issued to cause the avatar corresponding to the software agent from which the proposed act is obtained to emit synthesized speech and to act visually in accordance with the proposed act.
-
-