SYNCHRONIZING VISUAL AND SPEECH EVENTS IN A MULTIMODAL APPLICATION
    1.
    发明申请
    SYNCHRONIZING VISUAL AND SPEECH EVENTS IN A MULTIMODAL APPLICATION 有权
    在多模式应用程序中同步视觉和语音活动

    公开(公告)号:US20120022875A1

    公开(公告)日:2012-01-26

    申请号:US13249717

    申请日:2011-09-30

    IPC分类号: G10L21/00

    CPC分类号: G10L15/1815 G10L2021/105

    摘要: Exemplary methods, systems, and products are disclosed for synchronizing visual and speech events in a multimodal application, including receiving from a user speech; determining a semantic interpretation of the speech; calling a global application update handler; identifying, by the global application update handler, an additional processing function in dependence upon the semantic interpretation; and executing the additional function. Typical embodiments may include updating a visual element after executing the additional function. Typical embodiments may include updating a voice form after executing the additional function. Typical embodiments also may include updating a state table after updating the voice form. Typical embodiments also may include restarting the voice form after executing the additional function.

    摘要翻译: 公开了用于在多模式应用中同步视觉和语音事件的示例性方法,系统和产品,包括从用户语音接收; 确定语音的语义解释; 调用全局应用程序更新处理程序; 由全局应用程序更新处理程序识别依赖于语义解释的附加处理功能; 并执行附加功能。 典型实施例可以包括在执行附加功能之后更新视觉元素。 典型实施例可以包括在执行附加功能之后更新语音表单。 典型实施例还可以包括在更新语音形式之后更新状态表。 典型实施例还可以包括在执行附加功能之后重新启动语音形式。

    Dynamically creating multimodal markup documents
    3.
    发明授权
    Dynamically creating multimodal markup documents 有权
    动态创建多模式标记文档

    公开(公告)号:US08032825B2

    公开(公告)日:2011-10-04

    申请号:US11154896

    申请日:2005-06-16

    IPC分类号: G06N3/00

    CPC分类号: G06F9/451

    摘要: Methods, systems, and products for dynamically creating a multimodal markup document are provided that include selecting a multimodal markup template, identifying in dependence upon the multimodal markup template a dynamic content module, instantiating the dynamic content module, executing a dynamic content creation function in the instantiated dynamic content module, receiving dynamic content from the dynamic content creation function, and including the dynamic content in the multimodal markup template. Selecting a multimodal markup template may be carried out by identifying a multimodal markup template from URI encoded data embedded in a request for a multimodal markup document from a multimodal browser. The multimodal markup template may include static content and the dynamic content may include XHTML+Voice content.

    摘要翻译: 提供了用于动态创建多模式标记文档的方法,系统和产品,其包括选择多模式标记模板,根据多模式标记模板识别动态内容模块,实例化动态内容模块,在动态内容模块中执行动态内容创建功能 实例化的动态内容模块,从动态内容创建功能接收动态内容,并将动态内容包括在多模式标记模板中。 可以通过从嵌入在多模式浏览器中的多模式标记文档的请求中的URI编码数据中识别多模式标记模板来选择多模式标记模板。 多模式标记模板可以包括静态内容,并且动态内容可以包括XHTML +语音内容。

    Synchronizing visual and speech events in a multimodal application
    4.
    发明授权
    Synchronizing visual and speech events in a multimodal application 有权
    在多模式应用程序中同步视觉和语音事件

    公开(公告)号:US08571872B2

    公开(公告)日:2013-10-29

    申请号:US13249717

    申请日:2011-09-30

    IPC分类号: G10L21/00

    CPC分类号: G10L15/1815 G10L2021/105

    摘要: Exemplary methods, systems, and products are disclosed for synchronizing visual and speech events in a multimodal application, including receiving from a user speech; determining a semantic interpretation of the speech; calling a global application update handler; identifying, by the global application update handler, an additional processing function in dependence upon the semantic interpretation; and executing the additional function. Typical embodiments may include updating a visual element after executing the additional function. Typical embodiments may include updating a voice form after executing the additional function. Typical embodiments also may include updating a state table after updating the voice form. Typical embodiments also may include restarting the voice form after executing the additional function.

    摘要翻译: 公开了用于在多模式应用中同步视觉和语音事件的示例性方法,系统和产品,包括从用户语音接收; 确定语音的语义解释; 调用全局应用程序更新处理程序; 由全局应用程序更新处理程序识别依赖于语义解释的附加处理功能; 并执行附加功能。 典型实施例可以包括在执行附加功能之后更新视觉元素。 典型实施例可以包括在执行附加功能之后更新语音表单。 典型实施例还可以包括在更新语音形式之后更新状态表。 典型实施例还可以包括在执行附加功能之后重新启动语音形式。

    Synchronizing visual and speech events in a multimodal application
    5.
    发明授权
    Synchronizing visual and speech events in a multimodal application 有权
    在多模式应用程序中同步视觉和语音事件

    公开(公告)号:US07917365B2

    公开(公告)日:2011-03-29

    申请号:US11154898

    申请日:2005-06-16

    IPC分类号: G10L15/04

    CPC分类号: G10L15/1815 G10L2021/105

    摘要: Exemplary methods, systems, and products are disclosed for synchronizing visual and speech events in a multimodal application, including receiving from a user speech; determining a semantic interpretation of the speech; calling a global application update handler; identifying, by the global application update handler, an additional processing function in dependence upon the semantic interpretation; and executing the additional function. Typical embodiments may include updating a visual element after executing the additional function. Typical embodiments may include updating a voice form after executing the additional function. Typical embodiments also may include updating a state table after updating the voice form. Typical embodiments also may include restarting the voice form after executing the additional function.

    摘要翻译: 公开了用于在多模式应用中同步视觉和语音事件的示例性方法,系统和产品,包括从用户语音接收; 确定语音的语义解释; 调用全局应用程序更新处理程序; 由全局应用程序更新处理程序识别依赖于语义解释的附加处理功能; 并执行附加功能。 典型实施例可以包括在执行附加功能之后更新视觉元素。 典型实施例可以包括在执行附加功能之后更新语音表单。 典型实施例还可以包括在更新语音形式之后更新状态表。 典型实施例还可以包括在执行附加功能之后重新启动语音形式。

    Synchronizing Visual And Speech Events In A Multimodal Application
    8.
    发明申请
    Synchronizing Visual And Speech Events In A Multimodal Application 有权
    在多模式应用程序中同步视觉和语音事件

    公开(公告)号:US20080177530A1

    公开(公告)日:2008-07-24

    申请号:US12061750

    申请日:2008-04-03

    IPC分类号: G06F17/28

    CPC分类号: G10L15/1815 G10L2021/105

    摘要: Exemplary methods, systems, and products are disclosed for synchronizing visual and speech events in a multimodal application, including receiving from a user speech; determining a semantic interpretation of the speech; calling a global application update handler; identifying, by the global application update handler, an additional processing function in dependence upon the semantic interpretation; and executing the additional function. Typical embodiments may include updating a visual element after executing the additional function. Typical embodiments may include updating a voice form after executing the additional function. Typical embodiments also may include updating a state table after updating the voice form. Typical embodiments also may include restarting the voice form after executing the additional function.

    摘要翻译: 公开了用于在多模式应用中同步视觉和语音事件的示例性方法,系统和产品,包括从用户语音接收; 确定语音的语义解释; 调用全局应用程序更新处理程序; 由全局应用程序更新处理程序识别依赖于语义解释的附加处理功能; 并执行附加功能。 典型实施例可以包括在执行附加功能之后更新视觉元素。 典型实施例可以包括在执行附加功能之后更新语音表单。 典型实施例还可以包括在更新语音形式之后更新状态表。 典型实施例还可以包括在执行附加功能之后重新启动语音形式。