System and method for accessing and annotating electronic medical records using a multi-modal interface
    1.
    发明授权
    System and method for accessing and annotating electronic medical records using a multi-modal interface 有权
    使用多模式界面访问和注释电子病历的系统和方法

    公开(公告)号:US07499862B1

    公开(公告)日:2009-03-03

    申请号:US11788890

    申请日:2007-04-23

    IPC分类号: G10L21/00

    摘要: A system and method of exchanging medical information between a user and a computer device is disclosed. The computer device can receive user input in one of a plurality of types of user input comprising speech, pen, gesture and a combination of speech, pen and gesture. The method comprises receiving information from the user associated with a medical condition and a bodily location of the medical condition on a patient in one of a plurality of types of user input, presenting in one of a plurality of types of system output an indication of the received medical condition and the bodily location of the medical condition, and presenting to the user an indication that the computer device is ready to receive further information. The invention enables a more flexible multi-modal interactive environment for entering medical information into a computer device. The medical device also generates multi-modal output for presenting a patient's medical condition in an efficient manner.

    摘要翻译: 公开了一种在用户和计算机设备之间交换医疗信息的系统和方法。 计算机设备可以以包括语音,笔,手势以及语音,笔和手势的组合的多种类型的用户输入中的一种接收用户输入。 所述方法包括以多种类型的用户输入中的一种类型的用户输入中的与患者的医疗状况和医疗状况的身体位置相关联的信息,以多种类型的系统中的一种输出, 接收到医疗状况和医疗状况的身体位置,并向用户呈现计算机设备准备好接收更多信息的指示。 本发明实现了用于将医疗信息输入计算机设备的更灵活的多模态交互环境。 医疗装置还产生用于以有效的方式呈现患者的医疗状况的多模式输出。

    System and method for accessing and annotating electronic medical records using multi-modal interface
    2.
    发明授权
    System and method for accessing and annotating electronic medical records using multi-modal interface 有权
    使用多模态界面访问和注释电子病历的系统和方法

    公开(公告)号:US07225131B1

    公开(公告)日:2007-05-29

    申请号:US10329123

    申请日:2002-12-24

    IPC分类号: G10L21/00

    摘要: A system and method of exchanging medical information between a user and a computer device is disclosed. The computer device can receive user input in one of a plurality of types of user input comprising speech, pen, gesture and a combination of speech, pen and gesture. The method comprises receiving information from the user associated with a medical condition and a bodily location of the medical condition on a patient in one of a plurality of types of user input, presenting in one of a plurality of types of system output an indication of the received medical condition and the bodily location of the medical condition, and presenting to the user an indication that the computer device is ready to receive further information. The invention enables a more flexible multi-modal interactive environment for entering medical information into a computer device. The medical device also generates multi modal output for presenting a patient's medical condition in an efficient manner.

    摘要翻译: 公开了一种在用户和计算机设备之间交换医疗信息的系统和方法。 计算机设备可以以包括语音,笔,手势以及语音,笔和手势的组合的多种类型的用户输入中的一种接收用户输入。 所述方法包括以多种类型的用户输入中的一种类型的用户输入中的与患者的医疗状况和医疗状况的身体位置相关联的信息,以多种类型的系统中的一种输出, 接收到医疗状况和医疗状况的身体位置,并向用户呈现计算机设备准备好接收更多信息的指示。 本发明实现了用于将医疗信息输入计算机设备的更灵活的多模态交互环境。 该医疗装置还产生多模式输出,用于以有效的方式呈现患者的医疗状况。

    System and method for accessing and annotating electronic medical records using a multi-modal interface
    3.
    发明授权
    System and method for accessing and annotating electronic medical records using a multi-modal interface 有权
    使用多模式界面访问和注释电子病历的系统和方法

    公开(公告)号:US07818177B1

    公开(公告)日:2010-10-19

    申请号:US12378560

    申请日:2009-02-17

    IPC分类号: G10L21/00

    摘要: A system and method of exchanging medical information between a user and a computer device is disclosed. The computer device can receive user input in one of a plurality of types of user input comprising speech, pen, gesture and a combination of speech, pen and gesture. The method comprises receiving information from the user associated with a medical condition and a bodily location of the medical condition on a patient in one of a plurality of types of user input, presenting in one of a plurality of types of system output an indication of the received medical condition and the bodily location of the medical condition, and presenting to the user an indication that the computer device is ready to receive further information. The invention enables a more flexible multi-modal interactive environment for entering medical information into a computer device. The medical device also generates multi-modal output for presenting a patient's medical condition in an efficient manner.

    摘要翻译: 公开了一种在用户和计算机设备之间交换医疗信息的系统和方法。 计算机设备可以以包括语音,笔,手势以及语音,笔和手势的组合的多种类型的用户输入中的一种接收用户输入。 所述方法包括以多种类型的用户输入中的一种类型的用户输入中的与患者的医疗状况和医疗状况的身体位置相关联的信息,以多种类型的系统中的一种输出, 接收到医疗状况和医疗状况的身体位置,并向用户呈现计算机设备准备好接收更多信息的指示。 本发明实现了用于将医疗信息输入计算机设备的更灵活的多模态交互环境。 医疗装置还产生用于以有效的方式呈现患者的医疗状况的多模式输出。

    Learning edit machines for robust multimodal understanding
    4.
    发明授权
    Learning edit machines for robust multimodal understanding 有权
    学习编辑机器,实现强大的多模态理解

    公开(公告)号:US07716039B1

    公开(公告)日:2010-05-11

    申请号:US11279804

    申请日:2006-04-14

    IPC分类号: G06F17/27

    CPC分类号: G06F17/289 G06F17/27

    摘要: A system and method are disclosed for processing received data associated with a grammar. The method comprises receiving input data having a characteristic that the input data cannot be assigned an interpretation by a grammar, translating the input data into translated input data and submitting the translated input data into the grammar. The transducer coerces the set of strings encoded in a lattice resulting from recognition (such as speech recognition) to the closest strings in the grammar that can be assigned an interpretation.

    摘要翻译: 公开了一种用于处理与语法相关联的接收数据的系统和方法。 该方法包括接收输入数据,该输入数据具有输入数据不能被语法解释的特征,将输入数据转换成翻译的输入数据并将翻译的输入数据提交到语法中。 传感器强制将由识别(如语音识别)产生的格子编码的字符串集合到语法中可以分配解释的最接近的字符串。

    SYSTEMS AND METHODS FOR GENERATING MARKUP-LANGUAGE BASED EXPRESSIONS FROM MULTI-MODAL AND UNIMODAL INPUTS
    7.
    发明申请
    SYSTEMS AND METHODS FOR GENERATING MARKUP-LANGUAGE BASED EXPRESSIONS FROM MULTI-MODAL AND UNIMODAL INPUTS 有权
    用于从多模式和单向输入生成基于语言的语言表达的系统和方法

    公开(公告)号:US20080046418A1

    公开(公告)日:2008-02-21

    申请号:US11773659

    申请日:2007-07-05

    IPC分类号: G06F17/30

    摘要: When using finite-state devices to perform various functions, it is beneficial to use finite state devices representing regular grammars with terminals having markup-language-based semantics. By using markup-language-based symbols in the finite state devices, it is possible to generate valid markup-language expressions by concatenating the symbols representing the result of the performed function. The markup-language expression can be used by other applications and/or devices. Finite-state devices are used to convert strings of words and gestures into valid markup-language, for example, XML, expressions that can be used, for example, to provide an application program interface to underlying system applications.

    摘要翻译: 当使用有限状态设备来执行各种功能时,使用表示具有基于标记语言的语义的终端的常规语法的有限状态设备是有益的。 通过在有限状态设备中使用基于标记语言的符号,可以通过连接表示所执行功能的结果的符号来生成有效的标记语言表达。 标记语言表达式可以由其他应用程序和/或设备使用。 有限状态设备用于将字串和手势转换为有效的标记语言,例如XML,可以使用的表达式,例如为基础系统应用程序提供应用程序接口。

    SYSTEM AND METHOD FOR USING PROSODY FOR VOICE-ENABLED SEARCH
    9.
    发明申请
    SYSTEM AND METHOD FOR USING PROSODY FOR VOICE-ENABLED SEARCH 有权
    用于语音启发搜索的系统和方法

    公开(公告)号:US20120072217A1

    公开(公告)日:2012-03-22

    申请号:US12884959

    申请日:2010-09-17

    IPC分类号: G10L15/06

    摘要: Disclosed herein are systems, methods, and non-transitory computer-readable storage media for approximating relevant responses to a user query with voice-enabled search. A system practicing the method receives a word lattice generated by an automatic speech recognizer based on a user speech and a prosodic analysis of the user speech, generates a reweighted word lattice based on the word lattice and the prosodic analysis, approximates based on the reweighted word lattice one or more relevant responses to the query, and presents to a user the responses to the query. The prosodic analysis examines metalinguistic information of the user speech and can identify the most salient subject matter of the speech, assess how confident a speaker is in the content of his or her speech, and identify the attitude, mood, emotion, sentiment, etc. of the speaker. Other information not described in the content of the speech can also be used.

    摘要翻译: 本文公开了用于使用具有语音的搜索近似对用户查询的相关响应的系统,方法和非暂时的计算机可读存储介质。 实施该方法的系统基于用户语音和用户语音的韵律分析接收由自动语音识别器生成的单词格,基于单词格点和韵律分析生成重新加权的词格,基于重新加权的词近似 对查询进行一个或多个相关响应,并向用户呈现对查询的响应。 韵律分析检查用户言语的金属语言信息,可以确定演讲中最突出的主题,评估演讲者在演讲内容中的信心,并确定态度,情绪,情感等情绪。 的演讲者。 还可以使用在语音内容中未描述的其他信息。

    SYSTEM AND METHOD FOR MULTIMODAL INTERACTION USING ROBUST GESTURE PROCESSING
    10.
    发明申请
    SYSTEM AND METHOD FOR MULTIMODAL INTERACTION USING ROBUST GESTURE PROCESSING 审中-公开
    使用稳健姿态处理的多模式相互作用的系统和方法

    公开(公告)号:US20100281435A1

    公开(公告)日:2010-11-04

    申请号:US12433320

    申请日:2009-04-30

    IPC分类号: G06F3/033

    CPC分类号: G06F3/038 G06F3/04883

    摘要: Disclosed herein are systems, computer-implemented methods, and tangible computer-readable media for multimodal interaction. The method includes receiving a plurality of multimodal inputs associated with a query, the plurality of multimodal inputs including at least one gesture input, editing the at least one gesture input with a gesture edit machine. The method further includes responding to the query based on the edited gesture input and remaining multimodal inputs. The gesture inputs can be from a stylus, finger, mouse, and other pointing/gesture device. The gesture input can be unexpected or errorful. The gesture edit machine can perform actions such as deletion, substitution, insertion, and aggregation. The gesture edit machine can be modeled as a finite-state transducer. In one aspect, the method further includes generating a lattice for each input, generating an integrated lattice of combined meaning of the generated lattices, and responding to the query further based on the integrated lattice.

    摘要翻译: 本文公开的是用于多模式交互的系统,计算机实现的方法和有形的计算机可读介质。 所述方法包括接收与查询相关联的多个多模式输入,所述多个多模式输入包括至少一个手势输入,用手势编辑机编辑所述至少一个手势输入。 该方法还包括基于编辑的手势输入和剩余的多模式输入来响应查询。 手势输入可以来自手写笔,手指,鼠标和其他指向/手势设备。 手势输入可能是意外或错误的。 手势编辑机可以执行删除,替换,插入和聚合等动作。 手势编辑机可以被建模为有限状态换能器。 一方面,所述方法还包括为每个输入生成格子,产生所产生的格子的组合意义的积分格,以及进一步基于所述积分格来响应所述查询。