-
1.发明申请公开(公告)号：US20110153310A1
公开(公告)日：2011-06-23
申请号：US12645589
申请日：2009-12-23
Applicant: Patrick Ehlen , Michael Johnston , Remi Zajac
Inventor： Patrick Ehlen , Michael Johnston , Remi Zajac
CPC classification number: G06T11/00 , H04L67/04 , H04L67/18 , H04M3/42348 , H04M2250/10
Abstract: In one or more embodiments, one or more methods and/or systems described can perform producing a lattice of object hypotheses based on multiple reference objects from image information; receiving input speech information that includes a request for information associated with at least one reference object of the multiple reference objects; producing a lattice of speech hypotheses based on at least a first possible description included in the speech information; producing a lattice of scored semantic hypotheses based on at least the lattice of object hypotheses and the lattice of speech hypotheses; determining that a single semantic interpretation score of the lattice of scored semantic hypotheses exceeds a predetermined value; and providing requested information associated with the at least the first reference object of the plurality of reference objects.
Abstract translation: 在一个或多个实施例中，所描述的一个或多个方法和/或系统可以基于来自图像信息的多个参考对象来执行产生对象假设的格子; 接收包括与所述多个参考对象的至少一个参考对象相关联的信息的请求的输入语音信息; 基于语音信息中包含的至少第一可能的描述产生语音假设的格子; 至少基于对象假设的格子和言语假说的格子产生一个刻划的语义假设的格子; 确定得分的语义假设的格子的单个语义解释得分超过预定值; 以及提供与所述多个参考对象中的至少第一参考对象相关联的所请求的信息。
-
2.发明授权System and method of handling problematic input during context-sensitive help for multi-modal dialog systems 有权在多模式对话系统的上下文相关帮助过程中处理问题输入的系统和方法公开(公告)号：US07177816B2
公开(公告)日：2007-02-13
申请号：US10326629
申请日：2002-12-19
Applicant: Patrick Ehlen , Helen Hastie , Michael Johnston
Inventor： Patrick Ehlen , Helen Hastie , Michael Johnston
CPC classification number: G10L15/22 , G10L2015/221 , G10L2015/228
Abstract: A method of presenting a multi-modal help dialog move to a user in a multi-modal dialog system is disclosed. The method comprises presenting an audio portion of the multi-modal help dialog move that explains available ways of user inquiry and presenting a corresponding graphical action performed on a user interface associated with the audio portion. The multi-modal help dialog move is context-sensitive and uses current display information and dialog contextual information to present a multi-modal help move that is currently related to the user. A user request or a problematic dialog detection module may trigger the multi-modal help move.
Abstract translation: 公开了一种向多用户对话系统中的用户呈现多模式帮助对话框的方法。 该方法包括呈现多模式帮助对话移动的音频部分，其解释用户查询的可用方式并呈现在与音频部分相关联的用户界面上执行的对应图形动作。 多模式帮助对话框移动是上下文相关的，并使用当前显示信息和对话框上下文信息来呈现当前与用户相关的多模式帮助移动。 用户请求或有问题的对话检测模块可以触发多模式帮助移动。
-
3.发明授权Systems, methods, and computer program products for location salience modeling for multimodal search 有权用于多模态搜索的位置显着性建模的系统，方法和计算机程序产品公开(公告)号：US08700655B2
公开(公告)日：2014-04-15
申请号：US12941312
申请日：2010-11-08
Applicant: Michael Johnston , Patrick Ehlen
Inventor： Michael Johnston , Patrick Ehlen
CPC classification number: G06F17/3087 , G01C21/3608
Abstract: Computational models of dialog context have often focused on unimodal spoken dialog or text, using the language itself as the primary locus of contextual information. But as spoken unimodal interaction is replaced by situated multimodal interaction on mobile platforms supporting a combination of spoken dialog with graphical interaction, touch-screen input, geolocation, and other non-linguistic contextual factors, a need arises for more sophisticated models of context that capture the influence of these factors on semantic interpretation and dialog flow. The systems, methods, and computer program products disclosed herein address this need. A method for multimodal search includes, in part, determining an intended location of search query based upon information received from a remote mobile device that issued the search query.
Abstract translation: 对话语境的计算模型往往侧重于单语口语对话或文本，使用语言本身作为语境信息的主要场所。 但是，由于口头单模互动被移动平台上的定位多模态交互所取代，支持语音对话与图形交互，触摸屏输入，地理位置和其他非语言背景因素的组合，需要出现更复杂的上下文模型 这些因素对语义解释和对话流程的影响。 本文所公开的系统，方法和计算机程序产品满足了这一需求。 用于多模式搜索的方法部分地包括基于从发出搜索查询的远程移动设备接收的信息来确定搜索查询的预期位置。
-
公开(公告)号：US08688443B2
公开(公告)日：2014-04-01
申请号：US12645589
申请日：2009-12-23
Applicant: Patrick Ehlen , Michael Johnston , Remi Zajac
Inventor： Patrick Ehlen , Michael Johnston , Remi Zajac
IPC: G10L13/00
CPC classification number: G06T11/00 , H04L67/04 , H04L67/18 , H04M3/42348 , H04M2250/10
Abstract: In one or more embodiments, one or more methods and/or systems described can perform producing a lattice of object hypotheses based on multiple reference objects from image information; receiving input speech information that includes a request for information associated with at least one reference object of the multiple reference objects; producing a lattice of speech hypotheses based on at least a first possible description included in the speech information; producing a lattice of scored semantic hypotheses based on at least the lattice of object hypotheses and the lattice of speech hypotheses; determining that a single semantic interpretation score of the lattice of scored semantic hypotheses exceeds a predetermined value; and providing requested information associated with the at least the first reference object of the plurality of reference objects.
Abstract translation: 在一个或多个实施例中，所描述的一个或多个方法和/或系统可以基于来自图像信息的多个参考对象来执行产生对象假设的格子; 接收包括与所述多个参考对象的至少一个参考对象相关联的信息的请求的输入语音信息; 基于语音信息中包含的至少第一可能的描述产生语音假设的格子; 至少基于对象假设的格子和言语假说的格子产生一个刻划的语义假设的格子; 确定得分的语义假设的格子的单个语义解释得分超过预定值; 以及提供与所述多个参考对象中的至少第一参考对象相关联的所请求的信息。
-
公开(公告)号：US09026915B1
公开(公告)日：2015-05-05
申请号：US11263051
申请日：2005-10-31
Applicant: Patrick Ehlen , David Crawford Gibbon , Mazin Gilbert , Michael Johnston , Zhu Liu , Behzad Shahraray
Inventor： Patrick Ehlen , David Crawford Gibbon , Mazin Gilbert , Michael Johnston , Zhu Liu , Behzad Shahraray
CPC classification number: G06F17/24 , G06F3/0481 , G06F3/0482 , G06F3/167 , G06F17/211 , G06F17/241 , G06F17/28 , G06F17/30056 , G06F17/30418 , G06F17/30781 , G06F17/30864 , G06F17/30867 , G06Q10/10 , G10L15/22 , G10L15/26 , G11B27/105 , H04N5/74
Abstract: The invention provides for a system, method, and computer readable medium storing instructions related to controlling a presentation in a multimodal system. The method embodiment of the invention is a method for the retrieval of information on the basis of its content for incorporation into an electronic presentation. The method comprises receiving from a user a content-based request for at least one segment from a first plurality of segments within a media presentation preprocessed to enable natural language content searchability; in response to the request, presenting a subset of the first plurality of segments to the user; receiving a selection indication from the user associated with at least one segment of the subset of the first plurality of segments and adding the selected at least one segment to a deck for use in a presentation.
Abstract translation: 本发明提供了一种系统，方法和计算机可读介质，其存储与在多模式系统中控制演示有关的指令。 本发明的方法实施例是一种用于基于其内容检索信息的方法，用于并入电子呈现。 该方法包括从用户接收基于内容的对来自预处理的媒体表现中的第一多个段中的至少一个段的请求，以实现自然语言内容可搜索性; 响应于所述请求，向所述用户呈现所述第一多个段的子集; 从所述用户接收与所述第一多个段的所述子集的至少一个段相关联的选择指示，并且将所选择的至少一个段添加到用于呈现的甲板。
-
Patent Agency Ranking
6.发明授权公开(公告)号：US09116989B1
公开(公告)日：2015-08-25
申请号：US11319779
申请日：2005-12-29
Applicant: Patrick Ehlen , David C. Gibbon , Mazin Gilbert , Michael Johnston , Zhu Liu , Behzad Shahraray
Inventor： Patrick Ehlen , David C. Gibbon , Mazin Gilbert , Michael Johnston , Zhu Liu , Behzad Shahraray
CPC classification number: G06F3/167 , G06F3/038 , G06F3/0481 , G06F3/0482 , G06F3/04842 , G06F3/04883 , G06F17/28 , G06F17/30029 , G06F17/30554 , G06F17/30864 , G06F17/30867 , G06F2203/0381 , G10L15/18
Abstract: There is provided for a system, method, and computer readable medium storing instructions related to controlling a presentation in a multimodal system. A method for the retrieval of information on the basis of its content for real-time incorporation into an electronic presentation is discussed. One method includes controlling a media presentation using a multimodal interface. The method involves receiving from a presenter a content-based request associated with a plurality of segments within a media presentation preprocessed for context-based searching; displaying the media presentation and displaying to the presenter results in response to the content-based request; receiving a selection from the presenter of at least one result; and displaying the selected result to an audience.
Abstract translation: 提供了一种用于存储与在多模式系统中控制呈现相关的指令的系统，方法和计算机可读介质。 讨论了一种基于其内容来检索信息以便实时并入到电子演示中的方法。 一种方法包括使用多模式界面来控制媒体呈现。 该方法包括从演示者接收与预处理用于基于上下文的搜索的媒体表现中的与多个片段相关联的基于内容的请求; 响应于基于内容的请求，向演示者显示媒体呈现和显示结果; 从演示者接收至少一个结果的选择; 并将所选结果显示给观众。
-
7.发明申请SYSTEM AND METHOD OF HANDLING PROBLEMATIC INPUT DURING CONTEXT-SENSITIVE HELP FOR MULTI-MODAL DIALOG SYSTEMS 审中-公开用于多模式对话系统的语境敏感性帮助中处理问题输入的系统和方法公开(公告)号：US20090094036A1
公开(公告)日：2009-04-09
申请号：US12267183
申请日：2008-11-07
Applicant: Patrick Ehlen , Helen Hastie , Michael Johnston
Inventor： Patrick Ehlen , Helen Hastie , Michael Johnston
IPC: G10L21/00
CPC classification number: G10L15/22 , G10L2015/221 , G10L2015/228
Abstract: A method of presenting a multi-modal help dialog move to a user in a multi-modal dialog system is disclosed. The method comprises presenting an audio portion of the multi-modal help dialog move that explains available ways of user inquiry and presenting a corresponding graphical action performed on a user interface associated with the audio portion. The multi-modal help dialog move is context-sensitive and uses current display information and dialog contextual information to present a multi-modal help move that is currently related to the user. A user request or a problematic dialog detection module may trigger the multi-modal help move.
Abstract translation: 公开了一种向多用户对话系统中的用户呈现多模式帮助对话框的方法。 该方法包括呈现多模式帮助对话移动的音频部分，其解释用户查询的可用方式并呈现在与音频部分相关联的用户界面上执行的对应图形动作。 多模式帮助对话框移动是上下文相关的，并使用当前显示信息和对话框上下文信息来呈现当前与用户相关的多模式帮助移动。 用户请求或有问题的对话检测模块可以触发多模式帮助移动。
-
8.发明授权公开(公告)号：US08977965B1
公开(公告)日：2015-03-10
申请号：US11207439
申请日：2005-08-19
Applicant: Patrick Ehlen , David Crawford Gibbon , Mazin Gilbert , Michael Johnston , Zhu Liu , Behzad Shahraray
Inventor： Patrick Ehlen , David Crawford Gibbon , Mazin Gilbert , Michael Johnston , Zhu Liu , Behzad Shahraray
IPC: G06F3/00
CPC classification number: G06F3/167 , G06F3/038 , G06F3/0482 , G06F3/0483 , G06F3/04842 , G06F2203/0381
Abstract: The invention provides for a system, method, and computer readable medium storing instructions related to controlling a presentation in a multimodal system. The method embodiment of the invention is a method for the retrieval of information on the basis of its content for real-time incorporation into an electronic presentation. The method comprises receiving from a presenter a content-based request for at least one segment of a first plurality of segments within a media presentation and while displaying the media presentation to an audience, displaying to the presenter a second plurality of segments in response to the content-based request. The computing device practicing the method receives a selection from the presenter of a segment from the second plurality of segments and displays to the audience the selected segment.
Abstract translation: 本发明提供了一种系统，方法和计算机可读介质，其存储与在多模式系统中控制演示有关的指令。 本发明的方法实施例是一种用于基于其内容来检索信息以便实时并入到电子呈现中的方法。 所述方法包括从演示者接收基于内容的对媒体呈现内的第一多个片段的至少一个片段的请求，并且在向观众显示媒体呈现的同时，向演示者显示响应于第 基于内容的请求。 实施该方法的计算设备从第二多个段接收来自段的演示者的选择，并向观众显示所选择的段。
-
9.发明申请Systems, Methods, and Computer Program Products for Location Salience Modeling for Multimodal Search 有权系统，方法和计算机程序产品用于多模态搜索的位置显式建模公开(公告)号：US20120117112A1
公开(公告)日：2012-05-10
申请号：US12941312
申请日：2010-11-08
Applicant: Michael Johnston , Patrick Ehlen
Inventor： Michael Johnston , Patrick Ehlen
CPC classification number: G06F17/3087 , G01C21/3608
Abstract: Computational models of dialog context have often focused on unimodal spoken dialog or text, using the language itself as the primary locus of contextual information. But as spoken unimodal interaction is replaced by situated multimodal interaction on mobile platforms supporting a combination of spoken dialog with graphical interaction, touch-screen input, geolocation, and other non-linguistic contextual factors, a need arises for more sophisticated models of context that capture the influence of these factors on semantic interpretation and dialog flow. The systems, methods, and computer program products disclosed herein address this need. A method for multimodal search includes, in part, determining an intended location of search query based upon information received from a remote mobile device that issued the search query.
Abstract translation: 对话语境的计算模型往往侧重于单语口语对话或文本，使用语言本身作为语境信息的主要场所。 但是，由于口头单模互动被移动平台上的定位多模态交互所取代，支持语音对话与图形交互，触摸屏输入，地理位置和其他非语言背景因素的组合，需要出现更复杂的上下文模型 这些因素对语义解释和对话流程的影响。 本文所公开的系统，方法和计算机程序产品满足了这一需求。 用于多模式搜索的方法部分地包括基于从发出搜索查询的远程移动设备接收的信息来确定搜索查询的预期位置。
-
10.发明授权System and method of handling problematic input during context-sensitive help for multi-modal dialog systems 有权在多模式对话系统的上下文相关帮助过程中处理问题输入的系统和方法公开(公告)号：US07451088B1
公开(公告)日：2008-11-11
申请号：US11619325
申请日：2007-01-03
Applicant: Patrick Ehlen , Helen Hastie , Michael Johnston
Inventor： Patrick Ehlen , Helen Hastie , Michael Johnston
CPC classification number: G10L15/22 , G10L2015/221 , G10L2015/228
Abstract: A method of presenting a multi-modal help dialog move to a user in a multi-modal dialog system is disclosed. The method comprises presenting an audio portion of the multi-modal help dialog move that explains available ways of user inquiry and presenting a corresponding graphical action performed on a user interface associated with the audio portion. The multi-modal help dialog move is context-sensitive and uses current display information and dialog contextual information to present a multi-modal help move that is currently related to the user. A user request or a problematic dialog detection module may trigger the multi-modal help move.
Abstract translation: 公开了一种向多用户对话系统中的用户呈现多模式帮助对话框的方法。 该方法包括呈现多模式帮助对话移动的音频部分，其解释用户查询的可用方式并呈现在与音频部分相关联的用户界面上执行的对应图形动作。 多模式帮助对话框移动是上下文相关的，并使用当前显示信息和对话框上下文信息来呈现当前与用户相关的多模式帮助移动。 用户请求或有问题的对话检测模块可以触发多模式帮助移动。
-
-
-
-
-
-
-
-
-
Search Results
11
records
(took 0.011 seconds)
