公开(公告)号：US07559057B2

公开(公告)日：2009-07-07

申请号：US10729736

申请日：2003-12-05

申请人： Vittorio Castelli ,  Lawrence D. Bergman ,  Tessa A. Lau ,  Daniel A. Oblinger

发明人： Vittorio Castelli ,  Lawrence D. Bergman ,  Tessa A. Lau ,  Daniel A. Oblinger

IPC分类号： G06F9/45 ,  G06E1/00 ,  G06N5/02

CPC分类号： G06F11/3636 ,  G06F8/00

摘要： A method and system for generating one or more Computer-executable procedures simultaneously learns from a collection of procedure instances recorded by different users on a variety of computers aligning multiple traces and using the aligned traces to generalize.

摘要翻译： 用于生成一个或多个计算机可执行过程的方法和系统同时从在各种计算机上记录的不同用户记录的过程实例的集合中学习，所述计算机对齐多个迹线并使用对齐的跟踪来概括。

公开(公告)号：US20080120553A1

公开(公告)日：2008-05-22

申请号：US11560384

申请日：2006-11-16

申请人： Lawrence D. Bergman ,  Vittorio Castelli ,  Tessa A. Lau ,  Daniel A. Oblinger

发明人： Lawrence D. Bergman ,  Vittorio Castelli ,  Tessa A. Lau ,  Daniel A. Oblinger

IPC分类号： G06F3/00

CPC分类号： H04L67/025 ,  G06F3/1454 ,  H04L41/22 ,  H04L67/38

摘要： Under the present invention, an illustrative feature is to provide a method and system/structure for remotely controlling multiple computer systems by interacting with GUIs. Specifically, the present invention allows a controlled computer/system to be remotely controlled via a controlling computer/system. To this extent, data/action capture instrumentation is provided on the controlling system for automatically creating a representation of content of the GUI of the controlling system, for automatically observing a set of actions performed by a user on the GUI of the controlling system, for automatically creating a representation of the observed actions, and for sending to the controlled system the representation of the observed actions. In addition, execution instrumentation is provided on the controlled system for receiving the representation and replicating the actions on the controlled system by interacting with a GUI of the controlled system.

摘要翻译： 在本发明中，说明性的特征是提供一种用于通过与GUI交互来远程控制多个计算机系统的方法和系统/结构。 具体地，本发明允许受控计算机/系统通过控制计算机/系统进行远程控制。 在这种程度上，在控制系统上提供数据/动作捕获仪器，用于自动创建控制系统的GUI的内容的表示，用于自动观察由用户在控制系统的GUI上执行的一组动作，用于 自动创建观察到的动作的表示，以及向受控系统发送观察到的动作的表示。 此外，在受控系统上提供执行仪器，用于通过与受控系统的GUI交互来接收表示和复制受控系统上的动作。

公开(公告)号：US07801835B2

公开(公告)日：2010-09-21

申请号：US11152381

申请日：2005-06-15

申请人： Lawrence Bergman ,  Vittorio Castelli ,  Prabhakar N. Kudva ,  Tessa A. Lau ,  Daniel A. Oblinger

发明人： Lawrence Bergman ,  Vittorio Castelli ,  Prabhakar N. Kudva ,  Tessa A. Lau ,  Daniel A. Oblinger

IPC分类号： G06N5/00

CPC分类号： G06N99/005

摘要： A system for and method of constructing an executable reusable procedure which includes determining an executable procedure from at least one scored trace of a procedure execution.

摘要翻译： 一种构造可执行可重用过程的系统和方法，包括从过程执行的至少一个记分轨迹确定可执行过程。

公开(公告)号：US08595636B2

公开(公告)日：2013-11-26

申请号：US11560383

申请日：2006-11-16

申请人： Lawrence D. Bergman ,  Vittorio Castelli ,  Daniel A. Oblinger

发明人： Lawrence D. Bergman ,  Vittorio Castelli ,  Daniel A. Oblinger

IPC分类号： G06F3/048

CPC分类号： G06F3/048 ,  G06F17/30533

摘要： As indicated above, an exemplary feature of the present invention is to automatically identify corresponding GUI elements on different computer systems, or the same computer system at different points in time. Specifically, under the present invention, a user action on a widget of a GUI provided by an application loaded a first computer system is observed, and information about the widget(s) involved in the user action as well as on all other widget(s) in the GUI is collected and associated with the user action. Thereafter a widget(s) (on which the user action is to be performed) of a GUI provided by the application as loaded on a second computer system is robustly identified using the collection information. Then, the action is performed on the identified widget(s). In identifying the widget(s), the present invention utilizes a set of hard and soft constraints to identify a matching widget(s).

摘要翻译： 如上所述，本发明的示例性特征是在不同的时间点上自动识别不同计算机系统或相同计算机系统上的相应GUI元素。 具体地说，在本发明中，观察到由加载第一计算机系统的应用程序提供的GUI的widget的用户动作，以及关于用户动作中涉及的widget的信息以及所有其他widget ）在GUI中被收集并与用户操作相关联。 此后，使用收集信息可靠地识别由加载在第二计算机系统上的应用程序所提供的GUI的（要执行用户操作的小部件）。 然后，对所识别的小部件执行动作。 在识别窗口小部件时，本发明利用一组硬和软约束来识别匹配的窗口部件。

公开(公告)号：US07962847B2

公开(公告)日：2011-06-14

申请号：US11254976

申请日：2005-10-20

申请人： Peter K. Malkin ,  Thomas D. Erickson ,  Wendy A. Kellogg ,  Brent Tzion Hailpern ,  Lawrence D. Bergman ,  Vittorio Castelli ,  Daniel A. Oblinger

发明人： Peter K. Malkin ,  Thomas D. Erickson ,  Wendy A. Kellogg ,  Brent Tzion Hailpern ,  Lawrence D. Bergman ,  Vittorio Castelli ,  Daniel A. Oblinger

IPC分类号： G06F17/00

CPC分类号： G06F17/241

摘要： A system and method for obtaining a process definition; determining the current process; determining the current process step; determining whether a whether a user has requested creation or modification of an annotation of the current process or step; receiving information from the user for creating the annotation when a user has requested creation of an annotation; and displaying the annotation.

摘要翻译： 一种用于获得过程定义的系统和方法; 确定当前流程; 确定当前流程步骤; 确定用户是否请求创建或修改当前过程或步骤的注释; 当用户请求创建注释时，从用户接收用于创建注释的信息; 并显示注释。

公开(公告)号：US20080120336A1

公开(公告)日：2008-05-22

申请号：US11560383

申请日：2006-11-16

申请人： Lawrence D. Bergman ,  Vittorio Castelli ,  Daniel A. Oblinger

发明人： Lawrence D. Bergman ,  Vittorio Castelli ,  Daniel A. Oblinger

IPC分类号： G06F3/048 ,  G06F17/30

CPC分类号： G06F3/048 ,  G06F17/30533

摘要： As indicated above, an exemplary feature of the present invention is to automatically identify corresponding GUI elements on different computer systems, or the same computer system at different points in time. Specifically, under the present invention, a user action on a widget of a GUI provided by an application loaded a first computer system is observed, and information about the widget(s) involved in the user action as well as on all other widget(s) in the GUI is collected and associated with the user action. Thereafter a widget(s) (on which the user action is to be performed) of a GUI provided by the application as loaded on a second computer system is robustly identified using the collection information. Then, the action is performed on the identified widget(s). In identifying the widget(s), the present invention utilizes a set of hard and soft constraints to identify a matching widget(s).

摘要翻译： 如上所述，本发明的示例性特征是在不同的时间点上自动识别不同计算机系统或相同计算机系统上的相应GUI元素。 具体地说，在本发明中，观察到由加载第一计算机系统的应用程序提供的GUI的widget的用户动作，以及关于用户动作中涉及的widget的信息以及所有其他widget ）在GUI中被收集并与用户操作相关联。 此后，使用收集信息可靠地识别由加载在第二计算机系统上的应用程序所提供的GUI的用户操作（在其上执行用户操作）的小部件。 然后，对所识别的小部件执行动作。 在识别窗口小部件时，本发明利用一组硬和软约束来识别匹配的窗口部件。

公开(公告)号：US06785676B2

公开(公告)日：2004-08-31

申请号：US09778139

申请日：2001-02-07

申请人： Daniel A. Oblinger

发明人： Daniel A. Oblinger

IPC分类号： G06F1730

CPC分类号： G06F17/30997 ,  G06Q30/02 ,  G06Q30/06 ,  Y10S707/99934 ,  Y10S707/99935

摘要： A system and method for annotating resource results obtained in a customer self service system that performs resource search and selection. The method comprising the steps of: receiving a resource response set of results obtained in response to a current user query and receiving a user context vector associated with the current user query, the user context vector comprising data associating an interaction state with the user; applying an ordering and annotation function for mapping the user context vector with the resource response set to generate an annotated response set having one or more annotations; and, controlling the presentation of the resource response set to the user according to the annotations, wherein the ordering and annotation function is executed interactively at the time of each user query. In an off-line process, a supervised learning algorithm is implemented for receiving user interaction data from among a database of user interaction records and an annotation scoring metric representing a measure of performance in locating resource response results displayed via a graphical interface. The algorithm generates ordering and annotation functions which are adaptable based on history of user interactions as provided in the database of user interaction records. The result of this invention is the ability to drive visualization systems for presenting resource response results in the most beneficial and meaningful way to the user via an interface when performing search and resource selection. The system and method is especially applicable for a self service system in a variety of customer self service domains including education, real estate and travel.

摘要翻译： 一种用于注释在执行资源搜索和选择的客户自助服务系统中获得的资源结果的系统和方法。 该方法包括以下步骤：接收响应于当前用户查询获得的结果的资源响应集合，并且接收与当前用户查询相关联的用户上下文向量，所述用户上下文向量包括将交互状态与用户相关联的数据; 应用排序和注释功能，用于将所述用户上下文矢量与所述资源响应集合进行映射以生成具有一个或多个注释的带注释的响应集合; 以及根据所述注释控制对所述用户的所述资源响应的呈现，其中所述排序和注释功能在每个用户查询时被交互地执行。 在离线过程中，实施监督学习算法，用于从用户交互记录的数据库中接收用户交互数据，以及表示在经由图形界面显示的定位资源响应结果中的性能测量的注释评分度量。 该算法基于用户交互记录的数据库中提供的用户交互历史，生成可适应性的排序和注释功能。 本发明的结果是，当执行搜索和资源选择时，可以通过接口来驱动可视化系统，以最有益和有意义的方式向用户呈现资源响应结果。 该系统和方法特别适用于各种客户自助服务领域的自助服务体系，包括教育，房地产和旅游。

公开(公告)号：US06701311B2

公开(公告)日：2004-03-02

申请号：US09778146

申请日：2001-02-07

申请人： Debra L. Biebesheimer ,  Donn P. Jasura ,  Neal M. Keller ,  Daniel A. Oblinger ,  Mark E. Podlaseck ,  Stephen J. Rolando

发明人： Debra L. Biebesheimer ,  Donn P. Jasura ,  Neal M. Keller ,  Daniel A. Oblinger ,  Mark E. Podlaseck ,  Stephen J. Rolando

IPC分类号： G06F1730

CPC分类号： G06F17/30864 ,  Y10S707/99933 ,  Y10S707/99935 ,  Y10S707/99945 ,  Y10S707/99952

摘要： A customer self service system and method for performing resource search and selection. The method includes steps of providing an interface enabling entry of a query for a resource and specification of one or more user context elements, each element representing a context associated with the current user state and having context attributes and attribute values associated therewith; enabling user specification of relevant resource selection criteria for enabling expression of relevance of resource results in terms of user context; searching a resource database and generating a resource response set having resources that best match a user's query, user context attributes and user defined relevant resource selection criteria; presenting said resource response set to the user in a manner whereby a relevance of each of the resources being expressed in terms of user context in a manner optimized to facilitate resource selection; and, enabling continued user selection and modification of context attribute values to enable increased specificity and accuracy of a user's query to thereby result in improved selection logic and attainment of resource response sets best fitted to the query. More particularly, adaptive algorithms and supervised and unsupervised learning sub-processes are implemented to enable the self service resource search and selection system to learn from each and all users and make that learning operationally benefit all users over time.

摘要翻译： 用于执行资源搜索和选择的客户自助系统和方法。 该方法包括以下步骤：提供能够输入资源的查询和指定一个或多个用户上下文元素的接口，每个元素表示与当前用户状态相关联的上下文并具有与其相关联的上下文属性和属性值; 使用户能够根据用户上下文来指定相关的资源选择标准，以便能够表达资源结果的相关性; 搜索资源数据库并生成具有与用户查询，用户上下文属性和用户定义的相关资源选择标准最匹配的资源的资源响应集合; 以如下方式呈现所述资源响应集，所述方式使得根据用户上下文来表达每个资源的相关性以优化的方式来促进资源选择; 并且允许继续用户选择和修改上下文属性值，以使得用户查询的特异性和准确度增加，从而导致改进的选择逻辑和获得最适合查询的资源响应集。 更具体地，实现自适应算法和监督和无监督的学习子过程，以使得自助服务资源搜索和选择系统能够从每个和所有用户学习，并使得该学习随着时间的推移对所有用户进行操作上的益处。

公开(公告)号：US09165280B2

公开(公告)日：2015-10-20

申请号：US11062382

申请日：2005-02-22

申请人： Sara H. Basson ,  Dimitri Kanevsky ,  Daniel A. Oblinger

发明人： Sara H. Basson ,  Dimitri Kanevsky ,  Daniel A. Oblinger

IPC分类号： G06F3/00 ,  G06F3/048 ,  G06Q10/10 ,  G05D1/00 ,  G05D3/00 ,  G06F7/00 ,  G06F17/00

CPC分类号： G06Q10/10

摘要： Dynamic modification of user interfaces is disclosed, based upon identification of the current state of the user and the sensing of a particular situation in which the user is involved and/or environment in which the user is situated. In particular, emotional and mental states of a user are identified and these states are taken into consideration when creating and/or adapting an interface to be used by the user. The interface is modified/created automatically based on identified user biometrics, that is, measured physical properties of the user.

摘要翻译： 基于用户的当前状态的识别和用户所涉及的特定情况的感测和/或用户所在的环境来公开用户界面的动态修改。 特别地，识别用户的情绪和精神状态，并且在创建和/或调整要由用户使用的界面时考虑这些状态。 界面根据识别的用户生物特征，即用户的测量物理属性自动修改/创建。

公开(公告)号：US06693651B2

公开(公告)日：2004-02-17

申请号：US09778147

申请日：2001-02-07

申请人： Debra L. Biebesheimer ,  Donn P. Jasura ,  Neal M. Keller ,  Daniel A. Oblinger ,  Mark E. Podlaseck ,  Stephen J. Rolando

发明人： Debra L. Biebesheimer ,  Donn P. Jasura ,  Neal M. Keller ,  Daniel A. Oblinger ,  Mark E. Podlaseck ,  Stephen J. Rolando

IPC分类号： G09G500

CPC分类号： G06F17/30696

摘要： A graphical user interface for a customer self service system that performs resource search and selection including a system and method for controlling a display of resources resulting from a query initiated by a user of the system. The system and method for controlling the display includes the steps of: enabling via a first graphic interface, entry of a query and selection of one or more user context icons, each representing a context associated with the current user situation and having context attribute parameters associated therewith; enabling, via a second graphic interface, user specification of relevant resource selection criteria for enabling expression of relevance of resource results in terms of user context; searching a resource database and generating a resource response set for best matching a user's query, user context attributes and user defined relevant resource selection criteria; and, displaying via a third graphic interface, the response set of resources that the customer self service system has determined to match the user's query based on the user's context, attributes and user defined resource selection criteria utilized in search. Central to the system is the expression of the relevance of results in terms of user context in a manner optimized to facilitate resource selection.

摘要翻译： 用于执行资源搜索和选择的客户自助服务系统的图形用户界面，包括用于控制由系统的用户启动的查询产生的资源的显示的系统和方法。 用于控制显示器的系统和方法包括以下步骤：通过第一图形界面启用查询的输入和一个或多个用户上下文图标的选择，每个用户上下文图标表示与当前用户情况相关联的上下文，并且具有关联的上下文属性参数 与; 通过第二图形界面，使用户能够根据用户上下文来指定相关的资源选择标准，以便表达资源结果的相关性; 搜索资源数据库并生成用于最佳匹配用户查询，用户上下文属性和用户定义的相关资源选择标准的资源响应集合; 并且经由第三图形界面显示客户自助服务系统基于用户的上下文，属性和在搜索中使用的用户定义的资源选择标准来确定与用户的查询相匹配的资源的响应集合。 系统的核心是以优化的方式在用户上下文中表达结果的相关性，以促进资源选择。