-
公开(公告)号：US09606980B2
公开(公告)日：2017-03-28
申请号：US14572691
申请日：2014-12-16
发明人： Pamela D. Andrejko , Andrew R. Freed , Cynthia M. Murch , Robert L. Nielsen , Jan M. Nordland , Humberto R. Rivero
CPC分类号： G06F17/274 , G06F17/2264 , G06F17/227 , G06F17/2276 , G06F17/2282 , G06F17/241 , G06F17/2735 , G06F17/2775 , G06F17/2881 , G16H15/00
摘要： Test cases for a text annotator are generated by determining types of inputs to the annotator and analyzing language structures in a corpus to identify sentence types and grammar constructs. An input type can correspond to multiple grammar constructs. Test cases are generated by performing grammar tree transformations on selected fragments from the corpus based on the sentence types and the grammar constructs. Additional test cases are generated by replacing starting phrases in selected fragments with substitute phrases from dictionaries associated with the input types (a dictionary can include a false synonym for an input type for purposes of negative testing). The two generating approaches can be combined, i.e., performing one or more successive (different) grammar tree transformations to yield a sentence which is then subjected to phrase substitution.
-
公开(公告)号：US10275487B2
公开(公告)日：2019-04-30
申请号：US14734481
申请日：2015-06-09
发明人： Anthony W. Eichenlaub , Cynthia M. Murch , Terrence T. Nixa , Jan M. Nordland , John E. Petri , Michelle A. Schlicht
摘要： A first question may be received. A first tag may be identified. The first tag may correspond to a first demographic trait. The first tag may be for use in providing a context for generating a first answer estimate to the first question. The first answer estimate may be generated using natural language processing and based on the first tag.
-
公开(公告)号：US09390374B2
公开(公告)日：2016-07-12
申请号：US14566449
申请日：2014-12-10
发明人： Pamela D. Andrejko , Andrew R. Freed , Cynthia M. Murch , Richard A. Salmon , Charles S. Skinner
CPC分类号： G06N5/022 , G06F17/2881 , G06F17/30654 , G06F17/30867 , G06F17/3097
摘要： An approach is provided in which an information handling system analyzes correction information corresponding to an answer generated by a question answer system. The correction information includes a correction to the answer and captured variable information utilized by the question answer system to generate the answer. The information handling system selects input variables based upon the correction analysis and generates a test case that includes the selected input variables and the variable information. In turn, the information handling system tests the question answer system using the generated test case.
摘要翻译： 提供了一种方法，其中信息处理系统分析对应于由问题答案系统产生的答案的校正信息。 校正信息包括对答案的纠正和由问题答案系统利用的捕获变量信息以产生答案。 信息处理系统基于校正分析来选择输入变量，并生成包括所选择的输入变量和变量信息的测试用例。 反过来，信息处理系统使用生成的测试用例来测试问题答案系统。
-
公开(公告)号：US10572547B2
公开(公告)日：2020-02-25
申请号：US16263248
申请日：2019-01-31
摘要： A primary ingestion pipeline configured for use in natural language processing includes annotators configured for annotating documents. The annotators and documents to be annotated are evaluated. Based on the evaluations, an ingestion risk score is generated for each document. Each ingestion risk score represents a likelihood that an associated document will not successfully be annotated by the annotators. Each ingestion risk score is compared to a set of risk criteria. Based on the comparisons, a determination is made that each document of a first set of documents satisfies the set of risk criteria. A further determination is made, based on the comparisons, that each document of a second set of documents does not satisfy the set of risk criteria. In response to these determinations, the first set of documents is entered into the primary ingestion pipeline and the second set of documents is provided special handling.
-
公开(公告)号：US20160364391A1
公开(公告)日：2016-12-15
申请号：US14734481
申请日：2015-06-09
发明人： Anthony W. Eichenlaub , Cynthia M. Murch , Terrence T. Nixa , Jan M. Nordland , John E. Petri , Michelle A. Schlicht
CPC分类号： G06F17/3043 , G06F17/2785 , G06F17/2881 , G06F17/30401 , G06F17/30542 , G06F17/30867 , G06N5/04 , G06N99/005
摘要： A first question may be received. A first tag may be identified. The first tag may correspond to a first demographic trait. The first tag may be for use in providing a context for generating a first answer estimate to the first question. The first answer estimate may be generated using natural language processing and based on the first tag.
摘要翻译： 可能会收到第一个问题。 可以识别第一个标签。 第一个标签可能对应于第一个人口特征。 第一标签可以用于提供用于生成第一问题的第一答案估计的上下文。 可以使用自然语言处理并基于第一标签生成第一个答案估计。
-
公开(公告)号：US20190163706A1
公开(公告)日：2019-05-30
申请号：US16263248
申请日：2019-01-31
CPC分类号： G06F16/93 , G06F16/3344 , G06F17/241
摘要： A primary ingestion pipeline configured for use in natural language processing includes annotators configured for annotating documents. The annotators and documents to be annotated are evaluated. Based on the evaluations, an ingestion risk score is generated for each document. Each ingestion risk score represents a likelihood that an associated document will not successfully be annotated by the annotators. Each ingestion risk score is compared to a set of risk criteria. Based on the comparisons, a determination is made that each document of a first set of documents satisfies the set of risk criteria. A further determination is made, based on the comparisons, that each document of a second set of documents does not satisfy the set of risk criteria. In response to these determinations, the first set of documents is entered into the primary ingestion pipeline and the second set of documents is provided special handling.
-
7.发明申请GENERATING NATURAL LANGUAGE TEXT SENTENCES AS TEST CASES FOR NLP ANNOTATORS WITH COMBINATORIAL TEST DESIGN 有权产生自然语言文本作为具有组合测试设计的NLP神经元的测试案例公开(公告)号：US20160170972A1
公开(公告)日：2016-06-16
申请号：US14572691
申请日：2014-12-16
发明人： Pamela D. Andrejko , Andrew R. Freed , Cynthia M. Murch , Robert L. Nielsen , Jan M. Nordland , Humberto R. Rivero
CPC分类号： G06F17/274 , G06F17/2264 , G06F17/227 , G06F17/2276 , G06F17/2282 , G06F17/241 , G06F17/2735 , G06F17/2775 , G06F17/2881 , G16H15/00
摘要： Test cases for a text annotator are generated by determining types of inputs to the annotator and analyzing language structures in a corpus to identify sentence types and grammar constructs. An input type can correspond to multiple grammar constructs. Test cases are generated by performing grammar tree transformations on selected fragments from the corpus based on the sentence types and the grammar constructs. Additional test cases are generated by replacing starting phrases in selected fragments with substitute phrases from dictionaries associated with the input types (a dictionary can include a false synonym for an input type for purposes of negative testing). The two generating approaches can be combined, i.e., performing one or more successive (different) grammar tree transformations to yield a sentence which is then subjected to phrase substitution.
摘要翻译： 通过确定注释器的输入类型和分析语料库中的语言结构来识别句子类型和语法结构，来生成文本注释器的测试用例。 输入类型可以对应于多个语法结构。 通过根据句子类型和语法结构对来自语料库的所选片段执行语法树变换来生成测试用例。 通过使用与输入类型相关联的字典中的替换短语替换所选片段中的起始短语来生成另外的测试用例（字典可以包括用于负测试的输入类型的假同义词）。 两个生成方法可以组合，即执行一个或多个连续（不同）语法树转换，以产生一个句子，然后进行短语替换。
-
公开(公告)号：US10318591B2
公开(公告)日：2019-06-11
申请号：US14728050
申请日：2015-06-02
摘要： A primary ingestion pipeline configured for use in natural language processing includes annotators configured for annotating documents. The annotators and documents to be annotated are evaluated. Based on the evaluations, an ingestion risk score is generated for each document. Each ingestion risk score represents a likelihood that an associated document will not successfully be annotated by the annotators. Each ingestion risk score is compared to a set of risk criteria. Based on the comparisons, a determination is made that each document of a first set of documents satisfies the set of risk criteria. A further determination is made, based on the comparisons, that each document of a second set of documents does not satisfy the set of risk criteria. In response to these determinations, the first set of documents is entered into the primary ingestion pipeline and the second set of documents is provided special handling.
-
公开(公告)号：US20160359894A1
公开(公告)日：2016-12-08
申请号：US14728050
申请日：2015-06-02
CPC分类号： G06F17/30011 , G06F17/241 , G06F17/30684
摘要： A primary ingestion pipeline configured for use in natural language processing includes annotators configured for annotating documents. The annotators and documents to be annotated are evaluated. Based on the evaluations, an ingestion risk score is generated for each document. Each ingestion risk score represents a likelihood that an associated document will not successfully be annotated by the annotators. Each ingestion risk score is compared to a set of risk criteria. Based on the comparisons, a determination is made that each document of a first set of documents satisfies the set of risk criteria. A further determination is made, based on the comparisons, that each document of a second set of documents does not satisfy the set of risk criteria. In response to these determinations, the first set of documents is entered into the primary ingestion pipeline and the second set of documents is provided special handling.
摘要翻译： 配置用于自然语言处理的主要摄取流水线包括被配置用于注释文档的注释器。 评估要注释的注释器和文档。 根据评估，为每个文件生成摄取风险评分。 每个摄入风险分数表示相关联的文档不会被注释器成功注释的可能性。 将每个摄入风险评分与一组风险标准进行比较。 根据比较，确定第一组文件的每个文件都满足一组风险标准。 基于比较，进一步确定第二组文档的每个文档不满足一组风险标准。 响应于这些确定，第一组文件被输入到主要摄取管道中，并且第二组文档被提供特殊处理。
-
公开(公告)号：US20160171371A1
公开(公告)日：2016-06-16
申请号：US14566449
申请日：2014-12-10
发明人： Pamela D. Andrejko , Andrew R. Freed , Cynthia M. Murch , Richard A. Salmon , Charles S. Skinner
CPC分类号： G06N5/022 , G06F17/2881 , G06F17/30654 , G06F17/30867 , G06F17/3097
摘要： An approach is provided in which an information handling system analyzes correction information corresponding to an answer generated by a question answer system. The correction information includes a correction to the answer and captured variable information utilized by the question answer system to generate the answer. The information handling system selects input variables based upon the correction analysis and generates a test case that includes the selected input variables and the variable information. In turn, the information handling system tests the question answer system using the generated test case.
摘要翻译： 提供了一种方法，其中信息处理系统分析对应于由问题答案系统产生的答案的校正信息。 校正信息包括对答案的纠正和由问题答案系统利用的捕获变量信息以产生答案。 信息处理系统基于校正分析来选择输入变量，并生成包括所选择的输入变量和变量信息的测试用例。 反过来，信息处理系统使用生成的测试用例来测试问题答案系统。
-
-
-
-
-
-
-
-
-
搜索结果
10 条记录 (耗时 0.027 秒)