公开(公告)号：US20100223214A1

公开(公告)日：2010-09-02

申请号：US12395586

申请日：2009-02-27

申请人： Alok S. Kirpal ,  Sandeepkumar Bhuramal Satpal ,  Meghana Kshirsagar ,  Srinivasan H. Sengamedu

发明人： Alok S. Kirpal ,  Sandeepkumar Bhuramal Satpal ,  Meghana Kshirsagar ,  Srinivasan H. Sengamedu

IPC分类号： G06F15/18

CPC分类号： G06F16/86

摘要： A method and apparatus for automatically extracting information from a large number of documents through applying machine learning techniques and exploiting structural similarities among documents. A machine learning model is trained to have at least 50% accuracy. The trained machine learning model is used to identify information attributes in a sample of pages from a cluster of structurally similar documents. A structure-specific model of the cluster is created by compiling a list of top-K locations for each attribute identified by the trained machine learning model in the sample. These top-K lists are used to extract information from the pages of the cluster from which the sample of pages was taken.

摘要翻译： 一种通过应用机器学习技术和利用文档之间的结构相似性自动从大量文档中提取信息的方法和装置。 训练机器学习模型至少有50％的准确性。 训练有素的机器学习模型用于识别来自结构类似文档的集群的页面样本中的信息属性。 通过编译样本中经过训练的机器学习模型识别的每个属性的顶部K位置的列表来创建集群的结构特定模型。 这些顶级K列表用于从从中获取页面样本的群集页面中提取信息。

公开(公告)号：US20090216739A1

公开(公告)日：2009-08-27

申请号：US12036079

申请日：2008-02-22

申请人： Alok S. Kirpal ,  Meghana Kshirsagar

发明人： Alok S. Kirpal ,  Meghana Kshirsagar

IPC分类号： G06F7/10 ,  G06F17/30

CPC分类号： G06F16/313

摘要： Methods and apparatus are described for use with information extraction techniques based on sequential models. Additional statistics are maintained during inference and employed to boost the accuracy of the extraction algorithm and mitigate the effects of training bias.

摘要翻译： 描述了基于顺序模型的信息提取技术的方法和装置。 在推理过程中，维持其他统计数据，用于提高算法的准确性，减轻训练偏差的影响。

公开(公告)号：US20110087646A1

公开(公告)日：2011-04-14

申请号：US12576011

申请日：2009-10-08

申请人： Nilesh Dalvi ,  Raghu Ramakrishnan ,  Vinay Kakade ,  Arup Kumar Choudhury ,  Sathiya Keerthi Selvaraj ,  Philip Bohannon ,  Mani Abrol ,  David Ciemiewicz ,  Arun Shankar Iyer ,  Vipul Agarwal ,  Alok S. Kirpal

发明人： Nilesh Dalvi ,  Raghu Ramakrishnan ,  Vinay Kakade ,  Arup Kumar Choudhury ,  Sathiya Keerthi Selvaraj ,  Philip Bohannon ,  Mani Abrol ,  David Ciemiewicz ,  Arun Shankar Iyer ,  Vipul Agarwal ,  Alok S. Kirpal

IPC分类号： G06F7/10 ,  G06F17/30

CPC分类号： G06F17/30864

摘要： Techniques are provided for the efficient location, processing, and retrieval of local product information derived from web pages generally locatable through form queries submitted to web pages often referred to as the “deep” or “hidden” web. In an embodiment, information such as product information and dealer-location information is located on a web page form such as a dealer-locator form. After location of a suitable web page form, editorial wrapping is performed to create an automated information extraction process. Using the automated information extractor, deep-web crawling is performed. A grid-based extraction of individual business records is performed, and matching and ingestion are performed in conjunction with a business listing database. Finally, metadata tags are added to entries in the business listing database. Metadata tags also may be added to entries in other databases.

摘要翻译： 提供技术用于从通常通过提交到通常被称为“深”或“隐藏”网络的网页的表单查询的定位的网页获得的本地产品信息的有效定位，处理和检索。 在一个实施例中，诸如产品信息和经销商位置信息的信息位于诸如经销商定位器形式的网页形式上。 在找到合适的网页表单之后，执行编辑包装以创建自动化信息提取过程。 使用自动信息提取器，执行深度网页抓取。 执行单个业务记录的基于网格的提取，并且与业务列表数据库一起执行匹配和摄取。 最后，元数据标签被添加到业务列表数据库中的条目。 元数据标签也可以添加到其他数据库中的条目。

公开(公告)号：US08793239B2

公开(公告)日：2014-07-29

申请号：US12576011

申请日：2009-10-08

申请人： Nilesh Dalvi ,  Raghu Ramakrishnan ,  Vinay Kakade ,  Arup Kumar Choudhury ,  Sathiya Keerthi Selvaraj ,  Philip Bohannon ,  Mani Abrol ,  David Ciemiewicz ,  Arun Shankar Iyer ,  Vipul Agarwal ,  Alok S. Kirpal

发明人： Nilesh Dalvi ,  Raghu Ramakrishnan ,  Vinay Kakade ,  Arup Kumar Choudhury ,  Sathiya Keerthi Selvaraj ,  Philip Bohannon ,  Mani Abrol ,  David Ciemiewicz ,  Arun Shankar Iyer ,  Vipul Agarwal ,  Alok S. Kirpal

IPC分类号： G06F17/30 ,  G06F7/00

CPC分类号： G06F17/30864

摘要： Techniques are provided for the efficient location, processing, and retrieval of local product information derived from web pages generally locatable through form queries submitted to web pages often referred to as the “deep” or “hidden” web. In an embodiment, information such as product information and dealer-location information is located on a web page form such as a dealer-locator form. After location of a suitable web page form, editorial wrapping is performed to create an automated information extraction process. Using the automated information extractor, deep-web crawling is performed. A grid-based extraction of individual business records is performed, and matching and ingestion are performed in conjunction with a business listing database. Finally, metadata tags are added to entries in the business listing database. Metadata tags also may be added to entries in other databases.

摘要翻译： 提供了技术，用于有效地定位，处理和检索从通常可通过提交到通常被称为“深”或“隐藏”网络的网页的表单查询的网页获得的本地产品信息。 在一个实施例中，诸如产品信息和经销商位置信息的信息位于诸如经销商定位器形式的网页形式上。 在找到合适的网页表单之后，执行编辑包装以创建自动化信息提取过程。 使用自动信息提取器，执行深度网页抓取。 执行单个业务记录的基于网格的提取，并且与业务列表数据库一起执行匹配和摄取。 最后，元数据标签被添加到业务列表数据库中的条目。 元数据标签也可以添加到其他数据库中的条目。

公开(公告)号：US20100241639A1

公开(公告)日：2010-09-23

申请号：US12408450

申请日：2009-03-20

申请人： Daniel Kifer ,  Srujana Merugu ,  Ankur Jain ,  Sathiya Keerthi Selvaraj ,  Alok S. Kirpal ,  Philip L. Bohannon ,  Raghu Ramakrishnan

发明人： Daniel Kifer ,  Srujana Merugu ,  Ankur Jain ,  Sathiya Keerthi Selvaraj ,  Alok S. Kirpal ,  Philip L. Bohannon ,  Raghu Ramakrishnan

IPC分类号： G06F17/30

CPC分类号： G06F16/345 ,  G06F16/313

摘要： Disclosed are methods and apparatus for extracting (or annotating) structured information from web content. Web content of interest from a particular domain is represented as one or more tree instances having a plurality of branching nodes that each correspond to a web object such that the tree instances correspond to one or more structured data instances. The particular domain is associated with domain knowledge that includes one or more presentation rulesets that each specifies a particular structure for a set of data instances, a domain-specific concept labeler, one or more specified properties of the web objects in the tree instances, and a concept schema that specifies a representation of the data to be extracted from the web content. A structured data instance that conforms to the concept schema is extracted from the one or more tree instances based on the domain knowledge for the particular domain. Extraction of the structured data instances is accomplished by (i) using the domain-specific concept labeler to annotate a subset of nodes of the tree instances; and (ii) using a locally adaptive concept annotator to extract the structured data instances based on the annotated segments and the local properties associated with such annotated segments. The extracted structured data instance is stored as structured output records in a database.

摘要翻译： 公开了从网页内容中提取（或注释）结构化信息的方法和装置。 来自特定域的感兴趣的Web内容被表示为具有多个分支节点的一个或多个树实例，每个分支节点对应于web对象，使得树实例对应于一个或多个结构化数据实例。 特定域与域知识相关联，其包括一个或多个呈现规则集，每个表示规则集指定一组数据实例的特定结构，特定于域的概念标签器，树实例中的web对象的一个​​或多个指定的属性，以及 一个概念模式，指定要从Web内容中提取的数据的表示。 基于特定域的域知识，从一个或多个树实例提取符合概念模式的结构化数据实例。 结构化数据实例的提取是通过（i）使用域特定概念标签器来注释树实例的节点的子集来实现的; 以及（ii）使用本地适应性概念注释器基于所注释的段和与这些注释段相关联的本地属性来提取结构化数据实例。 提取的结构化数据实例作为结构化输出记录存储在数据库中。

公开(公告)号：US20090182759A1

公开(公告)日：2009-07-16

申请号：US12013289

申请日：2008-01-11

申请人： Alok S. Kirpal

发明人： Alok S. Kirpal

IPC分类号： G06F17/30

CPC分类号： G06F16/951

摘要： A method for extracting entities from a web page includes first applying a high precision low recall (HPLR) technique on a first web page, producing one or more entities extracted from the first web page. Then a sequential model is trained using the one or more entities extracted from the first web page. The sequential model is then performed on a second web page, producing one or more entities extracted from the second web page.

摘要翻译： 用于从网页提取实体的方法包括首先在第一网页上应用高精度低回调（HPLR）技术，产生从第一网页提取的一个或多个实体。 然后使用从第一网页提取的一个或多个实体来训练顺序模型。 随后在第二网页上执行顺序模型，产生从第二网页提取的一个或多个实体。

公开(公告)号：US20090240638A1

公开(公告)日：2009-09-24

申请号：US12051729

申请日：2008-03-19

申请人： Alok S. Kirpal ,  Krishna Lecla Poola ,  Kirshna Prasad Chitrapura

发明人： Alok S. Kirpal ,  Krishna Lecla Poola ,  Kirshna Prasad Chitrapura

IPC分类号： G06F17/30 ,  G06F15/18

CPC分类号： G06F16/9566 ,  G06F16/36

摘要： Subject matter disclosed herein may relate to analyses of uniform resource identifiers associated with web pages, and further may relate to gathering information about web pages by analyzing the uniform resource identifiers.

摘要翻译： 本文公开的主题涉及与网页相关联的统一资源标识符的分析，并且还可以涉及通过分析统一资源标识符来收集关于网页的信息。