利索-全球专利检索

  1. 登录
  2. 注册
发明授权
CN109063053B 一种网站站点地图自动重构的方法及系统 有权

一种网站站点地图自动重构的方法及系统
摘要：
本发明提供了一种网站站点地图自动重构的方法，该方法具体包括以下步骤：S1、网站网页采集；S2、对每个采集到的网页，进行数字化标识提取，得到每个网页的唯一数字标识DOM_ID，并以键值对 的方式保存进行归类保存，得到网站网页信息集合MAP；S3、对网站网页信息集合MAP利用判定规则进行统计分析，确定网站的栏目对象列表COLUMNs；S4、对步骤S3确定的栏目对象列表COLUMNs，通过栏目的上下级关系来重构栏目树，得到完整的站点地图。另外，本发明还提供了一种网站站点地图自动重构的系统。通过本发明的技术方案自动构建网站的站点地图，能够使得爬虫能够对网站重点栏目页进行及时全面的采集，从而用更少的资源采集更多的文章，提高网站的SEO友好性，为网站带来更多用户。
摘要（英）：

The invention provides a method for automatically reconstructing a website site map. The method specifically comprises the following steps: S1, collecting website page; S2, extracting the digital identifier from each collected web page to obtain the unique digital identifier DOM_ID of each web page, and storing the unique digital identifier DOM_ID: PAGEs in a key value pair mode to classify and save the unique digital identifier DOM_ID: PAGEs to obtain the web page information set MAP of the web site; 3, statistically analyze that MAP of the web page information set of the web site by using the judgment rule, and determining the column object list COLUMNs of the web site; S4, for the column object list COLUMNs determined in the step S3, the column tree is reconstructed through the column hierarchical relationship to obtain a complete site map. In addition, the invention also provides a system for automatically reconstructing a website site map. Through the technical proposal of the invention, the site map of the website is automatically constructed, so that the crawler can collect the key column pages of the website in time and comprehensively, so as to collect more articles with fewer resources, improve the SEO friendliness of the website and bring more users to the website.

公开/授权文献
0/0