公开(公告)号：US20230376545A1

公开(公告)日：2023-11-23

申请号：US18027039

申请日：2022-03-07

Applicant: BEIJING BAIDU NETCOM SCIENCE TECHNOLOGY CO., LTD.

Inventor： Yu Ding ,  Liang Hong

IPC: G06F16/951 ,  G06F16/955

CPC classification number: G06F16/951 ,  G06F16/955

Abstract: The present invention relates to a method and an apparatus for controlling scraping pressure. The method includes: matching a website to be scraped to a pre-configured pressure unit based on a URL of the website to be scraped; determining a first scraping pressure limit and a second scraping pressure limit based on historical scraping data of the pressure unit; and controlling the scraping pressure of the pressure unit within a current scraping period based on the first scraping pressure limit and the second scraping pressure limit.