公开(公告)号：US20250130726A1

公开(公告)日：2025-04-24

申请号：US19000111

申请日：2024-12-23

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Hua XU ,  Xiaoming BAO ,  Ce ZHU ,  Hongwei SUN ,  Xinglong WANG

IPC: G06F3/06

Abstract: Example data processing methods and apparatus are described. In one example method, a control node estimates a data volume of result data obtained after a plurality of second computing nodes execute a data processing task in parallel. The control node determines a quantity of reduce tasks based on the data volume and memory information of a first computing node that executes a reduce task. Each of the plurality of second computing nodes partitions, based on the quantity of reduced tasks, the result data generated after the data processing task is executed, where each partition corresponds to one reduce task. The first computing node performs reduce processing on data obtained after partitioning is performed by the plurality of second computing nodes.