-
公开(公告)号:US20240036728A1
公开(公告)日:2024-02-01
申请号:US18485847
申请日:2023-10-12
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Hua XU , Xiaoming BAO , Hongwei SUN , Yihai ZHENG , Chun LIU
IPC: G06F3/06
CPC classification number: G06F3/0608 , G06F3/067 , G06F3/0644 , G06F3/064
Abstract: Methods and apparatuses for processing data are provided. In an implementation, a method comprising: obtaining, by a reduction server of a plurality of reduction servers in a distributed processing system and from a first storage area, metadata of first data to be read, wherein the first data comprises a target data block in a plurality of data blocks of second data, and wherein the second data comprises a processing result of a mapping server of a plurality of mapping servers for input data, determining a first address of the first data in a global memory based on the metadata, wherein the global memory comprises memories of the plurality of mapping servers and the plurality of reduction servers, and reading the first data from the global memory based on the first address.