-
公开(公告)号:US20240036728A1
公开(公告)日:2024-02-01
申请号:US18485847
申请日:2023-10-12
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Hua XU , Xiaoming BAO , Hongwei SUN , Yihai ZHENG , Chun LIU
IPC: G06F3/06
CPC classification number: G06F3/0608 , G06F3/067 , G06F3/0644 , G06F3/064
Abstract: Methods and apparatuses for processing data are provided. In an implementation, a method comprising: obtaining, by a reduction server of a plurality of reduction servers in a distributed processing system and from a first storage area, metadata of first data to be read, wherein the first data comprises a target data block in a plurality of data blocks of second data, and wherein the second data comprises a processing result of a mapping server of a plurality of mapping servers for input data, determining a first address of the first data in a global memory based on the metadata, wherein the global memory comprises memories of the plurality of mapping servers and the plurality of reduction servers, and reading the first data from the global memory based on the first address.
-
2.
公开(公告)号:US20220286409A1
公开(公告)日:2022-09-08
申请号:US17747234
申请日:2022-05-18
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Keyong SUN , Lei XIAO , Hongwei SUN
IPC: H04L47/80 , H04L41/0823 , H04L49/00 , H04L47/2425
Abstract: This application provides a method and apparatus for configuring a quality of service policy for a service, and a computing device, and belongs to the field of network communications technologies. The method includes: obtaining a first data flow forwarded by a virtual switch; determining service information of the first data flow, where the service information includes a service type of the first data flow and an access path of the first data flow; determining, based on the service information of the first data flow, a quality of service QoS policy matching the first data flow; and configuring devices on the access path based on the matched QoS policy. According to this application, efficiency of configuring a quality of service policy for a service can be improved.
-
公开(公告)号:US20250130726A1
公开(公告)日:2025-04-24
申请号:US19000111
申请日:2024-12-23
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Hua XU , Xiaoming BAO , Ce ZHU , Hongwei SUN , Xinglong WANG
IPC: G06F3/06
Abstract: Example data processing methods and apparatus are described. In one example method, a control node estimates a data volume of result data obtained after a plurality of second computing nodes execute a data processing task in parallel. The control node determines a quantity of reduce tasks based on the data volume and memory information of a first computing node that executes a reduce task. Each of the plurality of second computing nodes partitions, based on the quantity of reduced tasks, the result data generated after the data processing task is executed, where each partition corresponds to one reduce task. The first computing node performs reduce processing on data obtained after partitioning is performed by the plurality of second computing nodes.
-
公开(公告)号:US20240241826A1
公开(公告)日:2024-07-18
申请号:US18618572
申请日:2024-03-27
Applicant: HUAWEI TECHNOLOGIES CO., LTD.
Inventor: Xiuqiao LI , Xiaogang PAN , Qiang CHEN , Shuai GAO , Hongwei SUN
IPC: G06F12/0802
CPC classification number: G06F12/0802 , G06F2212/60
Abstract: A computing node cluster provided in this embodiment of this application includes a plurality of computing nodes, and the plurality of computing nodes include an aggregation computing node. The plurality of computing nodes are configured to jointly perform a write operation on to-be-written data. Each of the plurality of computing nodes is configured to return a write success after writing partial data in the to-be-written data to a local cache. The aggregation computing node is configured to aggregate the partial data stored in caches of the plurality of computing nodes into aggregated data with consecutive addresses, and write the aggregated data into a storage node.
-
-
-