公开(公告)号：US20240220334A1

公开(公告)日：2024-07-04

申请号：US18604395

申请日：2024-03-13

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Hua XU ,  Xiaoming BAO ,  Chun LIU ,  Minjun ZHOU ,  Jiahuai CHEN

IPC: G06F9/50

CPC classification number: G06F9/5083 ,  G06F9/5016 ,  G06F9/5038

Abstract: A data processing method in a distributed system is provided. The method includes: A management node splits a to-be-processed data processing request into a map task and a reduce task. A first worker node executes the map task, and writes intermediate data obtained by executing the map task into a shared storage area. The intermediate data is divided into a plurality of partitions based on a quantity of second worker nodes. Each partition belongs to one second worker node. An aggregation node stores, in a centralized manner, intermediate data that belongs to a same partition in the shared storage area. The second worker node obtains intermediate data of a corresponding partition to execute the reduce task.

公开(公告)号：US20210157765A1

公开(公告)日：2021-05-27

申请号：US17165158

申请日：2021-02-02

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Mingjian QUE ,  Junjie WANG ,  Minjun ZHOU

IPC: G06F13/42 ,  G06F13/28 ,  G06F9/455

Abstract: A data processing method, including: obtaining, by a device in a server, a first I/O request sent by a virtual machine, where the device is connected to the server through a PCIe bus, the virtual machine runs on the server, the device provides a plurality of VFs for the server, the first I/O request is initiated by the virtual machine for any one VF of the plurality of VFs, the first I/O request includes a read operation or a write operation, the read operation is used to perform a data read operation on an I/O device in the server, the write operation is used to perform a data write operation on the I/O device in the server; and reading or writing, by the device, data from or into the I/O device in the server based on the first I/O request.

公开(公告)号：US20250117145A1

公开(公告)日：2025-04-10

申请号：US18990923

申请日：2024-12-20

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Xiaoming BAO ,  Hua XU ,  Chun LIU ,  Minjun ZHOU ,  Jiahuai CHEN

IPC: G06F3/06

Abstract: This disclosure provides data processing methods, apparatuses, and systems. In an implementation, a method comprises receiving, by a first data processing unit (DPU), a memory allocation request from a first service process in a computing node that comprises the first DPU, wherein the first DPU stores memory address assignment information that indicates a virtual memory address corresponding to a physical memory allocated by a storage node to the computing node. Determining, by the first DPU based on the memory address assignment information and in the virtual memory address corresponding to the physical memory allocated by the storage node to the computing node, a virtual memory address range assigned to the first service process, and when the first DPU receives a data storage request from the first service process, sending, by the first DPU, a write data request to the second DPU over a communication link between the first DPU and the second DPU.