Invention Grant
- Patent Title: Task processing method and distributed computing framework
-
Application No.: US16352678Application Date: 2019-03-13
-
Publication No.: US11709894B2Publication Date: 2023-07-25
- Inventor: Yuncong Zhang , Xiang Wen , Hua Chai , Cong Wang , Guanyin Zhu
- Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
- Applicant Address: CN Beijing
- Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
- Current Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
- Current Assignee Address: CN Beijing
- Agency: Knobbe, Martens, Olson & Bear LLP
- Priority: CN 1610873646.X 2016.09.30
- Main IPC: G06F16/903
- IPC: G06F16/903 ; G06F16/2455 ; G06F16/2452 ; G06F40/205 ; G06F16/182 ; G06F16/9032 ; G06F16/9035 ; G06F16/901 ; G06F9/50

Abstract:
The present disclosure discloses a task processing method and a distributed computing framework. A specific embodiment of the method includes: parsing an expression corresponding to a distributed computing task, and constructing task description information corresponding to the distributed computing task, the task description information being used to describe a corresponding relationship between an operator and a distributed dataset, and the operator acting on at least one of the distributed dataset or distributed datasets obtained by grouping the distributed dataset; determining, based on the task description information, a distributed dataset the operator acting on; and performing distributed computing on the distributed dataset the operator acting on using the operator. In the distributed computing, the acting scope and nesting relationship of the operator is described by constructing a topology.
Public/Granted literature
- US20190213217A1 TASK PROCESSING METHOD AND DISTRIBUTED COMPUTING FRAMEWORK Public/Granted day:2019-07-11
Information query