公开(公告)号：US11709894B2

公开(公告)日：2023-07-25

申请号：US16352678

申请日：2019-03-13

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Yuncong Zhang ,  Xiang Wen ,  Hua Chai ,  Cong Wang ,  Guanyin Zhu

IPC: G06F16/903 ,  G06F16/2455 ,  G06F16/2452 ,  G06F40/205 ,  G06F16/182 ,  G06F16/9032 ,  G06F16/9035 ,  G06F16/901 ,  G06F9/50

CPC classification number: G06F16/90335 ,  G06F16/182 ,  G06F16/24524 ,  G06F16/24556 ,  G06F16/9027 ,  G06F16/9035 ,  G06F16/90332 ,  G06F40/205 ,  G06F9/5072

Abstract: The present disclosure discloses a task processing method and a distributed computing framework. A specific embodiment of the method includes: parsing an expression corresponding to a distributed computing task, and constructing task description information corresponding to the distributed computing task, the task description information being used to describe a corresponding relationship between an operator and a distributed dataset, and the operator acting on at least one of the distributed dataset or distributed datasets obtained by grouping the distributed dataset; determining, based on the task description information, a distributed dataset the operator acting on; and performing distributed computing on the distributed dataset the operator acting on using the operator. In the distributed computing, the acting scope and nesting relationship of the operator is described by constructing a topology.

公开(公告)号：US11379499B2

公开(公告)日：2022-07-05

申请号：US16293360

申请日：2019-03-05

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Yuncong Zhang ,  Xiang Wen ,  Cong Wang ,  Hua Chai ,  Yao Xu

IPC: G06F16/27

Abstract: A method and apparatus for executing a distributed computing task are provided. The method can include: parsing an expression of the distributed computing task to obtain an operator keyword; and executing, by using an operator corresponding to the operator keyword, the distributed computing task based on an input parameter of the operator, the input parameter of the operator including at least one of: a distributed stored distributed dataset including at least one data element, a distributed stored distributed key-value pair set including at least one key-value pair, and a value of the key-value pair in the distributed key-value pair set being a distributed dataset or a distributed key-value pair set.