公开(公告)号：US20190213188A1

公开(公告)日：2019-07-11

申请号：US16352576

申请日：2019-03-13

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Jianwei ZHANG ,  Yuncong ZHANG ,  Cong WANG ,  Yao XU ,  Chunyang WEN ,  Xin HUANG ,  Zhan SONG ,  Guanyin ZHU

IPC: G06F16/2453 ,  G06F16/182 ,  G06F16/22 ,  G06F16/242 ,  G06F17/27

CPC classification number: G06F16/24537 ,  G06F9/5066 ,  G06F16/182 ,  G06F16/2228 ,  G06F16/243 ,  G06F17/2705

Abstract: A distributed computing framework and a distributed computing method are provided. A specific embodiment of the distributed computing framework includes: a parsing unit, configured to parse an expression of a distributed computing task, and determine an operator and a field corresponding to the operator; and an operator unit, configured to provide the operator, input parameters of the operator including: the field and a field-type distributed dataset. The type of parameters received and returned by any operator may be the field-type distributed dataset, and any operator may operate on the data corresponding to the field in the field-type distributed dataset. Therefore, any operator needs to be implemented once to realize the reuse of the operator. The distributed computing task is expressed in a simple expression, which simplifies the complexity of writing a distributed computing program with the distributed computing framework used by the user.

公开(公告)号：US20190213007A1

公开(公告)日：2019-07-11

申请号：US16293360

申请日：2019-03-05

Applicant: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.

Inventor： Yuncong ZHANG ,  Xiang WEN ,  Cong WANG ,  Hua CHAI ,  Yao XU

IPC: G06F9/30 ,  G06F17/27

CPC classification number: G06F16/27 ,  G06F9/5072

Abstract: A method and apparatus for executing a distributed computing task are provided. The method can include: parsing an expression of the distributed computing task to obtain an operator keyword; and executing, by using an operator corresponding to the operator keyword, the distributed computing task based on an input parameter of the operator, the input parameter of the operator including at least one of: a distributed stored distributed dataset including at least one data element, a distributed stored distributed key-value pair set including at least one key-value pair, and a value of the key-value pair in the distributed key-value pair set being a distributed dataset or a distributed key-value pair set.