公开(公告)号：US20170255496A1

公开(公告)日：2017-09-07

申请号：US15598696

申请日：2017-05-18

Applicant: Huawei Technologies Co., Ltd.

Inventor： Liqun Deng ,  Junhua Zhu

IPC: G06F9/50 ,  G06F9/48

CPC classification number: G06F9/5027 ,  G06F9/4881 ,  G06F9/5044

Abstract: A method for scheduling a data flow task and an apparatus. The method includes: preprocessing a data flow task to obtain at least one subtask; classifying the subtask into a central processing unit (CPU) task group, a graphics processing unit (GPU) task group, or a to-be-determined task group; allocating the subtask to a working node; when the subtask belongs to the CPU task group, determining that a CPU executes the subtask; when the subtask belongs to the GPU task group, determining that a GPU executes the subtask; or when the subtask belongs to the to-be-determined task group, determining, according to costs of executing the subtask by a CPU and a GPU, a running platform (e.g., the CPU or the GPU) executes the subtask, where the cost includes duration of executing the subtask.

公开(公告)号：US09678969B2

公开(公告)日：2017-06-13

申请号：US15241909

申请日：2016-08-19

Applicant: Huawei Technologies Co., Ltd.

Inventor： Liqun Deng ,  Junhua Zhu

IPC: G06F17/00 ,  G06F17/30 ,  G06F3/06

CPC classification number: G06F17/3012 ,  G06F3/061 ,  G06F3/0638 ,  G06F3/067 ,  G06F17/30091 ,  G06F17/30185 ,  G06F17/30194 ,  G06F17/30238

Abstract: A metadata updating method based on columnar storage in a distributed file system includes acquiring to-be-updated metadata in a data table, splitting data records of the data table into multiple row groups on a row basis, converting the data table into global file metadata and multiple row group files, where the row group file includes an actual data block, a data index block, a local metadata block, a metadata index block, and a file footer, determining whether the to-be-updated metadata belongs to the global file metadata, updating local metadata when the to-be-updated metadata does not belong to the global file metadata, and adding an updated local metadata block, an updated metadata index block, and an updated file footer to the multiple row group files according to updated local metadata. Dynamic updating of metadata saves time of executing an updating operation of this type and needed computing resources.