公开(公告)号：US20180352024A1

公开(公告)日：2018-12-06

申请号：US15612747

申请日：2017-06-02

Applicant: Futurewei Technologies, Inc.

Inventor： Demai Ni ,  Mingyi Zhang ,  Le Cai

IPC: H04L29/08

Abstract: A system (and associated method) includes a processor which determines a performance metric ratio of a performance metric of a second type of server relative to a performance metric of a first server type for each of multiple sizes of multiple benchmark datasets to thereby determine a plurality of performance metric ratio values. The processor also determines an interpolation function for the plurality of performance metric ratio values usable to compute interpolation performance metric ratios of the second type of server relative to the first type of server for dataset sizes other than the first plurality of sizes. Given a second dataset, the processor determines an amount of the second dataset to provide to each of the respective server types using the interpolation function. The processor configures a load balancer based on the amount of the second dataset determined for each type of server.

公开(公告)号：US20180210916A1

公开(公告)日：2018-07-26

申请号：US15411713

申请日：2017-01-20

Applicant: Futurewei Technologies, Inc.

Inventor： Mingyi Zhang ,  Huaizhi Li ,  Yu Dong ,  Cheng Zhu

IPC: G06F17/30

Abstract: Embodiments of the present technology relate managing database query concurrency. A method of the present technology can include receiving a query, generating a first query plan that can be used to execute the query in system memory without any system memory constraints, and estimating a system memory cost for executing the query in the system memory using the first query plan. The method can also include placing the query in a queue if available system memory does not satisfy the estimated system memory cost. The method can further include conditionally selecting the query from the queue, conditionally generating a second query plan for the query that can be used to execute the query in the system memory in compliance with a system memory constraint, and conditionally executing the query in the system memory.

公开(公告)号：US11537615B2

公开(公告)日：2022-12-27

申请号：US15959442

申请日：2018-04-23

Applicant: Futurewei Technologies, Inc.

Inventor： Lei Liu ,  Mingyi Zhang ,  Yu Dong ,  Huaizhi Li ,  Yantao Qiao

IPC: G06F16/00 ,  G06F7/00 ,  G06F16/2453 ,  G06F17/16 ,  G06N5/04 ,  G06N20/00 ,  G06F16/28 ,  G06N20/10

Abstract: Methods and apparatus are provided for using machine learning to estimate query resource consumption in a massively parallel processing database (MPPDB). In various embodiments, the machine learning may jointly perform query resource consumption estimation for a query and resource extreme events detection together, utilize an adaptive kernel that is configured to learn most optimal similarity relation metric for data from each system settings, and utilize multi-level stacking technology configured to leverage outputs of diverse base classifier models. Advantages and benefits of the disclosed embodiments include providing faster and more reliable system performance and avoiding resource issues such as out of memory (OOM) occurrences.

公开(公告)号：US20220004551A1

公开(公告)日：2022-01-06

申请号：US17446679

申请日：2021-09-01

Applicant: Futurewei Technologies, Inc.

Inventor： Ahmad Ghazal ,  Ron-Chung Hu ,  Mingyi Zhang

IPC: G06F16/242 ,  G06F16/2455 ,  G06F16/22

Abstract: A query processing device includes a communication interface accessing a database and database catalog, a memory storing instructions, and a processor coupled to the memory and the communication interface. The processor executes the instructions to parse a query and generate first and second execution plans for the query, retrieve respective previously determined cardinality values for previously executed logical steps of the first and second execution plans from the database catalog, select an execution plan from the first execution plan or the second execution plan, the selected execution plan having a lower cost based on the previously determined cardinality values, and execute the selected execution plan on data accessed from the database. The query processing system stores actual cardinality values determined during the execution of the logical steps in the database catalog for use by subsequent queries. The query processing device, therefore, re-uses previously determined cardinality values.

公开(公告)号：US20180314735A1

公开(公告)日：2018-11-01

申请号：US15959442

申请日：2018-04-23

Applicant: Futurewei Technologies, Inc.

Inventor： Lei Liu ,  Mingyi Zhang ,  Yu Dong ,  Huaizhi Li ,  Yantao Qiao

IPC: G06F17/30 ,  G06F17/16 ,  G06N99/00 ,  G06N5/04

Abstract: Methods and apparatus are provided for using machine learning to estimate query resource consumption in a massively parallel processing database (MPPDB). In various embodiments, the machine learning may jointly perform query resource consumption estimation for a query and resource extreme events detection together, utilize an adaptive kernel that is configured to learn most optimal similarity relation metric for data from each system settings, and utilize multi-level stacking technology configured to leverage outputs of diverse base classifier models. Advantages and benefits of the disclosed embodiments include providing faster and more reliable system performance and avoiding resource issues such as out of memory (OOM) occurrences.

公开(公告)号：US11940997B2

公开(公告)日：2024-03-26

申请号：US17446679

申请日：2021-09-01

Applicant: Futurewei Technologies, Inc.

Inventor： Ahmad Ghazal ,  Ron-Chung Hu ,  Mingyi Zhang

IPC: G06F16/24 ,  G06F16/22 ,  G06F16/242 ,  G06F16/2455

CPC classification number: G06F16/2433 ,  G06F16/2255 ,  G06F16/2455

Abstract: A query processing device includes a communication interface accessing a database and database catalog, a memory storing instructions, and a processor coupled to the memory and the communication interface. The processor executes the instructions to parse a query and generate first and second execution plans for the query, retrieve respective previously determined cardinality values for previously executed logical steps of the first and second execution plans from the database catalog, select an execution plan from the first execution plan or the second execution plan, the selected execution plan having a lower cost based on the previously determined cardinality values, and execute the selected execution plan on data accessed from the database. The query processing system stores actual cardinality values determined during the execution of the logical steps in the database catalog for use by subsequent queries. The query processing device, therefore, re-uses previously determined cardinality values.

公开(公告)号：US10740332B2

公开(公告)日：2020-08-11

申请号：US15411713

申请日：2017-01-20

Applicant: Futurewei Technologies, Inc.

Inventor： Mingyi Zhang ,  Huaizhi Li ,  Yu Dong ,  Cheng Zhu

IPC: G06F16/2453 ,  G06F16/2455

Abstract: Embodiments of the present technology relate managing database query concurrency. A method of the present technology can include receiving a query, generating a first query plan that can be used to execute the query in system memory without any system memory constraints, and estimating a system memory cost for executing the query in the system memory using the first query plan. The method can also include placing the query in a queue if available system memory does not satisfy the estimated system memory cost. The method can further include conditionally selecting the query from the queue, conditionally generating a second query plan for the query that can be used to execute the query in the system memory in compliance with a system memory constraint, and conditionally executing the query in the system memory.