-
公开(公告)号:US10805241B2
公开(公告)日:2020-10-13
申请号:US15408206
申请日:2017-01-17
Applicant: Futurewei Technologies, Inc.
Inventor: Yu Dong , Qingqing Zhou , Guogen Zhang
IPC: H04L12/931 , H04L29/08 , G06F16/25
Abstract: A computer-implemented method and system are provided, including executing an application programming interface (API) in a network switch to define at least one of one or more database functions, performing, using one or more processors, the one or more database functions on at least a portion of data contained in a data message received at the switch, to generate result data, and routing the result data to one or more destination nodes. A database function-defined network switch includes a network switch and one or more processors to perform a pre-defined database function on query data contained in data messages received at the switch, to produce result data, wherein the pre-defined database function is performed on the query data in a first mode of operation to a state of full completion, generating complete result data and no skipped query data, or to a state of partial completion, generating partially completed result data and skipped query data.
-
公开(公告)号:US11537615B2
公开(公告)日:2022-12-27
申请号:US15959442
申请日:2018-04-23
Applicant: Futurewei Technologies, Inc.
Inventor: Lei Liu , Mingyi Zhang , Yu Dong , Huaizhi Li , Yantao Qiao
Abstract: Methods and apparatus are provided for using machine learning to estimate query resource consumption in a massively parallel processing database (MPPDB). In various embodiments, the machine learning may jointly perform query resource consumption estimation for a query and resource extreme events detection together, utilize an adaptive kernel that is configured to learn most optimal similarity relation metric for data from each system settings, and utilize multi-level stacking technology configured to leverage outputs of diverse base classifier models. Advantages and benefits of the disclosed embodiments include providing faster and more reliable system performance and avoiding resource issues such as out of memory (OOM) occurrences.
-
公开(公告)号:US20180314735A1
公开(公告)日:2018-11-01
申请号:US15959442
申请日:2018-04-23
Applicant: Futurewei Technologies, Inc.
Inventor: Lei Liu , Mingyi Zhang , Yu Dong , Huaizhi Li , Yantao Qiao
Abstract: Methods and apparatus are provided for using machine learning to estimate query resource consumption in a massively parallel processing database (MPPDB). In various embodiments, the machine learning may jointly perform query resource consumption estimation for a query and resource extreme events detection together, utilize an adaptive kernel that is configured to learn most optimal similarity relation metric for data from each system settings, and utilize multi-level stacking technology configured to leverage outputs of diverse base classifier models. Advantages and benefits of the disclosed embodiments include providing faster and more reliable system performance and avoiding resource issues such as out of memory (OOM) occurrences.
-
公开(公告)号:US10740332B2
公开(公告)日:2020-08-11
申请号:US15411713
申请日:2017-01-20
Applicant: Futurewei Technologies, Inc.
Inventor: Mingyi Zhang , Huaizhi Li , Yu Dong , Cheng Zhu
IPC: G06F16/2453 , G06F16/2455
Abstract: Embodiments of the present technology relate managing database query concurrency. A method of the present technology can include receiving a query, generating a first query plan that can be used to execute the query in system memory without any system memory constraints, and estimating a system memory cost for executing the query in the system memory using the first query plan. The method can also include placing the query in a queue if available system memory does not satisfy the estimated system memory cost. The method can further include conditionally selecting the query from the queue, conditionally generating a second query plan for the query that can be used to execute the query in the system memory in compliance with a system memory constraint, and conditionally executing the query in the system memory.
-
公开(公告)号:US10360267B2
公开(公告)日:2019-07-23
申请号:US14736050
申请日:2015-06-10
Applicant: Futurewei Technologies, Inc.
Inventor: Yu Dong , Qingqing Zhou , Guogen Zhang
IPC: G06F17/30 , G06F16/951 , H04L29/08 , G06F16/27 , G06F16/21
Abstract: Data messages having different priorities may be stored in different communication buffers of a network node. The data messages may then be forwarded from the communication buffers to working buffers as space becomes available in the working buffers. After being forwarded to the working buffers, the data messages may be available to be processed by upper-layer operations of the network node. Priorities may be assigned to the data messages based on a priority level of a query associated with the data messages, a priority level of an upper-layer operation assigned to process the data messages, or combinations thereof.
-
公开(公告)号:US20180203895A1
公开(公告)日:2018-07-19
申请号:US15408130
申请日:2017-01-17
Applicant: Futurewei Technologies, Inc.
Inventor: Yu Dong , Qingqing Zhou
IPC: G06F17/30
CPC classification number: G06F16/24524
Abstract: A computer-implemented method and system at a network switch provides using one or more processors to perform a pre-defined database function on query data contained in data messages received at the network switch, with the performing producing result data, and wherein the pre-defined database function is performed on the query data in a first mode of operation to a state of full completion, generating complete result data and no skipped query data, and in a second mode of operation to a state of partial completion, generating partially complete result data and skipped query data. Further, the method and system performing one or more network switch functions to route the complete result data, and/or route the partially complete result data and skipped query data, to one or more destination nodes. In addition, an application programming interface (API) is used to define the database function.
-
公开(公告)号:US20170270165A1
公开(公告)日:2017-09-21
申请号:US15071712
申请日:2016-03-16
Applicant: Futurewei Technologies, Inc.
Inventor: Yu Dong
CPC classification number: G06F16/24568 , H04L65/60
Abstract: A method comprises, by a first node on a first server in a massively parallel processing (MPP) database, selecting a second node on a second server in the MPP database. The first server further transmits data from the first node to the second node over a network. The method further comprises providing the data from the second node to other nodes on the second server.
-
公开(公告)号:US11080274B2
公开(公告)日:2021-08-03
申请号:US15408130
申请日:2017-01-17
Applicant: Futurewei Technologies, Inc.
Inventor: Yu Dong , Qingqing Zhou
IPC: G06F16/2452 , G06F16/2458 , H04L12/931
Abstract: A computer-implemented method and system at a network switch provides using one or more processors to perform a pre-defined database function on query data contained in data messages received at the network switch, with the performing producing result data, and wherein the pre-defined database function is performed on the query data in a first mode of operation to a state of full completion, generating complete result data and no skipped query data, and in a second mode of operation to a state of partial completion, generating partially complete result data and skipped query data. Further, the method and system performing one or more network switch functions to route the complete result data, and/or route the partially complete result data and skipped query data, to one or more destination nodes. In addition, an application programming interface (API) is used to define the database function.
-
公开(公告)号:US20180210916A1
公开(公告)日:2018-07-26
申请号:US15411713
申请日:2017-01-20
Applicant: Futurewei Technologies, Inc.
Inventor: Mingyi Zhang , Huaizhi Li , Yu Dong , Cheng Zhu
IPC: G06F17/30
Abstract: Embodiments of the present technology relate managing database query concurrency. A method of the present technology can include receiving a query, generating a first query plan that can be used to execute the query in system memory without any system memory constraints, and estimating a system memory cost for executing the query in the system memory using the first query plan. The method can also include placing the query in a queue if available system memory does not satisfy the estimated system memory cost. The method can further include conditionally selecting the query from the queue, conditionally generating a second query plan for the query that can be used to execute the query in the system memory in compliance with a system memory constraint, and conditionally executing the query in the system memory.
-
公开(公告)号:US20180205672A1
公开(公告)日:2018-07-19
申请号:US15408206
申请日:2017-01-17
Applicant: Futurewei Technologies, Inc.
Inventor: Yu Dong , Qingqing Zhou , Guogen Zhang
IPC: H04L12/931 , H04L29/08 , G06F17/30
Abstract: A computer-implemented method and system are provided, including executing an application programming interface (API) in a network switch to define at least one of one or more database functions, performing, using one or more processors, the one or more database functions on at least a portion of data contained in a data message received at the switch, to generate result data, and routing the result data to one or more destination nodes. A database function-defined network switch includes a network switch and one or more processors to perform a pre-defined database function on query data contained in data messages received at the switch, to produce result data, wherein the pre-defined database function is performed on the query data in a first mode of operation to a state of full completion, generating complete result data and no skipped query data, or to a state of partial completion, generating partially completed result data and skipped query data.
-
-
-
-
-
-
-
-
-