-
公开(公告)号：US20220012243A1
公开(公告)日：2022-01-13
申请号：US17051014
申请日：2020-03-04
发明人： Hongbin MA , Yang LI , Qing HAN
IPC分类号： G06F16/2453 , G06F16/22 , G06F16/2455
摘要： The present application discloses a dynamic routing method and apparatus for a query engine in a pre-computing system. The method includes: pre-obtaining cube data under a preset dimensional combination in a pre-computing system; determining a degree of aggregation of the cube data selected as expected under the preset dimensional combination after a query request is received; executing query processing on the query request in a first distributed query engine when the degree of aggregation of the cube data under the preset dimensional combination is high; and switching to a second distributed query engine to execute query processing on the query request when the degree of aggregation of the cube data under the preset dimensional combination is low. The present application solves the technical problem that the query response speed of the pre-computing query system is not ideal. Through the present application, the sub-second high-performance query response can be achieved. At the same time, as a result, higher concurrency can be supported so as to meet business needs, and the stability of the query system is simultaneously guaranteed.
-
公开(公告)号：US11281698B2
公开(公告)日：2022-03-22
申请号：US17051008
申请日：2020-03-04
发明人： Yifan Zhang , Yifei Wu , Yang Li , Qing Han
IPC分类号： G06F16/28 , G06F11/34 , G06F16/2453
摘要： The present application discloses a data configuration query method and device. The method includes: determining at least two target data sets required to be queried by a query instruction and an ordered association between the target data sets, wherein the ordered association at least includes a unidirectional association and/or a bidirectional association; generating, on the basis of the at least two target data sets and the ordered association between the target data sets, a target association path; and outputting an OLAP model conforming to the target association path in a database. According to the present application, the technical problems of a large demand quantity of OLAP models included in an OLAP query system and a low utilization rate of the OLAP models in the related art can be solved.
-
公开(公告)号：US20240028604A1
公开(公告)日：2024-01-25
申请号：US17615551
申请日：2021-01-29
发明人： Shaoxiong ZHAN , Yang LI , Qing HAN
IPC分类号： G06F16/25 , G06F16/172 , G06F16/14
CPC分类号： G06F16/254 , G06F16/172 , G06F16/148
摘要： The disclosure provides a cloud computing-based adaptive storage layering system and method. The system includes a data node management module, a metadata management module, an adaptive storage layering module, and a pre-aggregated query routing module. According to predefined rules, node capacity is expanded and shrunk, collected queried hit models and scanned file paths are aggregated and sorted, and layering loading and pre-loading are performed on files. Based on the disclosure, an efficient On-Line Analytical Processing (OLAP) query execution engine may be constructed, to deal with complex OLAP queries of various reporting system. Therefore, the execution efficiency of cloud OLAP engines can be significantly enhanced.
-
公开(公告)号：US20230306027A1
公开(公告)日：2023-09-28
申请号：US18021563
申请日：2022-03-29
发明人： Biaobiao Sun , Yang Li , Qing Han
IPC分类号： G06F16/2453 , G06F16/951 , G06F16/9532
CPC分类号： G06F16/24545 , G06F16/951 , G06F16/9532
摘要： A method includes: acquiring unit computation cost and unit storage cost of a currently used cloud computation server in unit time; acquiring all historical query statements of a target user, extracting common characteristics of all the historical query statements, and determining query indexes corresponding to the historical query statements according to the common characteristics; determining query cost of each query index according to the frequency and time of querying a database through the query index and the used computation resources; determining a plurality of current query indexes corresponding to the current query statement based on the acquired current query statement of the target user; determining the total cost corresponding to each current query index according to the plurality of current query indexes through the unit computation cost, the unit storage cost, and the computation resource usage amount and usage time; and recommending a target query index to the target user.
-
公开(公告)号：US20230153299A1
公开(公告)日：2023-05-18
申请号：US18092329
申请日：2023-01-01
IPC分类号： G06F16/2453 , G06F16/28 , G06F11/34
CPC分类号： G06F16/2453 , G06F16/283 , G06F11/3419
摘要： This application discloses a precomputation method and apparatus for continuous iterative optimization. The precomputation method for continuous iterative optimization includes: determining a query task corresponding to each of a plurality of time periods; and continuously performing multiple rounds of optimization on a precomputation model according to the query task corresponding to each time period. According to this application, the precomputation model is continuously optimized, so that the performance of the precomputation model is improved. Therefore, the technical problem of poor performance caused by long-term non-tuning of the precomputation model can be avoided.
-
公开(公告)号：US20230153298A1
公开(公告)日：2023-05-18
申请号：US18092330
申请日：2023-01-01
发明人： He LIU , Wenzheng LIU , Yang LI , Qing HAN
IPC分类号： G06F16/242 , G06F16/2453 , G06F16/2458 , G06F16/28
CPC分类号： G06F16/244 , G06F16/24542 , G06F16/2471 , G06F16/283
摘要： The present invention discloses a data query method, device and equipment and a storage medium. A data query method comprises the following steps: receiving an MDX query statement; acquiring related information of measurement and dimension in the MDX query statement; and performing query according to the related information of measurement and dimension to obtain a query result. According to the present invention, an MDX expression is computed by extracting the related information of measurement and dimension and utilizing a distributed computing framework, so that the data analysis efficiency is greatly improved.
-
公开(公告)号：US20230146136A1
公开(公告)日：2023-05-11
申请号：US18092327
申请日：2023-01-01
IPC分类号： G06F16/2453 , G06F16/28 , G06F11/34
CPC分类号： G06F16/2453 , G06F11/3419 , G06F16/283
摘要： This application discloses a method and apparatus for scoring a precomputation model, a device, and a storage medium. The method includes: calculating, in a plurality of precomputation models, a score when each precomputation model executes a same query load; determining the precomputation model with the largest score as a target precomputation model according to the score of each precomputation model; and using the target precomputation model for query calculation. According to this application, the precomputation model may be quantitatively scored, so that horizontal comparison is conveniently performed when different precomputation models execute query tasks of the same load. Therefore, a user can conveniently select different precomputation models for query calculation.
-
公开(公告)号：US20230017300A1
公开(公告)日：2023-01-19
申请号：US17621205
申请日：2021-01-29
发明人： Wenzheng LIU , Dong LI , Yang LI , Qing HAN
IPC分类号： G06F16/25 , G06F16/2455 , G06F16/2453
摘要： The query method and device suitable for an On-Line Analytical Processing (OLAP) query engine includes a client agent module, a query pattern matching module, a query distributed execution module, and a pre-aggregation module. The query pattern matching module is configured to obtain an MDX query request received by an OLAP query engine and process the MDX query request to generate at least one set of aggregation query sets. The one set of aggregation query sets includes a plurality of aggregation query requests. The query distributed execution module is configured to perform concurrent processing on the plurality of aggregation query requests. The aggregation query requests are arranged corresponding to the aggregation query results. An efficient OLAP query execution engine can deal with complex OLAP queries of various reporting system. Therefore, the execution efficiency of MDX query can be significantly enhanced, and analysis requests of the reporting systems are rapidly responded.
-
公开(公告)号：US12130831B2
公开(公告)日：2024-10-29
申请号：US17615551
申请日：2021-01-29
发明人： Shaoxiong Zhan , Yang Li , Qing Han
IPC分类号： G06F17/00 , G06F16/14 , G06F16/172 , G06F16/25
CPC分类号： G06F16/254 , G06F16/148 , G06F16/172
摘要： The disclosure provides a cloud computing-based adaptive storage layering system and method. The system includes a data node management module, a metadata management module, an adaptive storage layering module, and a pre-aggregated query routing module. According to predefined rules, node capacity is expanded and shrunk, collected queried hit models and scanned file paths are aggregated and sorted, and layering loading and pre-loading are performed on files. Based on the disclosure, an efficient On-Line Analytical Processing (OLAP) query execution engine may be constructed, to deal with complex OLAP queries of various reporting system. Therefore, the execution efficiency of cloud OLAP engines can be significantly enhanced.
-
10.发明公开公开(公告)号：US20230359647A1
公开(公告)日：2023-11-09
申请号：US17611183
申请日：2021-03-01
发明人： Shaoxiong ZHAN , Jinghua FENG , Rongchuan JIN , Yang LI , Qing HAN
CPC分类号： G06F16/283 , G06F9/4881
摘要： The disclosure provides a read-write separation and automatic scaling-based cloud arrangement system and method. Thus, a read operation and a write operation are separated. Capacity expansion and capacity reduction are performed on a cluster. All index data is stored in corresponding object storage. A pre-computing module submits resources (memory and CPU) required by a computing task to an automatic scaling module. Resource creation is performed by invoking API corresponding to an infrastructure automated arrangement tool Terraform, to guarantee the operation of a construction task. The automatic scaling module provides two resource expansion strategies, which are based on time and the maximum number of waiting tasks. According to the disclosure, the utilization rate of cloud resources is increased, costs are lowered, and manual intervention is reduced. Therefore, higher reliability is provided for the horizontal expansion of a query cluster, the stability of a system during high concurrency is enhanced, and the safety and infinite scalability of data are guaranteed.
-
-
-
-
-
-
-
-
-
搜索结果
15 条记录 (耗时 0.044 秒)
