-
公开(公告)号：US20220012243A1
公开(公告)日：2022-01-13
申请号：US17051014
申请日：2020-03-04
发明人： Hongbin MA , Yang LI , Qing HAN
IPC分类号： G06F16/2453 , G06F16/22 , G06F16/2455
摘要： The present application discloses a dynamic routing method and apparatus for a query engine in a pre-computing system. The method includes: pre-obtaining cube data under a preset dimensional combination in a pre-computing system; determining a degree of aggregation of the cube data selected as expected under the preset dimensional combination after a query request is received; executing query processing on the query request in a first distributed query engine when the degree of aggregation of the cube data under the preset dimensional combination is high; and switching to a second distributed query engine to execute query processing on the query request when the degree of aggregation of the cube data under the preset dimensional combination is low. The present application solves the technical problem that the query response speed of the pre-computing query system is not ideal. Through the present application, the sub-second high-performance query response can be achieved. At the same time, as a result, higher concurrency can be supported so as to meet business needs, and the stability of the query system is simultaneously guaranteed.
-
公开(公告)号：US20240028604A1
公开(公告)日：2024-01-25
申请号：US17615551
申请日：2021-01-29
发明人： Shaoxiong ZHAN , Yang LI , Qing HAN
IPC分类号： G06F16/25 , G06F16/172 , G06F16/14
CPC分类号： G06F16/254 , G06F16/172 , G06F16/148
摘要： The disclosure provides a cloud computing-based adaptive storage layering system and method. The system includes a data node management module, a metadata management module, an adaptive storage layering module, and a pre-aggregated query routing module. According to predefined rules, node capacity is expanded and shrunk, collected queried hit models and scanned file paths are aggregated and sorted, and layering loading and pre-loading are performed on files. Based on the disclosure, an efficient On-Line Analytical Processing (OLAP) query execution engine may be constructed, to deal with complex OLAP queries of various reporting system. Therefore, the execution efficiency of cloud OLAP engines can be significantly enhanced.
-
公开(公告)号：US20230153299A1
公开(公告)日：2023-05-18
申请号：US18092329
申请日：2023-01-01
IPC分类号： G06F16/2453 , G06F16/28 , G06F11/34
CPC分类号： G06F16/2453 , G06F16/283 , G06F11/3419
摘要： This application discloses a precomputation method and apparatus for continuous iterative optimization. The precomputation method for continuous iterative optimization includes: determining a query task corresponding to each of a plurality of time periods; and continuously performing multiple rounds of optimization on a precomputation model according to the query task corresponding to each time period. According to this application, the precomputation model is continuously optimized, so that the performance of the precomputation model is improved. Therefore, the technical problem of poor performance caused by long-term non-tuning of the precomputation model can be avoided.
-
公开(公告)号：US20230153298A1
公开(公告)日：2023-05-18
申请号：US18092330
申请日：2023-01-01
发明人： He LIU , Wenzheng LIU , Yang LI , Qing HAN
IPC分类号： G06F16/242 , G06F16/2453 , G06F16/2458 , G06F16/28
CPC分类号： G06F16/244 , G06F16/24542 , G06F16/2471 , G06F16/283
摘要： The present invention discloses a data query method, device and equipment and a storage medium. A data query method comprises the following steps: receiving an MDX query statement; acquiring related information of measurement and dimension in the MDX query statement; and performing query according to the related information of measurement and dimension to obtain a query result. According to the present invention, an MDX expression is computed by extracting the related information of measurement and dimension and utilizing a distributed computing framework, so that the data analysis efficiency is greatly improved.
-
公开(公告)号：US20230146136A1
公开(公告)日：2023-05-11
申请号：US18092327
申请日：2023-01-01
IPC分类号： G06F16/2453 , G06F16/28 , G06F11/34
CPC分类号： G06F16/2453 , G06F11/3419 , G06F16/283
摘要： This application discloses a method and apparatus for scoring a precomputation model, a device, and a storage medium. The method includes: calculating, in a plurality of precomputation models, a score when each precomputation model executes a same query load; determining the precomputation model with the largest score as a target precomputation model according to the score of each precomputation model; and using the target precomputation model for query calculation. According to this application, the precomputation model may be quantitatively scored, so that horizontal comparison is conveniently performed when different precomputation models execute query tasks of the same load. Therefore, a user can conveniently select different precomputation models for query calculation.
-
公开(公告)号：US20230017300A1
公开(公告)日：2023-01-19
申请号：US17621205
申请日：2021-01-29
发明人： Wenzheng LIU , Dong LI , Yang LI , Qing HAN
IPC分类号： G06F16/25 , G06F16/2455 , G06F16/2453
摘要： The query method and device suitable for an On-Line Analytical Processing (OLAP) query engine includes a client agent module, a query pattern matching module, a query distributed execution module, and a pre-aggregation module. The query pattern matching module is configured to obtain an MDX query request received by an OLAP query engine and process the MDX query request to generate at least one set of aggregation query sets. The one set of aggregation query sets includes a plurality of aggregation query requests. The query distributed execution module is configured to perform concurrent processing on the plurality of aggregation query requests. The aggregation query requests are arranged corresponding to the aggregation query results. An efficient OLAP query execution engine can deal with complex OLAP queries of various reporting system. Therefore, the execution efficiency of MDX query can be significantly enhanced, and analysis requests of the reporting systems are rapidly responded.
-
公开(公告)号：US20230359647A1
公开(公告)日：2023-11-09
申请号：US17611183
申请日：2021-03-01
发明人： Shaoxiong ZHAN , Jinghua FENG , Rongchuan JIN , Yang LI , Qing HAN
CPC分类号： G06F16/283 , G06F9/4881
摘要： The disclosure provides a read-write separation and automatic scaling-based cloud arrangement system and method. Thus, a read operation and a write operation are separated. Capacity expansion and capacity reduction are performed on a cluster. All index data is stored in corresponding object storage. A pre-computing module submits resources (memory and CPU) required by a computing task to an automatic scaling module. Resource creation is performed by invoking API corresponding to an infrastructure automated arrangement tool Terraform, to guarantee the operation of a construction task. The automatic scaling module provides two resource expansion strategies, which are based on time and the maximum number of waiting tasks. According to the disclosure, the utilization rate of cloud resources is increased, costs are lowered, and manual intervention is reduced. Therefore, higher reliability is provided for the horizontal expansion of a query cluster, the stability of a system during high concurrency is enhanced, and the safety and infinite scalability of data are guaranteed.
-
公开(公告)号：US20230342841A1
公开(公告)日：2023-10-26
申请号：US18092328
申请日：2023-01-01
发明人： Binbin ZOU , Yang LI , Qing HAN
IPC分类号： G06Q30/08 , G06Q10/0631
CPC分类号： G06Q30/08 , G06Q10/06313
摘要： An embodiment of the present invention discloses a computing resource configuration method and device for enterprise cloudification. The method comprises the following steps: obtaining parameters configured by a user through a configuration page, wherein the parameters include a proportion of a bidding instance to an on-demand instance; determining a total amount of computing resources required by a computing task after the computing task is obtained; determining the computing resources corresponding to the bidding instance and the computing resources corresponding to the on-demand instance based on existing computing resources, the total amount of the computing resources and the proportion; and applying for the computing resources from a cloud provider based on the computing resources corresponding to the bidding instance and the computing resources corresponding to the on-demand instance. Big data is computed in a bidding instance mode so that the total cost of the computing resources is greatly reduced. Moreover, the technical problem of high total cost of the computing resources caused by performing data computing in a mode of depending on a reserved instance and/or the on-demand instance is solved.
-
公开(公告)号：US20230153141A1
公开(公告)日：2023-05-18
申请号：US17621208
申请日：2021-01-29
IPC分类号： G06F9/455
CPC分类号： G06F9/45558 , G06F2009/45583 , G06F2009/4557
摘要： The cloud cost-based resource deployment system and method includes a dynamic deployment strategy module, a resource life cycle management module, and an automatic resource operation and maintenance module. The dynamic deployment strategy module automatically analyzes and combines resource deployment schemes. The resource life cycle management module docks with Application Program Interface (API) of various public clouds, and internally provides standardized and unified interfaces. The automatic resource operation and maintenance module modifies the resources in real time through the public cloud API and a manner of remotely connecting to infrastructure resources. Unified and efficient management on a plurality of public clouds is performed. For cloud resources, deployment strategy can be automatically adjusted for different operation systems, so that the public clouds can be efficiently used with a low cost.
-
公开(公告)号：US20220398259A1
公开(公告)日：2022-12-15
申请号：US17621210
申请日：2021-01-29
发明人： Danchao GU , Dong LI , Yang LI , Qing HAN
IPC分类号： G06F16/28 , G06F9/50 , H04L67/1097
摘要： The Online Analytical Processing (OLAP) precomputation engine optimization method based on an object storage, and application, and provides three optimization directions: reduction of an object renaming operation, data consistency check, and inversion of a logical path of an index file. A mapping relationship of a file before and after renaming is matched through a file mapping table added to a metadata layer, and a renaming operation on a bottom layer of a file system is reduced. Logical path inversion of a partition directory hierarchical structure of the file is corresponded to a prefix of the file in the object storage, and the object storage is rapidly queried and read. Logical verification is added to a read operation, a deletion operation, and a write operation, and the data consistency is checked.
-
-
-
-
-
-
-
-
-
搜索结果
12 条记录 (耗时 0.015 秒)
