METHOD FOR EXECUTING DATA PROCESSING TASK IN CLUSTER MIXED DEPLOYMENT SCENARIO, ELECTRONIC DEVICE AND STORAGE MEDIUM

    公开(公告)号:US20250147801A1

    公开(公告)日:2025-05-08

    申请号:US18934437

    申请日:2024-11-01

    Abstract: A method and an apparatus for executing a data processing task in a cluster mixed deployment scenario and a device are provided. A first electronic device is provided with computing nodes of at least two data engines. A specific implementation of the method includes: in response to a first data engine node receiving a first data processing task, determining a first memory occupancy corresponding to the first data processing task, where the first data engine node is deployed on the first electronic device and belongs to a first data engine; and determining whether to execute the first data processing task based on a second memory occupancy corresponding to another data engine node, where the another data engine node is deployed on the first electronic device and belongs to another data engine other than the first data engine in the at least two data engines.

    DATA PROCESSING METHOD BASED ON ONLINE ANALYTICAL PROCESSING, ELECTRONIC DEVICE AND STORAGE MEDIUM

    公开(公告)号:US20250131014A1

    公开(公告)日:2025-04-24

    申请号:US18885407

    申请日:2024-09-13

    Abstract: A data processing method based on online analytical processing, an electronic device and a storage medium are provided. The method includes: receiving a data operation request, wherein the data operation request includes a first field; determining a target associated data pair from a set of associated data pairs stored in a row-based manner based on the data operation request, and determining a second field associated with the first field according to the determined target associated data pair; taking a field value corresponding to the second field in a fact table of a first database as a target field value corresponding to the first field, and executing an operation indicated by the data operation request for the target field value; wherein fields belonging to the second data type among the associated data pairs are stored in the fact table.

    DATA READING AND WRITING METHOD, ELECTRONIC DEVICE AND MEDIUM

    公开(公告)号:US20250124032A1

    公开(公告)日:2025-04-17

    申请号:US18827533

    申请日:2024-09-06

    Abstract: A data reading and writing method, apparatus and electronic device are provided. In one embodiment, the method includes: receiving a data reading and writing request for a first database, wherein the first database stores data in a column-oriented storage format, the data reading and writing request is used for reading/writing data from/into a row storage table, the first database includes a front-end node and a back-end node, the front-end node is used for receiving the data reading and writing request and the back-end node is used for storing data; parsing the data reading and writing request in the front-end node and sending a parsing result to the back-end node; and reading/writing data from/into a second database by using the parsing result in the back-end node, wherein the first database calls data from the second database, and the second database stores data in a row-oriented storage format.

    DATA QUERY METHOD AND APPARATUS BASED ON DORIS, STORAGE MEDIUM AND DEVICE

    公开(公告)号:US20240095246A1

    公开(公告)日:2024-03-21

    申请号:US18470184

    申请日:2023-09-19

    CPC classification number: G06F16/24552 G06F16/219 G06F16/244

    Abstract: A data query method based on Doris includes: acquiring history data in a bottom operator in a storage engine architecture of the Doris, and performing an aggregation calculation on the history data to obtain an aggregation result of the history data; caching, by a preset cache system, the aggregation result of the history data; performing an aggregation calculation on real-time data in a newly inserted bottom operator in the Doris, in response to a data query request, to obtain an aggregate result of the real-time data; acquiring the aggregation result of the history data from the preset cache system, and merging the aggregation result of the history data with the aggregation result of the real-time data to obtain merged data; and sending, by a data sending operator in the Doris, the merged data to an upper layer of an execution engine, to output a final data query result.

Patent Agency Ranking