-
公开(公告)号:US20250147801A1
公开(公告)日:2025-05-08
申请号:US18934437
申请日:2024-11-01
Applicant: Beijing Volcano Engine Technology Co., Ltd.
Inventor: Zhaowei HUANG , Kejian JU , Leilei HU
Abstract: A method and an apparatus for executing a data processing task in a cluster mixed deployment scenario and a device are provided. A first electronic device is provided with computing nodes of at least two data engines. A specific implementation of the method includes: in response to a first data engine node receiving a first data processing task, determining a first memory occupancy corresponding to the first data processing task, where the first data engine node is deployed on the first electronic device and belongs to a first data engine; and determining whether to execute the first data processing task based on a second memory occupancy corresponding to another data engine node, where the another data engine node is deployed on the first electronic device and belongs to another data engine other than the first data engine in the at least two data engines.
-
2.
公开(公告)号:US20250131014A1
公开(公告)日:2025-04-24
申请号:US18885407
申请日:2024-09-13
Applicant: Beijing Volcano Engine Technology Co., Ltd.
Inventor: Kejian JU , Leilei HU , Zhaowei HUANG , Yuanpu DING
Abstract: A data processing method based on online analytical processing, an electronic device and a storage medium are provided. The method includes: receiving a data operation request, wherein the data operation request includes a first field; determining a target associated data pair from a set of associated data pairs stored in a row-based manner based on the data operation request, and determining a second field associated with the first field according to the determined target associated data pair; taking a field value corresponding to the second field in a fact table of a first database as a target field value corresponding to the first field, and executing an operation indicated by the data operation request for the target field value; wherein fields belonging to the second data type among the associated data pairs are stored in the fact table.
-
公开(公告)号:US20250124032A1
公开(公告)日:2025-04-17
申请号:US18827533
申请日:2024-09-06
Applicant: Beijing Volcano Engine Technology Co., Ltd.
Inventor: Leilei HU , Kejian JU , Zhaowei HUANG , Junling DU
IPC: G06F16/2453 , G06F16/22 , G06F16/23 , G06F16/25
Abstract: A data reading and writing method, apparatus and electronic device are provided. In one embodiment, the method includes: receiving a data reading and writing request for a first database, wherein the first database stores data in a column-oriented storage format, the data reading and writing request is used for reading/writing data from/into a row storage table, the first database includes a front-end node and a back-end node, the front-end node is used for receiving the data reading and writing request and the back-end node is used for storing data; parsing the data reading and writing request in the front-end node and sending a parsing result to the back-end node; and reading/writing data from/into a second database by using the parsing result in the back-end node, wherein the first database calls data from the second database, and the second database stores data in a row-oriented storage format.
-
公开(公告)号:US20240095246A1
公开(公告)日:2024-03-21
申请号:US18470184
申请日:2023-09-19
Applicant: BEIJING VOLCANO ENGINE TECHNOLOGY CO., LTD
Inventor: Zhaowei HUANG , Leilei HU , Junling DU , Xuan LUO
IPC: G06F16/2455 , G06F16/21 , G06F16/242
CPC classification number: G06F16/24552 , G06F16/219 , G06F16/244
Abstract: A data query method based on Doris includes: acquiring history data in a bottom operator in a storage engine architecture of the Doris, and performing an aggregation calculation on the history data to obtain an aggregation result of the history data; caching, by a preset cache system, the aggregation result of the history data; performing an aggregation calculation on real-time data in a newly inserted bottom operator in the Doris, in response to a data query request, to obtain an aggregate result of the real-time data; acquiring the aggregation result of the history data from the preset cache system, and merging the aggregation result of the history data with the aggregation result of the real-time data to obtain merged data; and sending, by a data sending operator in the Doris, the merged data to an upper layer of an execution engine, to output a final data query result.
-
-
-