公开(公告)号：US11789936B2

公开(公告)日：2023-10-17

申请号：US17462853

申请日：2021-08-31

Applicant: LEMON INC.

Inventor： Jianjun Chen ,  Yonghua Ding ,  Ye Liu ,  Fangshi Li ,  Li Zhang ,  Mingyi Zhang ,  Kui Wei ,  Wei Ding ,  Kai Wu ,  Jason Yang Sun

IPC: G06F16/00 ,  G06F16/23 ,  G06F16/28

CPC classification number: G06F16/2379 ,  G06F16/28

Abstract: The present disclosure describes storage techniques for hybrid transactional and analytical processing. Data captured by a first processing engine may be received. The first processing engine may be configured to perform online transactional processing). Multiple replicas of logical logs generated based on the data may be distributed to a Delta Store by applying a quorum protocol on the multiple replicas. Data in the Delta Store are stored in a row format and are visible to a query for online analytical processing performed by a second processing engine. Data may be flushed from the Delta Store to a Base Store based on one or more predetermined rules. Data in the Base Store are stored in a columnar format and may be accessible by the second processing engine.

公开(公告)号：US12164960B1

公开(公告)日：2024-12-10

申请号：US18737810

申请日：2024-06-07

Applicant: DOUYIN VISION CO., LTD. ,  LEMON INC.

Inventor： Yuanjin Lin ,  Wei Ding

IPC: G06F9/46 ,  G06F9/48

Abstract: The present disclosure relates to a database-based data processing method, device, medium and electronic apparatus, the method including: receiving a query request task to be executed, and determining a plurality of coroutine tasks corresponding to the query request task; in each thread, determining a target coroutine task to be executed according to time information of each coroutine task in the local task queue of the thread; interrupting the target coroutine task and adding the target coroutine task to the global task queue when execution of the target coroutine task is not completed and the target coroutine task has been executed in the thread for a current time slice; according to the global task queue, and the local task queue of the thread, determining a new target coroutine task for the thread, and executing the new target coroutine task in a next time slice.

公开(公告)号：US20230063730A1

公开(公告)日：2023-03-02

申请号：US17462853

申请日：2021-08-31

Applicant: LEMON INC.

Inventor： Jianjun Chen ,  Yonghua Ding ,  Ye Liu ,  Fangshi Li ,  Li Zhang ,  Mingyi Zhang ,  Kui Wei ,  Wei Ding ,  Kai Wu ,  Jason Yang Sun

IPC: G06F16/23 ,  G06F16/28

Abstract: The present disclosure describes storage techniques for hybrid transactional and analytical processing. Data captured by a first processing engine may be received. The first processing engine may be configured to perform online transactional processing). Multiple replicas of logical logs generated based on the data may be distributed to a Delta Store by applying a quorum protocol on the multiple replicas. Data in the Delta Store are stored in a row format and are visible to a query for online analytical processing performed by a second processing engine. Data may be flushed from the Delta Store to a Base Store based on one or more predetermined rules. Data in the Base Store are stored in a columnar format and may be accessible by the second processing engine.

公开(公告)号：US20240403292A1

公开(公告)日：2024-12-05

申请号：US18798502

申请日：2024-08-08

Applicant: Lemon Inc. ,  Beijing Zitiao Network Technology Co., Ltd.

Inventor： Wei Ding ,  Li Zhang ,  Yuanjin Lin ,  Kui Wei ,  Yuxiang Chen ,  Jianjun Chen

IPC: G06F16/2453 ,  G06F11/30 ,  G06F11/34

Abstract: A hybrid transactional/analytical processing database includes an OLTP engine, OLAP engine, and shared storage including a mass storage device holding data of multiple tenants. The shared storage includes processing circuitry configured to implement a query executor configured to continuously monitor actual memory usage of the shared storage while the shared storage is responding to one or more queries from the OLTP engine or OLAP engine. Upon determining the actual memory usage of an operator evaluating the one or more of the queries from the OLTP engine or OLAP engine at the shared storage exceeds the preventative memory usage threshold but does not exceed the system memory usage threshold, the query executor is further configured to spill one or more fragments of query memory corresponding to the one or more queries to the mass storage device, without terminating the one or more queries.