公开(公告)号：US20240411478A1

公开(公告)日：2024-12-12

申请号：US18734229

申请日：2024-06-05

Applicant: Beijing Volcano Engine Technology Co., Ltd.

Inventor： Xiao Liu ,  Haiyang Shi ,  Hao Wang

IPC: G06F3/06

Abstract: Embodiments of the disclosure provide a method and an apparatus of data processing, an electronic device and a storage medium. The method includes receiving first access data transmitted by at least one client, the first access data representing an instruction log of a remote direct data read instruction transmitted by the client for target data cached in a non-uniform memory access structure; obtaining a data popularity of the target data based on the first access data, the data popularity representing a frequency of the target data accessed by the remote direct data read instruction; and based on the data popularity of the target data, caching the target data to a target location in a data storage unit implemented based on the non-uniform memory access structure, or migrating the target data out of the data storage unit, wherein the target location has a data read-write speed corresponding to the data popularity.

公开(公告)号：US20240020167A1

公开(公告)日：2024-01-18

申请号：US18475763

申请日：2023-09-27

Applicant: Lemon Inc. ,  Beijing Volcano Engine Technology Co., Ltd.

Inventor： Jiaxin Ou ,  Hao Wang ,  Ming Zhao ,  Yi Wang ,  Zhengyu Yang

IPC: G06F9/50 ,  G06F11/14 ,  G06F16/18

CPC classification number: G06F9/5038 ,  G06F9/505 ,  G06F11/1435 ,  G06F16/1847

Abstract: By splitting data within a large LSM tree structure into smaller tree structures to reduce a number of layers in such a structure, write amplification factor (WAF) is efficiently reduced. By further classifying and labeling each I/O based on type, a lower-level filesystem is able to prioritize scheduling between different types of I/O to thereby facilitate stable latency for individual conjunction within the filesystem layer and for individual I/O operations.

公开(公告)号：US12229118B2

公开(公告)日：2025-02-18

申请号：US18742351

申请日：2024-06-13

Applicant: Beijing Volcano Engine Technology Co., Ltd.

Inventor： Haiyang Shi ,  Hao Wang

IPC: G06F16/23 ,  G06F7/14

Abstract: The embodiments of the disclosure provide a dada shuffling method, apparatus and device, a computer-readable storage medium and product. The method comprises: acquiring a data shuffling request; acquiring a shuffling request parameter linked list associated with the at least one data to be shuffled based on the data shuffling request; performing a merging operation on shuffling request parameters in the shuffling request parameter linked list according to the data amount of the data segment corresponding to the shuffling request parameter and memory buffer information to obtain at least one target request parameter; and caching the data to be shuffled corresponding to the at least one target request parameter to a predetermined remote direct memory access network card; and distributing respectively data segments associated with at least one data to be shuffled cached in the remote direct memory access network card to a target server of the data segment.

公开(公告)号：US20240086362A1

公开(公告)日：2024-03-14

申请号：US18475725

申请日：2023-09-27

Applicant: Lemon Inc. ,  Beijing Volcano Engine Technology Co., Ltd.

Inventor： Hao Wang ,  Jiaxin Ou ,  Sheng Qiu ,  Yi Wang ,  Zhengyu Yang ,  Yizheng Jiao ,  Jingwei Zhang ,  Jianyang Hu ,  Yang Liu ,  Ming Zhao ,  Hui Zhang ,  Kuankuan Guo ,  Huan Sun ,  Yinlin Zhang

IPC: G06F16/13

CPC classification number: G06F16/134

Abstract: A key-value store and a file system are integrated together to provide improved operations. The key-value store can include a log engine, a hash engine, a sorting engine, and a garbage collection manager. The features of the key-value store can be configured to reduce the number of I/O operations involving the file system, thereby improving read efficiency, reducing write latency, and reducing write amplification issues inherent in the combined key-value store and file system.

公开(公告)号：US20240028566A1

公开(公告)日：2024-01-25

申请号：US18475746

申请日：2023-09-27

Applicant: Lemon Inc. ,  Beijing Volcano Engine Technology Co., Ltd.

Inventor： Sheng Qiu ,  Hao Wang ,  Zhengyu Yang ,  Yizheng Jiao ,  Jianyang Hu ,  Yang Liu ,  Jiaxin Ou ,  Huan Sun ,  Yinlin Zhang

IPC: G06F16/18 ,  G06F16/178 ,  G06F11/14

CPC classification number: G06F16/1815 ,  G06F16/178 ,  G06F16/1847 ,  G06F11/1407

Abstract: A file system particular for use with key-value stores is provided. The file system can operate in a user space instead of a kernel space. The file system can be an append-only file system. The file system can support use of solid state drives (SSDs) for storage, including zoned SSDs. The file system can include a file manager, a metadata manager, a task scheduler, a space allocator, and a collaborator for collaborating with a key-value store.

公开(公告)号：US12235817B2

公开(公告)日：2025-02-25

申请号：US18475695

申请日：2023-09-27

Applicant: Lemon Inc. ,  Beijing Volcano Engine Technology Co., Ltd.

Inventor： Jiaxin Ou ,  Jingwei Zhang ,  Hao Wang ,  Hui Zhang ,  Ming Zhao ,  Yi Wang ,  Zhengyu Yang

IPC: G06F16/22 ,  G06F16/2455

Abstract: Systems and methods are provided for improved point querying of a database. The index values are separated from data and retained in cache memory to allow access without requiring a disk input/output (I/O) operation and thereby having less latency resulting from such disk I/O operations. The index values can be compressed using an algorithm such as Crit-Bit-Trie to allow storage of the index values in limited cache memory space. The index values can be selected for storage according to a least recently used approach when cache memory is insufficient to store all index values to maintain a hit rate for the cached portion and reduce the disk I/O operations.

公开(公告)号：US12299320B2

公开(公告)日：2025-05-13

申请号：US18734229

申请日：2024-06-05

Applicant: Beijing Volcano Engine Technology Co., Ltd.

Inventor： Xiao Liu ,  Haiyang Shi ,  Hao Wang

IPC: G06F3/06

Abstract: A method, apparatus, electronic device and storage medium for data caching based on data popularity is provided. In the method, first access data transmitted by at least one client is received. The first access data represents an instruction log of a remote direct data read instruction transmitted by the client for target data cached in a non-uniform memory access structure. A data popularity of the target data is obtained based on the first access data. The data popularity represents a frequency of the target data accessed by the remote direct data read instruction. Based on the data popularity of the target data, the target data is cached to a target location in a data storage unit implemented based on the non-uniform memory access structure. Alternatively, the target data out of the data storage unit is migrated. The target location has a data read-write speed corresponding to the data popularity.

公开(公告)号：US20240070135A1

公开(公告)日：2024-02-29

申请号：US18475695

申请日：2023-09-27

Applicant: Lemon Inc. ,  Beijing Volcano Engine Technology Co., Ltd.

Inventor： Jiaxin Ou ,  Jingwei Zhang ,  Hao Wang ,  Hui Zhang ,  Ming Zhao ,  Yi Wang ,  Zhengyu Yang

IPC: G06F16/22 ,  G06F16/2455

CPC classification number: G06F16/2228 ,  G06F16/2219 ,  G06F16/24552

Abstract: Systems and methods are provided for improved point querying of a database. The index values are separated from data and retained in cache memory to allow access without requiring a disk input/output (I/O) operation and thereby having less latency resulting from such disk I/O operations. The index values can be compressed using an algorithm such as Crit-Bit-Trie to allow storage of the index values in limited cache memory space. The index values can be selected for storage according to a least recently used approach when cache memory is insufficient to store all index values to maintain a hit rate for the cached portion and reduce the disk I/O operations.