公开(公告)号：US20240020167A1

公开(公告)日：2024-01-18

申请号：US18475763

申请日：2023-09-27

Applicant: Lemon Inc. ,  Beijing Volcano Engine Technology Co., Ltd.

Inventor： Jiaxin Ou ,  Hao Wang ,  Ming Zhao ,  Yi Wang ,  Zhengyu Yang

IPC: G06F9/50 ,  G06F11/14 ,  G06F16/18

CPC classification number: G06F9/5038 ,  G06F9/505 ,  G06F11/1435 ,  G06F16/1847

Abstract: By splitting data within a large LSM tree structure into smaller tree structures to reduce a number of layers in such a structure, write amplification factor (WAF) is efficiently reduced. By further classifying and labeling each I/O based on type, a lower-level filesystem is able to prioritize scheduling between different types of I/O to thereby facilitate stable latency for individual conjunction within the filesystem layer and for individual I/O operations.

公开(公告)号：US12298900B2

公开(公告)日：2025-05-13

申请号：US18475664

申请日：2023-09-27

Applicant: Lemon Inc. ,  Beijing Volcano Engine Technology Co., Ltd.

Inventor： Jiaxin Ou ,  Yi Wang ,  Jingwei Zhang ,  Zhengyu Yang

IPC: G06F12/02

Abstract: Methods and systems for garbage collection and compaction for key-value engines in a data storage and communication system. The method includes determining disk capacity usage of the key-value engine and adjusting a garbage collection percentage threshold and a number of garbage collection threads based on whether the disk capacity usage of the key-value engine meets and/or exceeds predetermined disk capacity usage thresholds. The method may further include performing a periodic compaction process to consolidate one or more expired pages of one or more applications on a log-structured merge (LSM) tree by merging one or more layers into a last layer of the one or more expired pages to reduce data handling during an occurrence of the garbage collection.

公开(公告)号：US20240086362A1

公开(公告)日：2024-03-14

申请号：US18475725

申请日：2023-09-27

Applicant: Lemon Inc. ,  Beijing Volcano Engine Technology Co., Ltd.

Inventor： Hao Wang ,  Jiaxin Ou ,  Sheng Qiu ,  Yi Wang ,  Zhengyu Yang ,  Yizheng Jiao ,  Jingwei Zhang ,  Jianyang Hu ,  Yang Liu ,  Ming Zhao ,  Hui Zhang ,  Kuankuan Guo ,  Huan Sun ,  Yinlin Zhang

IPC: G06F16/13

CPC classification number: G06F16/134

Abstract: A key-value store and a file system are integrated together to provide improved operations. The key-value store can include a log engine, a hash engine, a sorting engine, and a garbage collection manager. The features of the key-value store can be configured to reduce the number of I/O operations involving the file system, thereby improving read efficiency, reducing write latency, and reducing write amplification issues inherent in the combined key-value store and file system.

公开(公告)号：US20240020231A1

公开(公告)日：2024-01-18

申请号：US18475664

申请日：2023-09-27

Applicant: Lemon Inc. ,  Beijing Volcano Engine Technology Co., Ltd.

Inventor： Jiaxin Ou ,  Yi Wang ,  Jingwei Zhang ,  Zhengyu Yang

IPC: G06F12/02

CPC classification number: G06F12/0253 ,  G06F2212/7205

Abstract: Methods and systems for garbage collection and compaction for key-value engines in a data storage and communication system. The method includes determining disk capacity usage of the key-value engine and adjusting a garbage collection percentage threshold and a number of garbage collection threads based on whether the disk capacity usage of the key-value engine meets and/or exceeds predetermined disk capacity usage thresholds. The method may further include performing a periodic compaction process to consolidate one or more expired pages of one or more applications on a log-structured merge (LSM) tree by merging one or more layers into a last layer of the one or more expired pages to reduce data handling during an occurrence of the garbage collection.

公开(公告)号：US12235817B2

公开(公告)日：2025-02-25

申请号：US18475695

申请日：2023-09-27

Applicant: Lemon Inc. ,  Beijing Volcano Engine Technology Co., Ltd.

Inventor： Jiaxin Ou ,  Jingwei Zhang ,  Hao Wang ,  Hui Zhang ,  Ming Zhao ,  Yi Wang ,  Zhengyu Yang

IPC: G06F16/22 ,  G06F16/2455

Abstract: Systems and methods are provided for improved point querying of a database. The index values are separated from data and retained in cache memory to allow access without requiring a disk input/output (I/O) operation and thereby having less latency resulting from such disk I/O operations. The index values can be compressed using an algorithm such as Crit-Bit-Trie to allow storage of the index values in limited cache memory space. The index values can be selected for storage according to a least recently used approach when cache memory is insufficient to store all index values to maintain a hit rate for the cached portion and reduce the disk I/O operations.

公开(公告)号：US20240070135A1

公开(公告)日：2024-02-29

申请号：US18475695

申请日：2023-09-27

Applicant: Lemon Inc. ,  Beijing Volcano Engine Technology Co., Ltd.

Inventor： Jiaxin Ou ,  Jingwei Zhang ,  Hao Wang ,  Hui Zhang ,  Ming Zhao ,  Yi Wang ,  Zhengyu Yang

IPC: G06F16/22 ,  G06F16/2455

CPC classification number: G06F16/2228 ,  G06F16/2219 ,  G06F16/24552

Abstract: Systems and methods are provided for improved point querying of a database. The index values are separated from data and retained in cache memory to allow access without requiring a disk input/output (I/O) operation and thereby having less latency resulting from such disk I/O operations. The index values can be compressed using an algorithm such as Crit-Bit-Trie to allow storage of the index values in limited cache memory space. The index values can be selected for storage according to a least recently used approach when cache memory is insufficient to store all index values to maintain a hit rate for the cached portion and reduce the disk I/O operations.

公开(公告)号：US20250124012A1

公开(公告)日：2025-04-17

申请号：US18793745

申请日：2024-08-02

Applicant: INSTITUTE OF COMPUTING TECHNOLOGY, CHINESE ACADEMY OF SCIENCES ,  BEIJING VOLCANO ENGINE TECHNOLOGY CO., LTD.

Inventor： Qihan KANG ,  Ziwei XIONG ,  Mi ZHANG ,  Dejun JIANG ,  Jin XIONG ,  Jiaxin OU ,  Yi Wang

IPC: G06F16/22 ,  G06F16/27

Abstract: The embodiments of the present disclosure provide an information processing method, an information processing apparatus, an electronic device, and a storage medium. The method is applied to a key-value storage system for key-value separation, a storage unit in the key-value storage system includes a key partition used for storing LSMT information and a plurality of storage partitions used for storing key-value information, and the method includes: selecting, according to the LSMT information in the key partition, a target storage partition with a highest invalid information rate from the storage partitions; detecting validity information corresponding to each key-value information in the target storage partition, and screening out valid key-value information according to the validity information corresponding to each key-value information; and transferring and storing the valid key-value information to a first storage partition except for the target storage partition, and erasing multiple key-value information stored in the target storage partition.

公开(公告)号：US20240422070A1

公开(公告)日：2024-12-19

申请号：US18743730

申请日：2024-06-14

Applicant: Lemon Inc. ,  Beijing Youzhuju Network Technology Co., Ltd.

Inventor： Weirong Jiang ,  Anubhavnidhi Abhashkumar ,  Zhaoyu Gao ,  Yi Wang ,  Jian Wang

IPC: H04L41/14 ,  H04L41/12

Abstract: The disclosure provides a method, an apparatus, an electronic device and a storage medium for network topology-based verification. The method comprises: obtaining a network verification request which comprises device change information for a physical network; determining a target network device changed in the physical network using the device change information, and obtaining extended network devices from network devices in each of the hierarchical layers in the physical network, the extended network devices obtained in each of the hierarchical layers corresponding to different providers; constructing an emulated network topology based on the target network device and the extended network devices; and establishing an emulation runtime environment corresponding to the emulated network topology, and performing emulation verification on the emulated network topology based on the emulation runtime environment to obtain an emulation verification result.