-
公开(公告)号:US20240036767A1
公开(公告)日:2024-02-01
申请号:US18475481
申请日:2023-09-27
Applicant: Lemon Inc. , Beijing Volcano Engine Technology Co., Ltd.
Inventor: Zhengyu YANG , Hao WANG , Sheng QIU , Yang LIU , Yizheng JIAO , Qizhong MAO , Jiaxin OU , Ming ZHAO , Yi WANG , Jingwei ZHANG , Jianyang HU
IPC: G06F3/06
CPC classification number: G06F3/0659 , G06F3/0635 , G06F3/0604 , G06F3/067
Abstract: Decoupled computing systems include layers of same-type computing resources, and include a dispatch layer to assign tasks from one layer to another, such as input and output (I/O) flows. The I/O flows can be assigned to particular computing resources of a layer based on a weighted moving average of performance data for the layer. When traffic is high, the assignment can include random assignment to some or all of the computing resources in the layer. The I/O flows can be split between read-intensive and write-intensive flows, with more read-intensive flows being assigned based on a pick ratio.
-
公开(公告)号:US20240020277A1
公开(公告)日:2024-01-18
申请号:US18475943
申请日:2023-09-27
Applicant: Lemon Inc. , Beijing Volcano Engine Technology Co., Ltd.
Inventor: Hao WANG , Sheng QIU , Yizheng JIAO , Jianyan HU , Kuankuan GUO
IPC: G06F16/18 , G06F16/176 , G06F16/17 , G06F12/02
CPC classification number: G06F16/1805 , G06F16/176 , G06F16/1734 , G06F12/0253 , G06F2212/7205
Abstract: Methods and systems of a log engine for logging data operation in a file system is disclosed. The log engine includes a user interface module configured to receive a plurality of data operation logs that respectively record a data operation and a sequence ID corresponding to an order of the data operation being performed; and a shared log manager configured to provide an in queue configured to consolidate the plurality of data operation logs, and swap the plurality of data operation logs to an out queue with the plurality of data operation logs being ordered based on the sequence ID and saved in a shared log.
-
公开(公告)号:US20250068566A1
公开(公告)日:2025-02-27
申请号:US18784193
申请日:2024-07-25
Applicant: Beijing Volcano Engine Technology Co., Ltd.
Inventor: Kuankuan GUO , Yuanjin LIN , Liming FANG , Ming ZHAO , Hao WANG , Dong PAN
IPC: G06F12/0891 , G06F12/0831
Abstract: The present disclosure relates to a method for managing cache data, an apparatus, a storage medium and an electronic device, the method includes: acquiring a remaining available space of a solid-state disk for storing cache data; upon the remaining available space being less than a first space threshold, determining a first target fragment group in the solid-state disk that has the greatest garbage proportion, each fragment group including a first number of fragments, and each fragment corresponding to a second number of contiguous logical address spaces in the solid-state disk; and purging the cache data in the first target fragment of the first target fragment group that has the greatest garbage proportion, with this method, the space utilization rate of the solid-state disk can be improved.
-
4.
公开(公告)号:US20250028705A1
公开(公告)日:2025-01-23
申请号:US18742351
申请日:2024-06-13
Applicant: Beijing Volcano Engine Technology Co., Ltd.
Inventor: Haiyang SHI , Hao WANG
Abstract: The embodiments of the disclosure provide a dada shuffling method, apparatus and device, a computer-readable storage medium and product. The method comprises: acquiring a data shuffling request; acquiring a shuffling request parameter linked list associated with the at least one data to be shuffled based on the data shuffling request; performing a merging operation on shuffling request parameters in the shuffling request parameter linked list according to the data amount of the data segment corresponding to the shuffling request parameter and memory buffer information to obtain at least one target request parameter; and caching the data to be shuffled corresponding to the at least one target request parameter to a predetermined remote direct memory access network card; and distributing respectively data segments associated with at least one data to be shuffled cached in the remote direct memory access network card to a target server of the data segment.
-
公开(公告)号:US20240248794A1
公开(公告)日:2024-07-25
申请号:US18582524
申请日:2024-02-20
Applicant: Lemon Inc.
Inventor: Peng XU , Fei LIU , Kyoungryun BAE , Hao WANG , Ming LIN , Wei TANG , Sheng QIU , Yang LIU
IPC: G06F11/10
CPC classification number: G06F11/1004 , G06F11/1068
Abstract: A computing device for verifying data integrity is provided, comprising a memory controller configured to receive a plurality of original data blocks. Each original data block has an associated initial CRC value. The memory controller then segments and recombines the received data blocks into logic blocks, and calculates a new logic block CRC value for each logic block. The logic blocks are transmitted with their respective new logic block CRC values to a storage device, and the logic blocks are written to non-volatile memory of the storage device in a write operation. After the write operation, a combined CRC value is calculated for the logic blocks and a combined CRC value for the original data blocks, and compare the combined CRC values. The memory controller determines whether the combined CRC values match. When they match, the memory controller generates a verification response verifying the integrity of the write operation.
-
-
-
-