Data processing method, device, computer apparatus and storage medium

    公开(公告)号:US12235763B2

    公开(公告)日:2025-02-25

    申请号:US18741900

    申请日:2024-06-13

    Abstract: The present disclosure provides a data processing method, a device, a computer apparatus and a storage medium, wherein the method includes: in response to a target disk receiving at least one write request within a preset time period, determining a size threshold value for classifying a data update type according to a size of write data respectively indicated by each write request; determining a data update type corresponding to each write request according to a size of each write request and the size threshold value; dividing write data of the write request to obtain a data block according to a preset data block size, and caching the data block in a cache region of the target disk corresponding to the data update type, the target disk has multiple types of cache regions configured therein, different cache regions are configured to support caching of data with different update frequencies.

    Metadata management for transparent block level compression

    公开(公告)号:US12204750B2

    公开(公告)日:2025-01-21

    申请号:US17953242

    申请日:2022-09-26

    Applicant: Lemon Inc.

    Abstract: The present disclosure describes techniques of metadata management for transparent block level compression. A first area may be created in a backend solid state drive. The first area may comprise a plurality of entries. The plurality of entries may be indexed by addresses of a plurality of blocks of uncompressed data. Each of the plurality of entries comprises a first part configured to store metadata and a second part configured to store compressed data. Each of the plurality blocks of uncompressed data may be compressed individually to generate a plurality of compressed blocks. Metadata and at least a portion of compressed data associated with each of the plurality of compressed blocks may be stored in one of the plurality of entries based on an address of a corresponding block of uncompressed data. A second area may be created in the backend solid state drive for storing the rest of the compressed data.

    Data processing method, device, computer apparatus and storage medium

    公开(公告)号:US12189531B1

    公开(公告)日:2025-01-07

    申请号:US18741900

    申请日:2024-06-13

    Abstract: The present disclosure provides a data processing method, a device, a computer apparatus and a storage medium, wherein the method includes: in response to a target disk receiving at least one write request within a preset time period, determining a size threshold value for classifying a data update type according to a size of write data respectively indicated by each write request; determining a data update type corresponding to each write request according to a size of each write request and the size threshold value; dividing write data of the write request to obtain a data block according to a preset data block size, and caching the data block in a cache region of the target disk corresponding to the data update type, the target disk has multiple types of cache regions configured therein, different cache regions are configured to support caching of data with different update frequencies.

    TRANSPARENT BLOCK DEVICE COMPRESSION USING HASH-TABLE

    公开(公告)号:US20240248625A1

    公开(公告)日:2024-07-25

    申请号:US18099750

    申请日:2023-01-20

    Applicant: Lemon Inc.

    CPC classification number: G06F3/0641 G06F3/0608 G06F3/067

    Abstract: Systems and methods for accessing block storage devices are provided. In particular, a computing device may receive a write request including an uncompressed data and an uncompressed block address associated with the uncompressed data, generate compressed data by compressing the uncompressed data, determine a plurality of mapping candidates of compressed data blocks in the block storage devices based on the uncompressed block address, select a compressed data block from the plurality of mapping candidates that has sufficient capacity to store the compressed data, write the compressed data to the selected compressed data block, update metadata of the selected compressed data block to link the uncompressed block address to a compressed block address of the selected compressed data block, and write the selected compressed data block back to a respective block storage device of the block storage devices.

    HYBRID DESIGN FOR LARGE SCALE BLOCK DEVICE COMPRESSION USING FLAT HASH TABLE

    公开(公告)号:US20240168630A1

    公开(公告)日:2024-05-23

    申请号:US18056842

    申请日:2022-11-18

    Applicant: Lemon Inc.

    CPC classification number: G06F3/0608 G06F3/0631 G06F3/064 G06F3/0673

    Abstract: A flat hash table includes a plurality of entries, and each entry includes a hash function index and a usage bitmap. A method for block device level compression mapping using the flat hash table includes compressing uncompressed data to compressed data, retrieving an entry of the flat hash table using an uncompressed block address of the uncompressed data, determining a compressed block address of the compressed data by executing at least one hash function and by determining a hash function in the at least one hash function for mapping the uncompressed block address to the compressed block address that corresponds to a space in a block storage device, storing the compressed data to the space that corresponds to the compressed block address, and updating the hash function index of the entry of the flat hash table with an index indicative of the hash function.

    TECHNIQUES FOR INSTANCE STORAGE USING SEGMENT-BASED STORAGE

    公开(公告)号:US20240152455A1

    公开(公告)日:2024-05-09

    申请号:US18053908

    申请日:2022-11-09

    Applicant: Lemon Inc.

    CPC classification number: G06F12/0804 G06F12/0246 G06F12/0292 G06F2212/7201

    Abstract: Described are examples for storing data on a storage device, including storing, in a live write stream cache, one or more logical blocks (LBs) corresponding to a data segment, writing, for each LB in the data segment, a cache element of a cache entry that points to the LB in the live write stream cache, where the cache entry includes multiple cache elements corresponding to the multiple LBs of the data segment, writing, for the cache entry, a table entry in a mapping table that points to the cache entry, and when a storage policy is triggered for the cache entry, writing the multiple LBs, pointed to by each cache element of the cache entry, to a stream for storing as contiguous LBs on the storage device, and updating the table entry to point to a physical address of a first LB of the contiguous LBs on the storage device.

    SYSTEMS AND METHODS FOR MODELING A DEPLOYMENT OF HETEROGENEOUS MEMORY ON A SERVER NETWORK

    公开(公告)号:US20240135282A1

    公开(公告)日:2024-04-25

    申请号:US18525580

    申请日:2023-11-30

    Applicant: Lemon Inc.

    CPC classification number: G06Q10/06313 G06Q10/067

    Abstract: A computing system is provided for modeling a deployment of heterogeneous memory on a server network. The computing system receives a user input of parameters including a memory ratio of local memory to heterogeneous memory in each server, a first relative throughput when an entire dataset is in local memory on a server, and a second relative throughput when the entire dataset is in heterogeneous memory on the server. Based on these parameters, the system determines a server ratio of a number of servers in an enhanced cluster with heterogeneous memory to a number of servers in a baseline cluster without heterogeneous memory, where the enhanced cluster and the baseline cluster deliver equivalent data throughput performance. Based on the parameters and the server ratio, a server network design is generated and outputted.

    METADATA MANAGEMENT FOR TRANSPARENT BLOCK LEVEL COMPRESSION

    公开(公告)号:US20240103722A1

    公开(公告)日:2024-03-28

    申请号:US17953242

    申请日:2022-09-26

    Applicant: Lemon Inc.

    CPC classification number: G06F3/0608 G06F3/064 G06F3/0644 G06F3/0673

    Abstract: The present disclosure describes techniques of metadata management for transparent block level compression. A first area may be created in a backend solid state drive. The first area may comprise a plurality of entries. The plurality of entries may be indexed by addresses of a plurality of blocks of uncompressed data. Each of the plurality of entries comprises a first part configured to store metadata and a second part configured to store compressed data. Each of the plurality blocks of uncompressed data may be compressed individually to generate a plurality of compressed blocks. Metadata and at least a portion of compressed data associated with each of the plurality of compressed blocks may be stored in one of the plurality of entries based on an address of a corresponding block of uncompressed data. A second area may be created in the backend solid state drive for storing the rest of the compressed data.

Patent Agency Ranking