METHOD AND DEVICE FOR DETERMINING STRIPE CONSISTENCY

    公开(公告)号:EP4050485A1

    公开(公告)日:2022-08-31

    申请号:EP20890994.5

    申请日:2020-11-05

    IPC分类号: G06F11/10

    摘要: Embodiments of this application provide a method for determining stripe consistency and an apparatus, and relate to the field of computer technologies, so that network resources consumed for determining stripe consistency can be reduced. The method includes: An operation node obtains n groups of CRC data blocks corresponding to a target stripe, where the target stripe includes n first data blocks, the n first data blocks include k original data blocks and m EC data blocks of the k original data blocks, the n groups of CRC data blocks are respective CRC data blocks of n groups of second data blocks, one group of second data blocks includes m transformation results obtained by performing m times of EC transformation on one first data block, both k and m are positive integers, and n = m + k. In addition, the operation node determines whether the n groups of CRC data blocks meet a linear relationship. If the n groups of CRC data blocks meet a linear relationship, the operation node determines that the target stripe has stripe consistency.

    DATA PROCESSING METHOD AND RELATED DEVICE
    2.
    发明公开

    公开(公告)号:EP4394573A1

    公开(公告)日:2024-07-03

    申请号:EP22871446.5

    申请日:2022-05-30

    IPC分类号: G06F3/06

    CPC分类号: G06F12/02 G06F3/06

    摘要: This application provides a data processing method, including: obtaining a parameter related to performance of a memory of a storage node, adjusting an aggregation policy based on the parameter, aggregating a first input output IO request in the memory into a second IO request based on an adjusted aggregation policy, and performing persistent storage on data corresponding to the second IO request. On one hand, the storage node aggregates small IO requests into a large IO request, so as to avoid impact of the small IO requests on performance of an entire distributed storage system. On the other hand, the aggregation policy is adaptively adjusted, it can be avoided that the memory is quickly full due to aggregation performed based on an aggregation policy with a fixed parameter, thereby affecting overall performance of a distributed storage system.

    DATA PRE-FETCHING METHOD, AND COMPUTING NODE AND STORAGE SYSTEM

    公开(公告)号:EP4386567A1

    公开(公告)日:2024-06-19

    申请号:EP22871553.8

    申请日:2022-07-06

    IPC分类号: G06F12/08

    摘要: Embodiments of this application provide a data prefetching method, a computing node, and a storage system. The method includes: A computing node obtains information about accessing a storage node by a first application in a preset time period. The computing node determines information about prefetch data based on the access information. The computing node determines, based on the information about the prefetch data, a cache node prefetching the prefetch data, and generates a prefetch request for prefetching the prefetch data. The computing node sends the prefetch request to the cache node. The cache node performs a prefetching operation on the prefetch data in response to the prefetch request. The solutions provided in embodiments of this application improve prefetching accuracy.

    DATA STORAGE METHOD, STORAGE SYSTEM, STORAGE DEVICE, AND STORAGE MEDIUM

    公开(公告)号:EP4170499A1

    公开(公告)日:2023-04-26

    申请号:EP20944002.3

    申请日:2020-10-14

    IPC分类号: G06F11/10

    摘要: Embodiments of this application disclose a data storage method, a storage system, a storage device, and a storage medium, and pertain to the field of data storage technologies. In the embodiments of this application, performance of a first medium layer is different from performance of a second medium layer. Based on this, data is stored at the first medium layer and the second medium layer based on different erasure code ratios. The different erasure code ratios correspond to different write amplification, and therefore storage space utilization is different. Therefore, different erasure code ratios are selected based on different performance of medium layers to store data, so that storage performance of a corresponding medium layer can be better achieved, to effectively improve storage space utilization.

    DATA COMPRESSION METHOD AND APPARATUS, AND COMPUTING DEVICE AND STORAGE MEDIUM

    公开(公告)号:EP4350527A1

    公开(公告)日:2024-04-10

    申请号:EP22836718.1

    申请日:2022-06-22

    IPC分类号: G06F16/174 G06F3/06 H03M7/30

    摘要: This application discloses a data compression method and apparatus, a computing device, and a storage system, and relates to the field of data compression. The method includes: When compressing to-be-compressed data, a computing device determines a compression feature value of the to-be-compressed data based on a parameter that affects a compression result of the to-be-compressed data, determines, based on the compression feature value, a compression policy for compressing the to-be-compressed data, and compresses the to-be-compressed data according to the compression policy to obtain compressed data, and stores the compressed data. In this way, compared with a case in which the computing device compresses data with different features by using one compression algorithm, in the data compression method provided in this application, the compression policy used by the computing device is obtained based on selection of a feature that affects the compression result of the to-be-compressed data. The to-be-compressed data is compressed by using the compression policy that matches the feature of the to-be-compressed data, so that a data compression rate can be effectively improved.

    DATA PRE-FETCHING METHOD AND APPARATUS, AND DEVICE

    公开(公告)号:EP4261670A1

    公开(公告)日:2023-10-18

    申请号:EP21914426.8

    申请日:2021-12-28

    IPC分类号: G06F3/06

    摘要: A data prefetch method is disclosed. Before data is prefetched, a first data access request is first obtained, and a data prefetch policy is determined based on the first data access request and a data lifecycle, so that a first data set stored in a second storage medium is stored into a first storage medium according to the data prefetch policy. The first data set includes at least one piece of data, the data prefetch policy includes at least a prefetch length, the data lifecycle indicates duration for storing data in the first storage medium, and a read/write access rate of the second storage medium is less than that of the first storage medium. In this way, a prefetch length for prefetching data at a single time is dynamically adjusted in an adaptive manner, so that data of a proper length may be prefetched to the first storage medium in advance for a next data access request based on a previous data access request, to avoid as much as possible that excessively much or excessively little data is prefetched at the single time.

    DATA RECONSTRUCTION METHOD AND APPARATUS, COMPUTER DEVICE, STORAGE MEDIUM, AND SYSTEM

    公开(公告)号:EP3989069A1

    公开(公告)日:2022-04-27

    申请号:EP19938765.5

    申请日:2019-07-22

    IPC分类号: G06F11/10

    摘要: The present invention discloses a data reconstruction method and apparatus, a computer device, and a storage medium and system, and pertains to the field of data storage technologies. According to the method, a lost first block in a first strip is directly reconstructed based on a first result obtained from a target quantity of storage devices, so that there is no need to read an unlost block in the first strip. The first block may be reconstructed provided that the target quantity of first results are obtained. An amount of data of the first result is less than that of the unlost block in the first strip. Therefore, a data transmission process occupies less network bandwidth, and this improves block reconstruction performance.