摘要:
The present invention provides a method and a system for controlling quality of service of a storage system, and a storage system. The method includes: collecting statistics about processing capability information about hard disks in the storage system and obtaining processing capabilities of the hard disks according to the processing capability information; dividing a cache into multiple tiers according to the processing capabilities of the hard disks; and writing, for a cache of a tier in which dirty data reaches a preset proportion, data in the cache of the tier into a hard disk corresponding to the cache of the tier. The present invention avoids a phenomenon of preempting page resources in the cache.
摘要:
Embodiments of this application disclose a metadata processing method in a storage device and a related device, and belong to the field of computer technologies. The method includes: a network interface card in the storage device receives an IO request, where the IO request includes a data read request or a data write request; the network interface card executes a metadata processing task corresponding to the IO request; and when determining that the metadata processing task fails to be executed, the network interface card requests a CPU in the storage device to execute the metadata processing task. It can be learned that embodiments of this application provide a method in which a network interface card and a CPU adaptively and dynamically execute a metadata processing task. In this way, some metadata processing tasks may be adaptively offloaded from the CPU to the network interface card, so that data processing pressure of the CPU can be reduced, and an excessive delay due to metadata processing by the network interface card can be further avoided. Accordingly, data read/write efficiency of the storage device is improved.
摘要:
A read/write request processing method and apparatus, an electronic device, and a storage medium, which belong to the field of data processing are disclosed. In this method, each terminal is grouped, and different service durations are assigned for all terminal groups, so that a server can process, within any service duration, only a read/write request sent by a terminal in a terminal group corresponding to the service duration, so that quantities of QPs and WQEs that are generated based on the read/write request sent by the terminal in the terminal group are limited, thereby enabling a cache area of a network interface card of the server to store only limited quantities of QPs and WQEs, and further preventing a problem of uneven resource distribution from occurring in the cache area of the network interface card.
摘要:
A storage system, a memory management method, and a management node are provided. The storage system includes a management node, one or more first storage devices, and one or more second storage devices. The management node is configured to create a memory pool to provide a service for storing data. Performance of the first storage device is higher than that of the second storage device, at least one of the one or more first storage devices is located in a first storage node, and at least one of the one or more second storage devices is located in a second storage node. The management node is further configured to control the data to be migrated between the first storage device and the second storage device in the memory pool. The memory pool is created based on storage devices with different performance, and these storage devices with the different performance are located in different storage nodes, thereby implementing a cross-node memory pool that integrates storage devices with different performance.
摘要:
This application provides a data storage method and system, a storage access configuration method, and a related device. The data storage system includes a host, an adapter card, and a storage node. The host establishes a communication connection to the adapter card through a bus, and the storage node establishes a communication connection to the adapter card through a network. The storage node is configured to store data that the host requests to write into a first memory space. The first memory space is a storage space that is provided by the adapter card for the host and that supports memory semantic access. The adapter card writes the data into a second memory space of the storage node, where the adapter card includes a first correspondence between a physical address of the second memory space and an address of the first memory space. In this way, the host does not need to perform protocol conversion when performing data persistence, to improve data persistence efficiency of the storage system.
摘要:
This application discloses a data writing method, a data reading method, an apparatus, a device, a system, and a medium. A network controller performs erasure code encoding on original data, and writes a third quantity of target data blocks in a plurality of obtained target data blocks into a storage node. The network controller reads a first quantity of target data blocks in the third quantity of target data blocks from the storage node, and decodes the read target data blocks. The plurality of target data blocks include a first quantity of original data blocks and a second quantity of check data blocks, two ends of the target data block include same version information, and the third quantity is greater than the first quantity. In this application, computing overheads originally belonging to a central processing unit can be offloaded to the network controller, thereby reducing consumption of the central processing unit, improving data processing efficiency, and ensuring data validity by using the version information included at two ends of the target data block.
摘要:
A service system, and a memory management method and apparatus are provided, and relate to the computer field. In this application, memory load of service nodes in a service system can be balanced, and losses in memory performance and costs can be avoided, so that use performance of memory resources is improved. The service system includes a plurality of service nodes. A memory of at least one of the plurality of service nodes is divided into a local resource and a global resource. The local resource is used to provide memory storage space for a local service node, the global resource of the at least one service node forms a memory pool, and the memory pool is used to provide memory storage space for the plurality of service nodes. When a specific condition is satisfied, at least a part of space in the local resource is transferred to the memory pool, or at least a part of space in the memory pool is transferred to the local resource.
摘要:
A task execution method and a storage device are provided, and pertain to the field of computer technologies. A method for collaboratively processing data by using a plurality of types of processors in a storage device is provided. A central processing unit in the storage device divides a data processing task into a plurality of subtasks, and allocates the subtasks to dedicated processors in the storage device based on attributes of the subtasks. In one aspect, during data processing, the central processing unit is responsible for task decomposition and task scheduling, and the dedicated processors are responsible for executing the subtasks, so that both computing power of the central processing unit and computing power of the dedicated processors are fully utilized. In another aspect, an attribute of a subtask is considered when the subtask is allocated, so that the subtask can be scheduled, based on the attribute of the subtask, to a proper dedicated processor for execution. Therefore, according to the method, data processing efficiency is improved.