Abstract:
Embodiments of the present invention provide a cluster system with calculation and storage converged, including: a resource server group, where the resource server group includes at least two resource servers, each resource server in the resource server group has at least one of: a calculation resource and a storage resource, at least one resource server in the resource server group has a calculation resource and a storage resource, and the storage resource includes a persistent disk and a cache that corresponds to the persistent disk; and a storage resource control module, configured to construct a shared storage resource pool by using storage resources in the resource server group, so as to provide a storage service, where storage resources included in each storage resource pool are from at least two resource servers in the resource server group.
Abstract:
A distributed storage and replication system includes a MDC module, multiple IO routing modules, and multiple OSD nodes. The MDC module is adapted to configure at least two partition, the IO routing module is adapted to route an IO request to an OSD node, and the OSD node is adapted to execute storage of data corresponding to the IO request. The MDC is configured to determine a faulty OSD node, update a partition view of a partition group that includes a partition on the faulty OSD node, and send an updating notification to a primary OSD node in the updated partition view. The primary OSD node is adapted to process replication of the data corresponding to the IO request. According to embodiments of the present disclosure, processing performance, fault tolerance, and availability of consistency replication are improved.
Abstract:
A distributed storage and replication system includes a MDC module, multiple IO routing modules, and multiple OSD nodes. The MDC module is adapted to configure at least two partition, the IO routing module is adapted to route an IO request to an OSD node, and the OSD node is adapted to execute storage of data corresponding to the IO request. The MDC is configured to determine a faulty OSD node, update a partition view of a partition group that includes a partition on the faulty OSD node, and send an updating notification to a primary OSD node in the updated partition view. The primary OSD node is adapted to process replication of the data corresponding to the IO request. According to embodiments of the present disclosure, processing performance, fault tolerance, and availability of consistency replication are improved.
Abstract:
Embodiments of the present invention provide a method and a system for sharing a storage resource, where storage resources of a hard disk and a storage array are divided into multiple storage partitions and the multiple storage partitions form a shared storage resource pool, a read-write control module is allocated to each storage partition, and global partition information is generated to record a correspondence between each storage partition in the shared storage resource pool and the read-write control module. The embodiments of the present invention implement fast and simple integration of heterogeneous storage resources, and therefore can efficiently use various storage resources, save cost, and avoid a resource waste.
Abstract:
A data storage method is used to improve storage consistency of a distributed storage system. The method includes: a primary storage node performs EC coding on a to-be-stored data segment to obtain a target EC stripe; determines in a storage node group to which the primary storage node belongs, m+k target storage nodes used to store m+k target EC blocks of the target EC stripe; sends a preparation message to the target storage nodes; receives a response message sent by a target storage node; and sends an execution message to the target storage nodes to instruct the target storage nodes to write target EC blocks that are in preparation logs.
Abstract:
A data storage method is used to improve storage consistency of a distributed storage system. The method includes: a primary storage node performs EC coding on a to-be-stored data segment to obtain a target EC stripe; determines in a storage node group to which the primary storage node belongs, m+k target storage nodes used to store m+k target EC blocks of the target EC stripe; sends a preparation message to the target storage nodes; receives a response message sent by a target storage node; and sends an execution message to the target storage nodes to instruct the target storage nodes to write target EC blocks that are in preparation logs.
Abstract:
A data recovery method to improve storage consistency of a distributed storage system includes: receiving a recovery message from a storage node after a fault recovery of the faulty storage node; obtaining N lost erasure coding (EC) blocks of the faulty storage node through computation according to EC blocks stored by non-faulty storage nodes; sequentially sending N lost EC blocks to the faulty storage node for storage. In the process of sequentially sending the N lost EC blocks to the faulty storage node, when it is determined that for a first EC block that is to be stored by the faulty storage node, a second EC block having a same key value as the first EC block exists in the lost EC blocks, after the faulty storage node stores the second EC block, the first EC block is sent to the faulty storage node to store.
Abstract:
Embodiments of the present invention provide a method and a system for sharing a storage resource, where storage resources of a hard disk and a storage array are divided into multiple storage partitions and the multiple storage partitions form a shared storage resource pool, a read-write control module is allocated to each storage partition, and global partition information is generated to record a correspondence between each storage partition in the shared storage resource pool and the read-write control module. The embodiments of the present invention implement fast and simple integration of heterogeneous storage resources, and therefore can efficiently use various storage resources, save cost, and avoid a resource waste.
Abstract:
The present disclosure relates to the field of information technology, and in particular, to a block storage-based data processing method, apparatus, and system. The block storage-based data processing method provided in embodiments of the present disclosure is applied in a system including at least two storage nodes, each storage node including a CPU, a cache medium, and a non-volatile storage medium, and the cache medium in all the storage nodes forming a cache pool. According to the method, after receiving a data operation request sent by a client, a service processing node sends the data operation request to a corresponding storage node in the system according to a logical address carried in the data operation request, so that the data operation request is processed in the cache medium of the storage node under control of the CPU of the storage node.
Abstract:
The storage method according to the present invention includes: partitioning raw data into several data blocks; calculating, according to a preset mapping algorithm, three consecutive virtual storage partitions to which a first data block is mapped, where a virtual storage partition is a partition obtained by dividing a virtual storage area, each of the virtual storage partitions is mapped to one physical disk, physical disks have consecutive sequence numbers, and sequence numbers of three physical disks that are mapped to the three consecutive virtual storage partitions are in an arithmetic sequence with a non-zero common difference; and storing, according to the calculated three consecutive virtual storage partitions and the three physical disks that are mapped to the three consecutive virtual storage partitions, the first data block and a first copy and a second copy of the first data block in the three physical disks in sequence.