公开(公告)号：US09710331B2

公开(公告)日：2017-07-18

申请号：US15173327

申请日：2016-06-03

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Daohui Wang ,  Feng Zhang ,  Wei Fan ,  Zhile Zhang ,  Yongqiang Zeng

IPC: G06F11/00 ,  G06F11/10 ,  G06F3/06 ,  G06F9/46 ,  G06F9/50

CPC classification number: G06F11/1076 ,  G06F3/0617 ,  G06F3/0619 ,  G06F3/0631 ,  G06F3/064 ,  G06F3/067 ,  G06F9/466 ,  G06F9/5011 ,  G06F11/00

Abstract: A data storage method is used to improve storage consistency of a distributed storage system. The method includes: a primary storage node performs EC coding on a to-be-stored data segment to obtain a target EC stripe; determines in a storage node group to which the primary storage node belongs, m+k target storage nodes used to store m+k target EC blocks of the target EC stripe; sends a preparation message to the target storage nodes; receives a response message sent by a target storage node; and sends an execution message to the target storage nodes to instruct the target storage nodes to write target EC blocks that are in preparation logs.

公开(公告)号：US20160357634A1

公开(公告)日：2016-12-08

申请号：US15173327

申请日：2016-06-03

Applicant: HUAWEI TECHNOLOGIES CO.,LTD.

Inventor： Daohui Wang ,  Feng Zhang ,  Wei Fan ,  Zhile Zhang ,  Yongqiang Zeng

IPC: G06F11/10 ,  G06F3/06

CPC classification number: G06F11/1076 ,  G06F3/0617 ,  G06F3/0619 ,  G06F3/0631 ,  G06F3/064 ,  G06F3/067 ,  G06F9/466 ,  G06F9/5011 ,  G06F11/00

Abstract: A data storage method is used to improve storage consistency of a distributed storage system. The method includes: a primary storage node performs EC coding on a to-be-stored data segment to obtain a target EC stripe; determines in a storage node group to which the primary storage node belongs, m+k target storage nodes used to store m+k target EC blocks of the target EC stripe; sends a preparation message to the target storage nodes; receives a response message sent by a target storage node; and sends an execution message to the target storage nodes to instruct the target storage nodes to write target EC blocks that are in preparation logs.

Abstract translation: 数据存储方法用于提高分布式存储系统的存储一致性。 该方法包括：主存储节点对待存储的数据段执行EC编码以获得目标EC条带; 在主存储节点所属的存储节点组中确定m + k个目标存储节点，用于存储目标EC条带的m + k个目标EC块; 向目标存储节点发送准备消息; 接收目标存储节点发送的响应消息; 并向目标存储节点发送执行消息以指示目标存储节点写入准备日志中的目标EC块。

公开(公告)号：US20180074898A1

公开(公告)日：2018-03-15

申请号：US15817298

申请日：2017-11-20

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Daohui Wang ,  Feng Zhang ,  Wei Fan ,  Zhile Zhang ,  Yongqiang Zeng

IPC: G06F11/10 ,  G06F3/06 ,  G06F9/50 ,  G06F11/00 ,  G06F9/46

CPC classification number: G06F11/1076 ,  G06F3/0617 ,  G06F3/0619 ,  G06F3/0631 ,  G06F3/064 ,  G06F3/067 ,  G06F9/466 ,  G06F9/5011 ,  G06F11/00

Abstract: A data storage method is used to improve storage consistency of a distributed storage system. The method includes: a primary storage node performs EC coding on a to-be-stored data segment to obtain a target EC stripe; determines in a storage node group to which the primary storage node belongs, m+k target storage nodes used to store m+k target EC blocks of the target EC stripe; sends a preparation message to the target storage nodes; receives a response message sent by a target storage node; and sends an execution message to the target storage nodes to instruct the target storage nodes to write target EC blocks that are in preparation logs.

公开(公告)号：US20170255522A1

公开(公告)日：2017-09-07

申请号：US15603413

申请日：2017-05-23

Applicant: HUAWEI TECHNOLOGIES CO.,LTD.

Inventor： Daohui Wang ,  Feng Zhang ,  Wei Fan ,  Zhile Zhang ,  Yongqiang Zeng

IPC: G06F11/10 ,  G06F9/46 ,  G06F3/06 ,  G06F9/50

CPC classification number: G06F11/1076 ,  G06F3/0617 ,  G06F3/0619 ,  G06F3/0631 ,  G06F3/064 ,  G06F3/067 ,  G06F9/466 ,  G06F9/5011 ,  G06F11/00

Abstract: A data recovery method to improve storage consistency of a distributed storage system includes: receiving a recovery message from a storage node after a fault recovery of the faulty storage node; obtaining N lost erasure coding (EC) blocks of the faulty storage node through computation according to EC blocks stored by non-faulty storage nodes; sequentially sending N lost EC blocks to the faulty storage node for storage. In the process of sequentially sending the N lost EC blocks to the faulty storage node, when it is determined that for a first EC block that is to be stored by the faulty storage node, a second EC block having a same key value as the first EC block exists in the lost EC blocks, after the faulty storage node stores the second EC block, the first EC block is sent to the faulty storage node to store.

公开(公告)号：US10133633B2

公开(公告)日：2018-11-20

申请号：US15817298

申请日：2017-11-20

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Daohui Wang ,  Feng Zhang ,  Wei Fan ,  Zhile Zhang ,  Yongqiang Zeng

IPC: G06F11/00 ,  G06F11/10 ,  G06F3/06 ,  G06F9/46 ,  G06F9/50

Abstract: A data storage method is used to improve storage consistency of a distributed storage system. The method includes: a primary storage node performs EC coding on a to-be-stored data segment to obtain a target EC stripe; determines in a storage node group to which the primary storage node belongs, m+k target storage nodes used to store m+k target EC blocks of the target EC stripe; sends a preparation message to the target storage nodes; receives a response message sent by a target storage node; and sends an execution message to the target storage nodes to instruct the target storage nodes to write target EC blocks that are in preparation logs.

公开(公告)号：US09823970B2

公开(公告)日：2017-11-21

申请号：US15603413

申请日：2017-05-23

Applicant: HUAWEI TECHNOLOGIES CO.,LTD.

Inventor： Daohui Wang ,  Feng Zhang ,  Wei Fan ,  Zhile Zhang ,  Yongqiang Zeng

IPC: G06F11/00 ,  G06F11/10 ,  G06F3/06 ,  G06F9/50 ,  G06F9/46

CPC classification number: G06F11/1076 ,  G06F3/0617 ,  G06F3/0619 ,  G06F3/0631 ,  G06F3/064 ,  G06F3/067 ,  G06F9/466 ,  G06F9/5011 ,  G06F11/00

Abstract: A data recovery method to improve storage consistency of a distributed storage system includes: receiving a recovery message from a storage node after a fault recovery of the faulty storage node; obtaining N lost erasure coding (EC) blocks of the faulty storage node through computation according to EC blocks stored by non-faulty storage nodes; sequentially sending N lost EC blocks to the faulty storage node for storage. In the process of sequentially sending the N lost EC blocks to the faulty storage node, when it is determined that for a first EC block that is to be stored by the faulty storage node, a second EC block having a same key value as the first EC block exists in the lost EC blocks, after the faulty storage node stores the second EC block, the first EC block is sent to the faulty storage node to store.

公开(公告)号：US20160357440A1

公开(公告)日：2016-12-08

申请号：US15171794

申请日：2016-06-02

Applicant: HUAWEI TECHNOLOGIES CO.,LTD.

Inventor： Daohui Wang ,  Feng Zhang ,  Wei Fan ,  Zhile Zhang ,  Yongqiang Zeng

IPC: G06F3/06

CPC classification number: G06F3/064 ,  G06F3/0604 ,  G06F3/0611 ,  G06F3/0619 ,  G06F3/0631 ,  G06F3/0644 ,  G06F3/067

Abstract: A data distribution method for improving performance of a distributed storage system includes: receiving, by a data distribution apparatus, a storage instruction of a user, dividing to-be-stored data that the storage instruction instructs to store, into P data segments, determining a storage node group corresponding to each data segment, and finally distributing the data segment to a primary node in the corresponding storage node group.

Abstract translation: 一种用于提高分布式存储系统的性能的数据分配方法，包括：由数据分配装置将用户的存储指令，存储指令指示存储的存储数据分割成P个数据段，确定 对应于每个数据段的存储节点组，并且最后将数据段分配到相应存储节点组中的主节点。