公开(公告)号：US10831737B2

公开(公告)日：2020-11-10

申请号：US15814141

申请日：2017-11-15

Applicant: Huawei Technologies Co., Ltd.

Inventor： Tieying Wang ,  Zhe Liu ,  Ke Shen

IPC: G06F16/00 ,  G06F16/22 ,  G06F16/27 ,  G06F12/1009 ,  G06F12/1027

Abstract: A method for partitioning an association table in a distributed database, where a manager determines a first data table in data tables requiring partition and generates a colocation partition (CP) table set of the first data table, the CP table set of the first data table includes the first data table and at least one CP table of the first data table, and a CP table of the first data table includes a data table whose partition key includes a subset of a partition key of the first data table. The manager partitions the first data table according to the partition key and partitions each CP table in the CP table set, a partition range of a partition key of each CP table is the same as a partition range of a corresponding partition key in the first data table.

公开(公告)号：US10348827B2

公开(公告)日：2019-07-09

申请号：US14983853

申请日：2015-12-30

Applicant: Huawei Technologies Co., Ltd.

Inventor： Zhe Liu ,  Ke Shen

IPC: H04L29/08 ,  H04L12/741 ,  H04L12/743 ,  H04L12/751 ,  H04L12/803

Abstract: Disclosed are a distributed storage system, a cluster node, and a range management method thereof, including: partitioning, by the cluster node according to a configuration parameter, a range corresponding to a first routing table entry in a local routing table into at least two subranges, where the first routing table entry refers to a routing table entry in which information that indicates the cluster node is recorded in replica information; separately establishing, by the cluster node, a log queue for each of the subranges; determining, by the cluster node, a corresponding subrange according to a key field of a data operation request from a client; executing a corresponding data read/write operation according to the determined subrange; and updating, according to the data read/write operation, a log queue corresponding to the determined subrange.

公开(公告)号：US20160112516A1

公开(公告)日：2016-04-21

申请号：US14983853

申请日：2015-12-30

Applicant: Huawei Technologies Co., Ltd.

Inventor： Zhe Liu ,  Ke Shen

IPC: H04L29/08 ,  H04L12/743 ,  H04L12/803 ,  H04L12/741 ,  H04L12/751

CPC classification number: H04L67/1097 ,  H04L45/02 ,  H04L45/54 ,  H04L45/7453 ,  H04L47/125 ,  H04L67/1095 ,  H04L67/32

Abstract: Disclosed are a distributed storage system, a cluster node, and a range management method thereof, including: partitioning, by the cluster node according to a configuration parameter, a range corresponding to a first routing table entry in a local routing table into at least two subranges, where the first routing table entry refers to a routing table entry in which information that indicates the cluster node is recorded in replica information; separately establishing, by the cluster node, a log queue for each of the subranges; determining, by the cluster node, a corresponding subrange according to a key field of a data operation request from a client; executing a corresponding data read/write operation according to the determined subrange; and updating, according to the data read/write operation, a log queue corresponding to the determined subrange.

Abstract translation: 公开了一种分布式存储系统，集群节点及其范围管理方法，包括：根据配置参数将集群节点与本地路由表中的第一路由表项对应的范围划分为至少两个 子路由，其中​​第一路由表条目涉及路由表条目，其中指示群集节点的信息被记录在副本信息中; 由群集节点单独建立每个子范围的日志队列; 根据来自客户端的数据操作请求的关键字段，由所述集群节点确定相应的子范围; 根据确定的子范围执行相应的数据读/写操作; 并且根据数据读/写操作更新与所确定的子范围对应的日志队列。

公开(公告)号：US11226986B2

公开(公告)日：2022-01-18

申请号：US15853952

申请日：2017-12-25

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Zhe Liu ,  Ke Shen ,  Tieying Wang

IPC: G06F16/27 ,  G06F16/25 ,  G06F16/22

Abstract: A data table partitioning management method and apparatus are disclosed. The method includes: determining a type and a join key of each data table in a table group, where the type of the data table includes a one-dimensional table, a multidimensional table, or a fact table; and performing one-dimensional partitioning on row replica space of each data table in the table group, and performing one-dimensional or multidimensional partitioning on column replica space of the data table according to the type of the data table and based on the join key of the data table. Different partitioning management methods are applied to data tables of different types and different dimensions, so that data processing mechanisms of OLTP and OLAP are efficiently implemented in a system, and resource consumption is reduced.

公开(公告)号：US20180075077A1

公开(公告)日：2018-03-15

申请号：US15814141

申请日：2017-11-15

Applicant: Huawei Technologies Co., Ltd.

Inventor： Tieying Wang ,  Zhe Liu ,  Ke Shen

IPC: G06F17/30 ,  G06F12/1027 ,  G06F12/1009

CPC classification number: G06F16/2282 ,  G06F12/1009 ,  G06F12/1027 ,  G06F16/27 ,  G06F2212/65 ,  G06F2212/68

Abstract: A method for partitioning an association table in a distributed database, where a manager determines a first data table in data tables requiring partition and generates a colocation partition (CP) table set of the first data table, the CP table set of the first data table includes the first data table and at least one CP table of the first data table, and a CP table of the first data table includes a data table whose partition key includes a subset of a partition key of the first data table. The manager partitions the first data table according to the partition key and partitions each CP table in the CP table set, a partition range of a partition key of each CP table is the same as a partition range of a corresponding partition key in the first data table.

公开(公告)号：US20160105502A1

公开(公告)日：2016-04-14

申请号：US14974368

申请日：2015-12-18

Applicant: Huawei Technologies Co., Ltd.

Inventor： Ke Shen

IPC: H04L29/08 ,  H04L12/751 ,  H04L12/721

CPC classification number: H04L67/1065 ,  H04L45/02 ,  H04L45/44 ,  H04L67/1063 ,  H04L67/1095 ,  H04L69/40

Abstract: A data synchronization method, a data synchronization apparatus, and a distributed system are disclosed. A management node acquires a route update message that instructs to update routing information of the first data center and the second data center, where the routing information includes at least identification information of the first data center and the second data center, and backup routing information of nodes in the first data center and the second data center; the management node adjusts the routing information of the first data center and the second data center according to the route update message; and the management node synchronizes adjusted routing information of the first data center and the second data center to the first data center and the second data center, so that the first data center and the second data center perform, based on the adjusted routing information, synchronous transmission on data of managed nodes.

Abstract translation: 公开了数据同步方法，数据同步装置和分布式系统。 管理节点获取指示更新第一数据中心和第二数据中心的路由信息​​的路由更新消息，其中路由信息至少包括第一数据中心和第二数据中心的识别信息，以及备用路由信息 第一数据中心和第二数据中心中的节点; 管理节点根据路由更新消息来调整第一数据中心和第二数据中心的路由信息​​; 并且所述管理节点将所述第一数据中心和所述第二数据中心的经调整的路由信息​​同步到所述第一数据中心和所述第二数据中心，使得所述第一数据中心和所述第二数据中心基于所述经调整的路由信息​​进行同步 对受管节点数据的传输。