公开(公告)号：US20170353536A1

公开(公告)日：2017-12-07

申请号：US15428844

申请日：2017-02-09

Applicant: Google Inc.

Inventor： Alexander Shraer ,  Kfir Lev-Ari ,  Arif Abdulhusein Merchant ,  Vishesh Khemani ,  Atul Adya

IPC: H04L29/08 ,  H04L12/26

CPC classification number: H04L67/1002 ,  G06F9/5066 ,  G06F9/5088 ,  G06F16/00 ,  G06F16/278 ,  G06F2209/5017 ,  H04L43/08 ,  H04L67/148

Abstract: Methods, systems, and apparatus for automatic sharding and load balancing in a distributed data processing system. In one aspect, a method includes determining workload distribution for an application across worker computers and in response to determining a load balancing operation is required: selecting a first worker computer having a highest load measure relative to respective load measure of the other work computers; determining one or more move operations for a partition of data assigned to the first worker computer and a weight for each move operation; and selecting the move operation with a highest weight the selected move operation.