公开(公告)号：US09621636B1

公开(公告)日：2017-04-11

申请号：US14023208

申请日：2013-09-10

Applicant: Google Inc.

Inventor： Samuel Green McVeety ,  Vyacheslav Alekseyevich Chernyak

IPC: G06F15/16 ,  H04L29/08

CPC classification number: H04L67/10 ,  G06F9/5083 ,  H04L67/32

Abstract: Methods, systems, and apparatus are described for throttling a distributed processing system. In one aspect, a method includes identifying records being processed by a distributed processing system that performs agent processes, each of the records including a corresponding timestamp; determining, based on timestamps of the records that have been processed by a first agent process, a first agent progress; identifying a dependent agent process performed by the distributed processing system, wherein the dependent agent process processes only records that have been processed by the first agent process; determining, based on timestamps of records that have been processed by the dependent agent process, a dependent agent progress; and throttling performance of the first process based on the first agent progress and the dependent agent progress.

公开(公告)号：US20170255491A1

公开(公告)日：2017-09-07

申请号：US15395225

申请日：2016-12-30

Applicant: Google Inc.

Inventor： Robert Bradshaw ,  Rafael de Jesús Fernández Moctezuma ,  Daniel Mills ,  Samuel Green McVeety ,  Samuel Carl Whittle ,  Andrei Maksimenka ,  Cosmin Ionel Arad ,  Mark Brian Shields ,  Harris Samuel Nover ,  Manuel Alfred Fahndrich ,  Jeffrey Paul Gardner ,  Mikhail Shmulyan ,  Reuven Lax ,  Ahmet Altay ,  Craig D. Chambers

IPC: G06F9/50

Abstract: A job that receives as input a data stream is executed. For the job, it is iteratively determined a backlog growth over a first period of time; a backlog volume; and whether to adjust a quantity of processing resources. For each iteration for which the quantity of processing resources allocated to the job are determined to be adjusted, adjusting the quantity of processing resources allocated to the job. For each iteration for which the quantity of processing resources allocated to the job are determined not to be adjusted, maintaining the quantity of processing resources allocated to the job.