公开(公告)号：US09424083B2

公开(公告)日：2016-08-23

申请号：US14211660

申请日：2014-03-14

Applicant: Google Inc.

Inventor： Kenneth J. Goldman ,  Sunghwan Ihm ,  Xiaozhou Li ,  Jelena Pjesivac-Grbovic

IPC: G06F9/46 ,  G06F9/48 ,  G06F9/50 ,  G06F9/54

CPC classification number: G06F9/5083 ,  G06F9/4881 ,  G06F9/50 ,  G06F9/542 ,  G06F2009/4557

Abstract: Methods, systems, and apparatus are described for managing metadata for a distributed processing system. In one aspect, a method includes receiving a computation specification that includes a set of grains that specifies an initial state for a computation that is to be performed by a distributed processing system, wherein each grain comprises metadata that specifies a portion of the initial state for the computation; storing a grain hierarchy that represents a state for the computation based on a grain type associated with each grain, the grain hierarchy comprising subscription grains for subscriptions for the grain hierarchy, each subscription corresponding to one or more grains included in the grain hierarchy, and each subscription specifying one or more actions to be performed by the hub device; and performing, during performance of the computation, at least one of the actions specified by at least one of the subscriptions.

Abstract translation: 描述了用于管理分布式处理系统的元数据的方法，系统和装置。 一方面，一种方法包括接收计算规范，该计算规范包括指定要由分布式处理系统执行的计算的初始状态的一组粒子，其中每个粒子包括指定初始状态的一部分的元数据， 计算; 存储基于与每个粒度相关联的粒度类型的用于计算的状态的粒度层次，所述粒度层次包括用于粒度层次结构的订阅的订阅粒子，对应于包括在粒度层级中的一个或多个粒子的每个订阅，以及每个 指定要由所述集线器设备执行的一个或多个动作; 以及在执行所述计算期间执行至少一个所述订阅指定的动作中的至少一个。

公开(公告)号：US20160357613A1

公开(公告)日：2016-12-08

申请号：US15240785

申请日：2016-08-18

Applicant: Google Inc.

Inventor： Kenneth J. Goldman ,  Sunghwan Ihm ,  Xiaozhou Li ,  Jelena Pjesivac-Grbovic

IPC: G06F9/50

CPC classification number: G06F9/5083 ,  G06F9/4881 ,  G06F9/50 ,  G06F9/542 ,  G06F2009/4557

Abstract: A manager agent access a grain hierarchy that represents a state for a computation that is to performed by a distributed processing system, wherein the grain hierarchy includes manager agent grains including metadata for manager agent processes that manage the performance of the computation by the distributed processing system, and worker agent grains including, for tasks to be performed by the distributed processing system, metadata for worker agents that each correspond to a subset of the plurality of data processors for performing the task. A manager agent performs processes defined by a manager agent grain to manage the computation by worker agents and storing, within the grain, metadata describing the manager agent process performed by the manager agent, and worker agents perform tasks assigned to the worker agents based on an assignment of a respective worker agent grain to the worker agent.

Abstract translation: 管理者代理访问表示要由分布式处理系统执行的计算的状态的粒度层次，其中，粒度层次结构包括管理代理粒子，包括管理代理进程的元数据，管理者代理进程管理由分布式处理系统执行计算 以及工作代理粒子，包括对于由分布式处理系统执行的任务，每个对应于用于执行任务的多个数据处理器的子集的工作代理的元数据。 管理者代理执行由管理器代理粒子定义的进程以由工作代理管理计算，并且在谷物内存储描述由管理器代理执行的管理器代理进程的元数据，并且工作代理基于 将工作人员粮食分配给工人代理。

公开(公告)号：US20150261570A1

公开(公告)日：2015-09-17

申请号：US14211660

申请日：2014-03-14

Applicant: Google Inc.

Inventor： Kenneth J. Goldman ,  Sunghwan Ihm ,  Xiaozhou Li ,  Jelena Pjesivac-Grbovic

IPC: G06F9/48

CPC classification number: G06F9/5083 ,  G06F9/4881 ,  G06F9/50 ,  G06F9/542 ,  G06F2009/4557

Abstract: Methods, systems, and apparatus are described for managing metadata for a distributed processing system. In one aspect, a method includes receiving a computation specification that includes a set of grains that specifies an initial state for a computation that is to be performed by a distributed processing system, wherein each grain comprises metadata that specifies a portion of the initial state for the computation; storing a grain hierarchy that represents a state for the computation based on a grain type associated with each grain, the grain hierarchy comprising subscription grains for subscriptions for the grain hierarchy, each subscription corresponding to one or more grains included in the grain hierarchy, and each subscription specifying one or more actions to be performed by the hub device; and performing, during performance of the computation, at least one of the actions specified by at least one of the subscriptions.

Abstract translation: 描述了用于管理分布式处理系统的元数据的方法，系统和装置。 一方面，一种方法包括接收计算规范，该计算规范包括指定要由分布式处理系统执行的计算的初始状态的一组粒子，其中每个粒子包括指定初始状态的一部分的元数据， 计算; 存储表示基于与每个颗粒相关联的颗粒类型的用于计算的状态的颗粒层次，所述颗粒层级包括用于颗粒层次结构的订阅的订阅颗粒，对应于包括在颗粒层次中的一个或多个颗粒的每个订阅，以及每个 指定要由所述集线器设备执行的一个或多个动作; 以及在执行所述计算期间执行至少一个所述订阅指定的动作中的至少一个。