公开(公告)号：US20170017527A1

公开(公告)日：2017-01-19

申请号：US15280233

申请日：2016-09-29

Applicant: Amazon Technologies, Inc.

Inventor： AndyGibb Halim ,  Swapneel Patil

IPC: G06F9/52 ,  G06F9/48

CPC classification number: G06F9/52 ,  G06F9/46 ,  G06F9/48 ,  G06F9/4881 ,  G06F9/50

Abstract: A distributed work processing system for processing computational tasks is scalable and fault-tolerant without requiring centralized control. Worker processes running on worker hosts are organized into a logical group and worker coordinators running on worker coordinator hosts coordinate tasks assigned to worker processes. A task store might hold a collection of tasks to be performed by the logical group. A lock database can be used for locking the logical group for coordination by one worker coordinator process at a time. A membership store contains mappings of worker processes to logical groups, and an assignment store indicates which tasks are assigned to which workers. The worker coordinator process has a scanner process to deal with unassigned tasks and deduplicating duplicate assignments. If a worker coordinator does not see enough worker processes, it can instantiate more. If a worker process does not see a worker coordinator, it can instantiate one.

Abstract translation: 用于处理计算任务的分布式工作处理系统是可扩展的和容错的，而不需要集中控制。 在worker主机上运行的worker进程被组织成一个逻辑组，并且在worker协调器主机上运行的worker协调器协调分配给worker进程的任务。 任务存储可能会保存由逻辑组执行的任务集合。 锁定数据库可用于一次由一个工作人员协调程序锁定逻辑组进行协调。 会员存储包含对逻辑组的工作进程的映射，分配存储指示哪些工作分配给哪些工作人员。 工作协调器进程具有处理未分配任务和重复分配重复分配的扫描程序。 如果工作协调器看不到足够的工作进程，则可以实例化更多。 如果一个工作进程没有看到一个工作协调器，它可以实例化一个。

公开(公告)号：US09740537B2

公开(公告)日：2017-08-22

申请号：US15280233

申请日：2016-09-29

Applicant: Amazon Technologies, Inc.

Inventor： AndyGibb Halim ,  Swapneel Patil

IPC: G06F9/52 ,  G06F9/46 ,  G06F9/48 ,  G06F9/50

CPC classification number: G06F9/52 ,  G06F9/46 ,  G06F9/48 ,  G06F9/4881 ,  G06F9/50

Abstract: A distributed work processing system for processing computational tasks is scalable and fault-tolerant without requiring centralized control. Worker processes running on worker hosts are organized into a logical group and worker coordinators running on worker coordinator hosts coordinate tasks assigned to worker processes. A task store might hold a collection of tasks to be performed by the logical group. A lock database can be used for locking the logical group for coordination by one worker coordinator process at a time. A membership store contains mappings of worker processes to logical groups, and an assignment store indicates which tasks are assigned to which workers. The worker coordinator process has a scanner process to deal with unassigned tasks and deduplicating duplicate assignments. If a worker coordinator does not see enough worker processes, it can instantiate more. If a worker process does not see a worker coordinator, it can instantiate one.

公开(公告)号：US09459933B1

公开(公告)日：2016-10-04

申请号：US14619834

申请日：2015-02-11

Applicant: Amazon Technologies, Inc.

Inventor： AndyGibb Halim ,  Swapneel Patil

IPC: G06F9/52 ,  G06F9/46 ,  G06F9/48 ,  G06F9/50

CPC classification number: G06F9/52 ,  G06F9/46 ,  G06F9/48 ,  G06F9/4881 ,  G06F9/50

Abstract: A distributed work processing system for processing computational tasks IS scalable and fault-tolerant without requiring centralized control. Worker processes running on worker hosts and worker coordinators running on worker coordinator hosts interact with a task store that holds a collection of tasks to be performed by a logical group of worker processes, a lock database used for locking the logical group for coordination by one worker coordinator process at a time, a membership store that contains mappings of worker processes to logical groups, and an assignment store indicating which tasks are assigned to which workers. The worker coordinator process has a scanner process to deal with unassigned tasks and deduplicating duplicate assignments. If a worker coordinator does not see enough worker processes, it can instantiate more. If a worker process does not see a worker coordinator, it can instantiate one.

Abstract translation: 用于处理计算任务的分布式工作处理系统是可扩展的和容错的，而不需要集中控制。 在工作主机和运行在工作协调器主机上的工作协调器上运行的工作进程与一个任务存储进行交互，该任务存储包含要由逻辑组的工作进程执行的任务集合，用于锁定逻辑组以供一个工作人员进行协调的锁定数据库 协调程序进程，一个包含工作进程到逻辑组的映射的成员存储，以及一个分配存储，指示哪些工作分配给哪些工作。 工作协调器进程具有处理未分配任务和重复分配重复分配的扫描程序。 如果工作协调器看不到足够的工作进程，则可以实例化更多。 如果一个工作进程没有看到一个工作协调器，它可以实例化一个。