公开(公告)号：US09826031B2

公开(公告)日：2017-11-21

申请号：US14885776

申请日：2015-10-16

Applicant: Amazon Technologies, Inc.

Inventor： Peter Sirota ,  Richendra Khanna ,  Ian P. Nowland ,  Richard J. Cole ,  Jai Vasanth ,  Andrew J. Hitchcock ,  Luis Felipe Cabrera

IPC: G06F15/16 ,  H04L29/08 ,  G06F9/48

CPC classification number: H04L67/1008 ,  G06F9/485 ,  H04L29/08135 ,  H04L67/16

Abstract: Techniques are described for managing distributed execution of programs. In some situations, the techniques include determining configuration information to be used for executing a particular program in a distributed manner on multiple computing nodes and/or include providing information and associated controls to a user regarding ongoing distributed execution of one or more programs to enable the user to modify the ongoing distributed execution in various manners. Determined configuration information may include, for example, configuration parameters such as a quantity of computing nodes and/or other measures of computing resources to be used for the executing, and may be determined in various manners, including by interactively gathering values for at least some types of configuration information from an associated user (e.g., via a GUI that is displayed to the user) and/or by automatically determining values for at least some types of configuration information (e.g., for use as recommendations to a user).

公开(公告)号：US11263084B2

公开(公告)日：2022-03-01

申请号：US15867516

申请日：2018-01-10

Applicant: Amazon Technologies, Inc.

Inventor： Peter Sirota ,  Ian P. Nowland ,  Richard J. Cole ,  Richendra Khanna ,  Luis Felipe Cabrera

IPC: G06F15/173 ,  G06F11/14 ,  G06F9/48

Abstract: Techniques are described for managing distributed execution of programs. In at least some situations, the techniques include decomposing or otherwise separating the execution of a program into multiple distinct execution jobs that may each be executed on a distinct computing node, such as in a parallel manner with each execution job using a distinct subset of input data for the program. In addition, the techniques may include temporarily terminating and later resuming execution of at least some execution jobs, such as by persistently storing an intermediate state of the partial execution of an execution job, and later retrieving and using the stored intermediate state to resume execution of the execution job from the intermediate state. Furthermore, the techniques may be used in conjunction with a distributed program execution service that executes multiple programs on behalf of multiple customers or other users of the service.

公开(公告)号：US10901791B2

公开(公告)日：2021-01-26

申请号：US16399608

申请日：2019-04-30

Applicant: Amazon Technologies, Inc.

Inventor： James P. Bartlett ,  Richard J. Cole ,  Adam D. Gray ,  Peter Sirota

IPC: G06F9/50 ,  G06Q10/10 ,  H04L12/24 ,  G06Q10/06

Abstract: Techniques are described for providing clients with access to functionality for creating, configuring and executing defined workflows that manipulate source data in defined manners, such as under the control of a configurable workflow service that is available to multiple remote clients over one or more public networks. A defined workflow for a client may, for example, include multiple interconnected workflow components that are specified by the client and that each are configured to perform one or more types of data manipulation operations on a specified type of input data. The configurable workflow service may further execute the defined workflow at one or more times and in one or more manners, such as in some situations by provisioning multiple computing nodes provided by the configurable workflow service to each implement at least one of the workflow components for the defined workflow.

公开(公告)号：US20160100001A1

公开(公告)日：2016-04-07

申请号：US14885776

申请日：2015-10-16

Applicant: Amazon Technologies, Inc.

Inventor： Peter Sirota ,  Richendra Khanna ,  Ian P. Nowland ,  Richard J. Cole ,  Jai Vasanth ,  Andrew J. Hitchcock ,  Luis Felipe Cabrera

IPC: H04L29/08

CPC classification number: H04L67/1008 ,  G06F9/485 ,  H04L29/08135 ,  H04L67/16

Abstract: Techniques are described for managing distributed execution of programs. In some situations, the techniques include determining configuration information to be used for executing a particular program in a distributed manner on multiple computing nodes and/or include providing information and associated controls to a user regarding ongoing distributed execution of one or more programs to enable the user to modify the ongoing distributed execution in various manners. Determined configuration information may include, for example, configuration parameters such as a quantity of computing nodes and/or other measures of computing resources to be used for the executing, and may be determined in various manners, including by interactively gathering values for at least some types of configuration information from an associated user (e.g., via a GUI that is displayed to the user) and/or by automatically determining values for at least some types of configuration information (e.g., for use as recommendations to a user).

Abstract translation: 描述了用于管理程序的分布式执行的技术。 在某些情况下，技术包括确定用于在多个计算节点上以分布式方式执行特定程序的配置信息和/或包括向用户提供关于一个或多个程序的正在进行的分布式执行的信息和相关控制，以使能 用户以各种方式修改正在进行的分布式执行。 确定的配置信息可以包括例如诸如计算节点的数量的配置参数和/或要用于执行的计算资源的其他度量，并且可以以各种方式来确定，包括通过交互地收集至少一些 来自相关用户的配置信息的类型（例如，经由显示给用户的GUI）和/或通过自动确定至少一些类型的配置信息（例如，用作对用户的建议）的值。

公开(公告)号：US09207975B2

公开(公告)日：2015-12-08

申请号：US14338150

申请日：2014-07-22

Applicant: Amazon Technologies, Inc.

Inventor： Peter Sirota ,  Richendra Khanna ,  Ian P. Nowland ,  Richard J. Cole ,  Jai Vasanth ,  Andrew J. Hitchcock ,  Luis Felipe Cabrera

IPC: G06F15/16 ,  G06F9/48

CPC classification number: H04L67/1008 ,  G06F9/485 ,  H04L29/08135 ,  H04L67/16

Abstract: Techniques are described for managing distributed execution of programs. In some situations, the techniques include determining configuration information to be used for executing a particular program in a distributed manner on multiple computing nodes and/or include providing information and associated controls to a user regarding ongoing distributed execution of one or more programs to enable the user to modify the ongoing distributed execution in various manners. Determined configuration information may include, for example, configuration parameters such as a quantity of computing nodes and/or other measures of computing resources to be used for the executing, and may be determined in various manners, including by interactively gathering values for at least some types of configuration information from an associated user (e.g., via a GUI that is displayed to the user) and/or by automatically determining values for at least some types of configuration information (e.g., for use as recommendations to a user).

Abstract translation: 描述了用于管理程序的分布式执行的技术。 在某些情况下，技术包括确定用于在多个计算节点上以分布式方式执行特定程序的配置信息和/或包括向用户提供关于一个或多个程序的正在进行的分布式执行的信息和相关控制，以使能 用户以各种方式修改正在进行的分布式执行。 确定的配置信息可以包括例如诸如计算节点的数量的配置参数和/或要用于执行的计算资源的其他度量，并且可以以各种方式来确定，包括通过交互地收集至少一些 来自相关用户的配置信息的类型（例如，经由显示给用户的GUI）和/或通过自动确定至少一些类型的配置信息（例如，用作对用户的推荐）的值。

公开(公告)号：US08935404B2

公开(公告)日：2015-01-13

申请号：US13737815

申请日：2013-01-09

Applicant: Amazon Technologies, Inc.

Inventor： Peter Sirota ,  Ian P. Nowland ,  Richard J. Cole ,  Richendra Khanna ,  Luis Felipe Cabrera

IPC: G06F15/173 ,  G06F9/48

CPC classification number: G06F11/1451 ,  G06F9/4806 ,  G06F9/485 ,  G06F11/1469

Abstract: Techniques are described for managing distributed execution of programs. In at least some situations, the techniques include decomposing or otherwise separating the execution of a program into multiple distinct execution jobs that may each be executed on a distinct computing node, such as in a parallel manner with each execution job using a distinct subset of input data for the program. In addition, the techniques may include temporarily terminating and later resuming execution of at least some execution jobs, such as by persistently storing an intermediate state of the partial execution of an execution job, and later retrieving and using the stored intermediate state to resume execution of the execution job from the intermediate state. Furthermore, the techniques may be used in conjunction with a distributed program execution service that executes multiple programs on behalf of multiple customers or other users of the service.

Abstract translation: 描述了用于管理程序的分布式执行的技术。 在至少一些情况下，这些技术包括将程序的执行分解或以其他方式分离成可以在不同的计算节点上执行的多个不同的执行作业，例如以每个执行作业使用不同的输入子集的并行方式 程序数据。 此外，这些技术可以包括临时终止和稍后恢复至少一些执行作业的执行，例如通过持续地存储执行作业的部分执行的中间状态，以及稍后检索和使用存储的中间状态来恢复执行 执行作业从中间状态。 此外，这些技术可以与代表多个客户或服务的其他用户执行多个程序的分布式程序执行服务结合使用。

公开(公告)号：US11425194B1

公开(公告)日：2022-08-23

申请号：US17128746

申请日：2020-12-21

Applicant: Amazon Technologies, Inc.

Inventor： Richendra Khanna ,  Peter Sirota ,  Ian P. Nowland ,  Richard J. Cole ,  Jai Vasanth ,  Andrew J. Hitchcock ,  Luis Felipe Cabrera

IPC: G06F15/16 ,  H04L67/1029 ,  G06F9/50

Abstract: Techniques are described for managing distributed execution of programs. In some situations, the techniques include dynamically modifying the distributed program execution in various manners, such as based on monitored status information. The dynamic modifying of the distributed program execution may include adding and/or removing computing nodes from a cluster that is executing the program, modifying the amount of computing resources that are available for the distributed program execution, terminating or temporarily suspending execution of the program (e.g., if an insufficient quantity of computing nodes of the cluster are available to perform execution), etc.

公开(公告)号：US20180165348A1

公开(公告)日：2018-06-14

申请号：US15893468

申请日：2018-02-09

Applicant: Amazon Technologies, Inc.

Inventor： Richard J. Cole ,  Alan D. Mock

IPC: G06F17/30

CPC classification number: G06F16/283 ,  G06F16/2255 ,  G06F16/24556

Abstract: Techniques are described for managing aggregation of data in a distributed manner, such as for a particular client based on specified configuration information. The described techniques may include storing aggregated data values for an OLAP cube or other data structure in a distributed manner, such as in some situations in a distributed hash table. The aggregated data values to be stored may be generated in various manners, such as by performing multi-stage data manipulation operations—for example, a map-reduce architecture may be used, with a first stage involving the use of one or more specified map functions to be performed, and with at least a second stage involving the use of one or more specified reduce functions to be performed.

公开(公告)号：US20180129570A1

公开(公告)日：2018-05-10

申请号：US15867516

申请日：2018-01-10

Applicant: Amazon Technologies, Inc.

Inventor： Peter Sirota ,  Ian P. Nowland ,  Richard J. Cole ,  Richendra Khanna ,  Luis Felipe Cabrera

IPC: G06F11/14 ,  G06F9/48

CPC classification number: G06F11/1451 ,  G06F9/4806 ,  G06F9/485 ,  G06F11/1469

Abstract: Techniques are described for managing distributed execution of programs. In at least some situations, the techniques include decomposing or otherwise separating the execution of a program into multiple distinct execution jobs that may each be executed on a distinct computing node, such as in a parallel manner with each execution job using a distinct subset of input data for the program. In addition, the techniques may include temporarily terminating and later resuming execution of at least some execution jobs, such as by persistently storing an intermediate state of the partial execution of an execution job, and later retrieving and using the stored intermediate state to resume execution of the execution job from the intermediate state. Furthermore, the techniques may be used in conjunction with a distributed program execution service that executes multiple programs on behalf of multiple customers or other users of the service.

公开(公告)号：US20150169412A1

公开(公告)日：2015-06-18

申请号：US14571093

申请日：2014-12-15

Applicant: Amazon Technologies, Inc.

Inventor： Peter Sirota ,  Ian P. Nowland ,  Richard J. Cole ,  Richendra Khanna ,  Luis Felipe Cabrera

IPC: G06F11/14

CPC classification number: G06F11/1451 ,  G06F9/4806 ,  G06F9/485 ,  G06F11/1469

Abstract: Techniques are described for managing distributed execution of programs. In at least some situations, the techniques include decomposing or otherwise separating the execution of a program into multiple distinct execution jobs that may each be executed on a distinct computing node, such as in a parallel manner with each execution job using a distinct subset of input data for the program. In addition, the techniques may include temporarily terminating and later resuming execution of at least some execution jobs, such as by persistently storing an intermediate state of the partial execution of an execution job, and later retrieving and using the stored intermediate state to resume execution of the execution job from the intermediate state. Furthermore, the techniques may be used in conjunction with a distributed program execution service that executes multiple programs on behalf of multiple customers or other users of the service.

Abstract translation: 描述了用于管理程序的分布式执行的技术。 在至少一些情况下，这些技术包括将程序的执行分解或以其他方式分离成可以在不同的计算节点上执行的多个不同的执行作业，例如以每个执行作业使用不同的输入子集的并行方式 程序数据。 此外，这些技术可以包括临时终止和稍后恢复至少一些执行作业的执行，例如通过持续地存储执行作业的部分执行的中间状态，以及稍后检索和使用存储的中间状态来恢复执行 执行作业从中间状态。 此外，这些技术可以与代表多个客户或服务的其他用户执行多个程序的分布式程序执行服务结合使用。