-
公开(公告)号:US08812752B1
公开(公告)日:2014-08-19
申请号:US13764711
申请日:2013-02-11
Applicant: Amazon Technologies, Inc.
Inventor: Kathryn Marie Shih , Eider Brantly Moore , Richard Rex McKnight , Vaibhav Aggarwal , Peter Sirota , Richard Jeffrey Cole , James P. Bartlett , Carl Louis Christofferson
CPC classification number: G06F9/52 , G06F9/542 , G06Q10/063
Abstract: Methods and systems for a connector interface in a data pipeline are disclosed. A pipeline comprising two data source nodes and an activity node is configured. Each data source node represents data from a different data source, and the activity node represents a workflow activity that uses the data as input. Two connectors which implement the same connector interface are triggered. In response, data is acquired at each connector from the corresponding data source through the connector interface. The data is sent from the connectors to the activity node through the connector interface. The workflow activity is performed using the acquired data.
Abstract translation: 公开了数据管线中的连接器接口的方法和系统。 配置包括两个数据源节点和活动节点的流水线。 每个数据源节点表示来自不同数据源的数据,活动节点表示使用数据作为输入的工作流活动。 实现相同连接器接口的两个连接器被触发。 作为响应,通过连接器接口从相应的数据源在每个连接器处获取数据。 数据通过连接器接口从连接器发送到活动节点。 使用获取的数据执行工作流活动。
-
2.
公开(公告)号:US10452438B2
公开(公告)日:2019-10-22
申请号:US15665162
申请日:2017-07-31
Applicant: Amazon Technologies, Inc.
Inventor: Kathryn Marie Shih , Carl Louis Christofferson , Richard Jeffrey Cole , Peter Sirota , Vaibhav Aggarwal
Abstract: Methods and systems for optimization of task execution are disclosed. A definition of a task is received. A plurality of parameter values for execution of the task are selected based on an execution history for a plurality of prior tasks performed for a plurality of clients. The plurality of parameter values are selected to optimize one or more execution constraints for the execution of the task. The execution of the task is initiated using one or more computing resources configured with the selected parameter values.
-
公开(公告)号:US09430280B1
公开(公告)日:2016-08-30
申请号:US13764705
申请日:2013-02-11
Applicant: Amazon Technologies, Inc.
Inventor: Kathryn Marie Shih , Carl Louis Christofferson , Richard Jeffrey Cole , Peter Sirota , Vaibhav Aggarwal
CPC classification number: G06F9/485 , G06F9/5005 , G06F9/5027 , G06F2209/5013 , G06F2209/508
Abstract: Methods and systems for task timeouts as a function of input data size are disclosed. A definition of a task is received. The definition of the task indicates a set of input data for the task. A timeout duration for the task is determined based on the set of input data. The timeout duration varies with one or more characteristics of the set of input data. The execution of the task is initiated. The execution of the task is stopped if the execution of the task exceeds the timeout duration.
Abstract translation: 公开了作为输入数据大小的函数的任务超时的方法和系统。 收到任务的定义。 任务的定义表示一组任务的输入数据。 基于输入数据集来确定任务的超时持续时间。 超时持续时间随输入数据组的一个或多个特性而变化。 启动任务的执行。 如果执行任务超过超时持续时间,则任务的执行将停止。
-
4.
公开(公告)号:US09720732B1
公开(公告)日:2017-08-01
申请号:US13764708
申请日:2013-02-11
Applicant: Amazon Technologies, Inc.
Inventor: Kathryn Marie Shih , Carl Louis Christofferson , Richard Jeffrey Cole , Peter Sirota , Vaibhav Aggarwal
CPC classification number: G06F9/50 , G06F9/4887 , G06F9/5038 , G06F2209/485 , G06F2209/506
Abstract: Methods and systems for optimization of task execution are disclosed. A definition of a task is received. A plurality of parameter values for execution of the task are selected based on an execution history for a plurality of prior tasks performed for a plurality of clients. The plurality of parameter values are selected to optimize one or more execution constraints for the execution of the task. The execution of the task is initiated using one or more computing resources configured with the selected parameter values.
-
公开(公告)号:US09588822B1
公开(公告)日:2017-03-07
申请号:US13764716
申请日:2013-02-11
Applicant: Amazon Technologies, Inc.
Inventor: Kathryn Marie Shih , Eider Brantly Moore , Lorenzo Minore , Carl Louis Christofferson , Richard Rex McKnight , Richard Jeffrey Cole , Vaibhav Aggarwal , Peter Sirota , James P. Bartlett
CPC classification number: G06F9/52 , G06F9/542 , G06Q10/063
Abstract: Methods and systems for using a scheduler in a data pipeline are disclosed. A plurality of objects in a first layer are created, each representing a respective regularly scheduled task. A plurality of objects in a second layer are created, each representing a respective scheduled instance of a regularly scheduled task. It is determined whether each object in the second layer is ready to execute. For at least one object in the second layer, it is determined if the object has received notifications from any objects on which it depends. For each object that is ready to execute, the regularly scheduled task associated with the object is performed. For each object that is not ready to execute, the object is put to sleep.
Abstract translation: 公开了在数据流水线中使用调度器的方法和系统。 创建第一层中的多个对象,每个对象表示相应的规则排列任务。 创建第二层中的多个对象,每个对象表示规则调度任务的相应调度实例。 确定第二层中的每个对象是否准备好执行。 对于第二层中的至少一个对象,确定对象是否已经从其所依赖的任何对象接收到通知。 对于准备执行的每个对象,执行与对象相关联的定期计划的任务。 对于尚未准备好执行的每个对象,对象都将进入休眠状态。
-
公开(公告)号:US10552774B2
公开(公告)日:2020-02-04
申请号:US13764692
申请日:2013-02-11
Applicant: Amazon Technologies, Inc.
Inventor: Kathryn Marie Shih , Carl Louis Christofferson , Richard Jeffrey Cole , Peter Sirota , Vaibhav Aggarwal
Abstract: Methods and systems for cost-minimizing job scheduling are disclosed. A definition of a task is received. The definition comprises a need-by time. The need-by time comprises a deadline for completion of execution of the task. An estimated duration to complete the execution of the task is determined for each of a plurality of computing resources. One or more of the computing resources are selected based on an estimated cost of completing the execution using the computing resources. The execution of the task is initiated at a scheduled time using the selected one or more computing resources. The scheduled time is earlier than the need-by time by at least the estimated duration.
-
公开(公告)号:US20170357530A1
公开(公告)日:2017-12-14
申请号:US15665162
申请日:2017-07-31
Applicant: Amazon Technologies, Inc.
Inventor: Kathryn Marie Shih , Carl Louis Christofferson , Richard Jeffrey Cole , Peter Sirota , Vaibhav Aggarwal
IPC: G06F9/50
CPC classification number: G06F9/50 , G06F9/4887 , G06F9/5038 , G06F2209/485 , G06F2209/506
Abstract: Methods and systems for optimization of task execution are disclosed. A definition of a task is received. A plurality of parameter values for execution of the task are selected based on an execution history for a plurality of prior tasks performed for a plurality of clients. The plurality of parameter values are selected to optimize one or more execution constraints for the execution of the task. The execution of the task is initiated using one or more computing resources configured with the selected parameter values.
-
-
-
-
-
-