公开(公告)号：US08140673B2

公开(公告)日：2012-03-20

申请号：US12786731

申请日：2010-05-25

申请人： Yixin Diao ,  Xiao Lei Hu ,  Michael Joseph Spreitzer ,  Asser Nasreldin Tantawi ,  Rui Xiong Tian ,  Hai Shan Wu

发明人： Yixin Diao ,  Xiao Lei Hu ,  Michael Joseph Spreitzer ,  Asser Nasreldin Tantawi ,  Rui Xiong Tian ,  Hai Shan Wu

IPC分类号： G06F15/16 ,  G06F12/00

CPC分类号： G06F9/505 ,  H04L65/105

摘要： A method and system for controlling load admission rate of an application server is provided. In the method, actual heap utilization and load admission rate of the application server in current control cycle are detected; based on the detected actual heap utilization and load admission rate, load characteristics variation parameters of the application server are estimated; and control gain of a feedback controller is calculated based on the load characteristics variation parameters; the feedback controller calculates desired load admission rate of the application server in next control cycle by using the calculated control gain. The load admission rate of the application server can be adaptively controlled by tracking changes in workload characteristics of the application server, such that the actual heap utilization of the application server is maintained at or close to target heap utilization.

摘要翻译： 提供了一种用于控制应用服务器的承载率的方法和系统。 在该方法中，检测当前控制周期中应用服务器的实际堆利用率和承载率; 基于检测到的实际堆利用率和承载率，估计应用服务器的负载特性变化参数; 并根据负载特性变化参数计算反馈控制器的控制增益; 反馈控制器通过使用计算出的控制增益在下一个控制周期中计算应用服务器的期望载入准入率。 可以通过跟踪应用服务器的工作负载特性的变化来自适应地控制应用服务器的承载率，使得应用服务器的实际堆利用率维持在或接近目标堆利用率。

公开(公告)号：US20110295995A1

公开(公告)日：2011-12-01

申请号：US12786731

申请日：2010-05-25

申请人： Yixin Diao ,  Xiao Lei Hu ,  Michael Joseph Spreitzer ,  Asser Nasreldin Tantawi ,  Rui Xiong Tian ,  Hai Shan Wu

发明人： Yixin Diao ,  Xiao Lei Hu ,  Michael Joseph Spreitzer ,  Asser Nasreldin Tantawi ,  Rui Xiong Tian ,  Hai Shan Wu

IPC分类号： G06F15/173

CPC分类号： G06F9/505 ,  H04L65/105

摘要： A method and system for controlling load admission rate of an application server is provided. In the method, actual heap utilization and load admission rate of the application server in current control cycle are detected; based on the detected actual heap utilization and load admission rate, load characteristics variation parameters of the application server are estimated; and control gain of a feedback controller is calculated based on the load characteristics variation parameters; the feedback controller calculates desired load admission rate of the application server in next control cycle by using the calculated control gain. The load admission rate of the application server can be adaptively controlled by tracking changes in workload characteristics of the application server, such that the actual heap utilization of the application server is maintained at or close to target heap utilization.

摘要翻译： 提供了一种用于控制应用服务器的承载率的方法和系统。 在该方法中，检测当前控制周期中应用服务器的实际堆利用率和承载率; 基于检测到的实际堆利用率和承载率，估计应用服务器的负载特性变化参数; 并根据负载特性变化参数计算反馈控制器的控制增益; 反馈控制器通过使用计算出的控制增益在下一个控制周期中计算应用服务器的期望载入准入率。 可以通过跟踪应用服务器的工作负载特性的变化来自适应地控制应用服务器的承载率，使得应用服务器的实际堆利用率维持在或接近目标堆利用率。

公开(公告)号：US08230107B2

公开(公告)日：2012-07-24

申请号：US12191898

申请日：2008-08-14

申请人： Asser Nasreldin Tantawi ,  Giovanni Pacifici ,  Wolfgang Segmuller ,  Michael Joseph Spreitzer ,  Alaa Salah Youssef

发明人： Asser Nasreldin Tantawi ,  Giovanni Pacifici ,  Wolfgang Segmuller ,  Michael Joseph Spreitzer ,  Alaa Salah Youssef

IPC分类号： G06F15/16

CPC分类号： G06F11/3433 ,  G06F9/505 ,  G06F11/3419 ,  G06F2201/88 ,  G06F2209/508

摘要： Provides control of the workload, flow control, and concurrency control of a computer system through the use of only external performance monitors. Data collected by external performance monitors are used to build a simple, black box model of the computer system, comprising two resources: a virtual bottleneck resource and a delay resource representing all non-bottleneck resources combined. The service times of the two resource types are two parameters of the black box model. The two parameters are evaluated based on historical data collected by the external performance monitors. The workload capacity that avoids saturation of the bottleneck resource is then determined and used as a control variable by a flow controller to limit the workload on the computer system. The workload may include a mix of traffic classes. In such a case, data is collected, parameters are evaluated and control variables are determined for each of the traffic classes.

摘要翻译： 通过仅使用外部性能监视器来提供对计算机系统的工作负载，流量控制和并发控制的控制。 由外部性能监视器收集的数据用于构建计算机系统的简单的黑匣子模型，包括两个资源：虚拟瓶颈资源和代表所有非瓶颈资源的延迟资源。 两种资源类型的服务时间是黑匣子模型的两个参数。 这两个参数是根据外部性能监视器收集的历史数据进行评估的。 然后，通过流量控制器确定避免瓶颈资源饱和的工作负载，并将其用作控制变量，以限制计算机系统上的工作量。 工作负载可能包括混合的流量类别。 在这种情况下，收集数据，评估参数，并确定每个流量类别的控制变量。

公开(公告)号：US20080301696A1

公开(公告)日：2008-12-04

申请号：US12191898

申请日：2008-08-14

申请人： Asser Nasreldin Tantawi ,  Giovanni Pacifici ,  Wolfgang Segmuller ,  Michael Joseph Spreitzer ,  Alaa Salah Youssef

发明人： Asser Nasreldin Tantawi ,  Giovanni Pacifici ,  Wolfgang Segmuller ,  Michael Joseph Spreitzer ,  Alaa Salah Youssef

IPC分类号： G06F9/46

CPC分类号： G06F11/3433 ,  G06F9/505 ,  G06F11/3419 ,  G06F2201/88 ,  G06F2209/508

摘要： Provides control of the workload, flow control, and concurrency control of a computer system through the use of only external performance monitors. Data collected by external performance monitors are used to build a simple, black box model of the computer system, comprising two resources: a virtual bottleneck resource and a delay resource representing all non-bottleneck resources combined. The service times of the two resource types are two parameters of the black box model. The two parameters are evaluated based on historical data collected by the external performance monitors. The workload capacity that avoids saturation of the bottleneck resource is then determined and used as a control variable by a flow controller to limit the workload on the computer system. The workload may include a mix of traffic classes. In such a case, data is collected, parameters are evaluated and control variables are determined for each of the traffic classes.

摘要翻译： 通过仅使用外部性能监视器来提供对计算机系统的工作负载，流量控制和并发控制的控制。 由外部性能监视器收集的数据用于构建计算机系统的简单的黑匣子模型，包括两个资源：虚拟瓶颈资源和代表所有非瓶颈资源的延迟资源。 两种资源类型的服务时间是黑匣子模型的两个参数。 这两个参数是根据外部性能监视器收集的历史数据进行评估的。 然后，通过流量控制器确定避免瓶颈资源饱和的工作负载，并将其用作控制变量，以限制计算机系统上的工作量。 工作负载可能包括混合的流量类别。 在这种情况下，收集数据，评估参数，并确定每个流量类别的控制变量。

公开(公告)号：US20080235705A1

公开(公告)日：2008-09-25

申请号：US12133872

申请日：2008-06-05

申请人： John Alan Bivens ,  David Michael Chess ,  Donna N. Dillenberger ,  Steven E. Froehlich ,  James Edwin Hanson ,  Mark Francis Hulber ,  Jeffrey Owen Kephart ,  Giovanni Pacifici ,  Michael Joseph Spreitzer ,  Asser Nasreldin Tantawi ,  Mathew S. Thoennes ,  Ian Nicholas Whalley ,  Peter B. Yocom

发明人： John Alan Bivens ,  David Michael Chess ,  Donna N. Dillenberger ,  Steven E. Froehlich ,  James Edwin Hanson ,  Mark Francis Hulber ,  Jeffrey Owen Kephart ,  Giovanni Pacifici ,  Michael Joseph Spreitzer ,  Asser Nasreldin Tantawi ,  Mathew S. Thoennes ,  Ian Nicholas Whalley ,  Peter B. Yocom

IPC分类号： G06F9/46

CPC分类号： G06Q10/06

摘要： Techniques for globally managing systems are provided. One or more measurable effects of at least one hypothetical action to achieve a management goal are determined at a first system manager. The one or more measurable effects are sent from the first system manager to a second system manager. At the second system manager, one or more procedural actions to achieve the management goal are determined in response to the one or more received measurable effects. The one or more procedural actions are executed to achieve the management goal.

摘要翻译： 提供了全球管理系统的技术。 在第一个系统管理员处确定至少一个假设动作以实现管理目标的一个或多个可测量的影响。 一个或多个可测量的效果从第一系统管理器发送到第二系统管理器。 在第二系统管理器中，响应于一个或多个接收到的可测量效果来确定用于实现管理目标的一个或多个程序动作。 执行一个或多个程序操作以实现管理目标。

公开(公告)号：US08863144B2

公开(公告)日：2014-10-14

申请号：US12723914

申请日：2010-03-15

申请人： Arun Kwangil Iyengar ,  Hongbo Jiang ,  Erich M. Nahum ,  Wolfgang Segmuller ,  Asser Nasreldin Tantawi ,  Charles P. Wright

发明人： Arun Kwangil Iyengar ,  Hongbo Jiang ,  Erich M. Nahum ,  Wolfgang Segmuller ,  Asser Nasreldin Tantawi ,  Charles P. Wright

IPC分类号： G06F9/46 ,  G06F15/173 ,  G06F9/50

CPC分类号： G06F9/46 ,  G06F9/505 ,  G06F2209/501 ,  G06F2209/5019 ,  H04L67/1008

摘要： In a computer system comprising a plurality of computing devices wherein the plurality of computing devices processes a plurality of tasks and each task has a task type, a method for determining overheads associated with task types comprises the following steps. Overheads are estimated for a plurality of task types. One of the plurality of computing devices is selected to execute one of the plurality of tasks, wherein the selection comprises estimating load on at least a portion of the plurality of computing devices from tasks assigned to at least a portion of the plurality of computing devices and the estimates of overheads of the plurality of task types. One or more of the estimates of overheads of the plurality of task types are varied.

摘要翻译： 在包括多个计算设备的计算机系统中，其中所述多个计算设备处理多个任务，并且每个任务具有任务类型，用于确定与任务类型相关联的开销的方法包括以下步骤。 估计多个任务类型的开销。 选择多个计算设备中的一个来执行多个任务中的一个，其中所述选择包括从分配给所述多个计算设备的至少一部分的任务估计所述多个计算设备的至少一部分上的负载，以及 多个任务类型的开销的估计。 改变多个任务类型的开销的估计中的一个或多个。

公开(公告)号：US09110729B2

公开(公告)日：2015-08-18

申请号：US13399298

申请日：2012-02-17

申请人： Diana Jeanne Arroyo ,  Zohar Feldman ,  Michael Masin ,  Malgorzata Steinder ,  Asser Nasreldin Tantawi ,  Ian Nicholas Whalley

发明人： Diana Jeanne Arroyo ,  Zohar Feldman ,  Michael Masin ,  Malgorzata Steinder ,  Asser Nasreldin Tantawi ,  Ian Nicholas Whalley

IPC分类号： G06F9/50

CPC分类号： G06F9/5077 ,  G06F2209/503 ,  G06F2209/504 ,  Y02D10/22

摘要： Systems and methods for admission control to a physical host system are provided herein. One aspect provides for receiving at least one resource request at an admission control component of a distributed computing system, the at least one resource request comprised of at least one system type; processing the at least one resource request utilizing at least one physical host accessible to the distributed computing system; specifying a number of resource request slots to be reserved for at least one system type based on at least one future reservation threshold accessible to the admission control component; and blocking resource requests from entering the system through the admission control component based on a number of available resource request slots and the at least one future reservation threshold. Other embodiments and aspects are also described herein.

摘要翻译： 本文提供了用于物理主机系统的准入控制的系统和方法。 一个方面提供在分布式计算系统的接纳控制组件处接收至少一个资源请求，该至少一个资源请求由至少一个系统类型组成; 使用所述分布式计算系统可访问的至少一个物理主机来处理所述至少一个资源请求; 基于接纳控制部件可访问的至少一个未来预定阈值来指定要为至少一个系统类型保留的资源请求时隙的数量; 以及基于许多可用资源请求时隙和所述至少一个未来预留阈值，阻止资源请求通过准入控制组件进入系统。 本文还描述了其它实施例和方面。

公开(公告)号：US09071608B2

公开(公告)日：2015-06-30

申请号：US12110802

申请日：2008-04-28

申请人： Arun Kwangil Iyengar ,  Hongbo Jiang ,  Erich Miles Nahum ,  Wolfgang Segmuller ,  Asser Nasreldin Tantawi ,  Charles P. Wright

发明人： Arun Kwangil Iyengar ,  Hongbo Jiang ,  Erich Miles Nahum ,  Wolfgang Segmuller ,  Asser Nasreldin Tantawi ,  Charles P. Wright

IPC分类号： G06F9/50 ,  H04L29/08 ,  H04L29/06

CPC分类号： H04L67/1008 ,  G06F9/505 ,  H04L47/125 ,  H04L65/1006 ,  H04L67/1002 ,  H04L67/1017 ,  H04L67/1027 ,  H04L67/42

摘要： Techniques are disclosed for load balancing in networks such as those networks handling telephony applications. By way of example, such techniques direct requests associated with calls to servers in a system comprised of a network routing calls between a plurality of callers and at least one receiver wherein a load balancer sends requests associated with calls to a plurality of servers as follows. A request associated with a call, a caller, or a receiver is received, depending on the particular load balancing technique. A server is selected to receive the request. A subsequent request is received. A determination is made whether or not the subsequent request is associated with the call, the caller, or the receiver, depending on the particular load balancing technique. The subsequent request is sent to the server based on determining that the subsequent request is associated with the call, the caller, or the receiver, again depending on the particular load balancing technique.

摘要翻译： 公开了用于诸如处理电话应用的那些网络的网络中的负载平衡的技术。 作为示例，这样的技术将包括在多个呼叫者之间的网络路由呼叫和至少一个接收机的系统中的对服务器的呼叫相关联的请求进行直接请求，其中负载平衡器如下发送与多个服务器的呼叫相关联的请求。 根据特定的负载平衡技术，接收到与呼叫，呼叫者或接收者相关联的请求。 选择服务器接收请求。 接收到后续请求。 根据具体的负载平衡技术，确定后续请求是否与呼叫，呼叫者或接收者相关联。 基于特定的负载均衡技术，基于确定后续请求与呼叫，呼叫者或接收者相关联，将后续请求发送到服务器。

公开(公告)号：US08024278B2

公开(公告)日：2011-09-20

申请号：US12062828

申请日：2008-04-04

申请人： Asser Nasreldin Tantawi

发明人： Asser Nasreldin Tantawi

IPC分类号： G06F17/00

CPC分类号： G06F11/3452 ,  G06F11/3457 ,  H04L69/02

摘要： A generic queueing network model of a Web services environment is introduced. The behavior of a service is abstracted in three phases: serial, parallel and dormant, thus yielding a Serial Parallel Queueing Network (SPQN) model with a small number of parameters. A method is provided for estimated the parameters of the model that is based on stochastic approximation techniques for solving stochastic optimization problems. The parameter estimation method is shown to perform well in a noisy environment, where performance data is obtained through measurements or using approximate model simulations.

摘要翻译： 介绍了Web服务环境的通用排队网络模型。 服务的行为分为三个阶段：串行，并行和休眠，从而产生具有少量参数的串行并行排队网络（SPQN）模型。 提供了一种基于随机逼近技术求解随机优化问题的模型参数估计方法。 参数估计方法显示在噪声环境中表现良好，其中通过测量或使用近似模型模拟获得性能数据。

公开(公告)号：US20130219066A1

公开(公告)日：2013-08-22

申请号：US13399298

申请日：2012-02-17

申请人： Diana Jeanne Arroyo ,  Zohar Feldman ,  Michael Masin ,  Malgorzata Steinder ,  Asser Nasreldin Tantawi ,  Ian Nicholas Whalley

发明人： Diana Jeanne Arroyo ,  Zohar Feldman ,  Michael Masin ,  Malgorzata Steinder ,  Asser Nasreldin Tantawi ,  Ian Nicholas Whalley

IPC分类号： G06F15/173

CPC分类号： G06F9/5077 ,  G06F2209/503 ,  G06F2209/504 ,  Y02D10/22

摘要： Systems and methods for admission control to a physical host system are provided herein. One aspect provides for receiving at least one resource request at an admission control component of a distributed computing system, the at least one resource request comprised of at least one system type; processing the at least one resource request utilizing at least one physical host accessible to the distributed computing system; specifying a number of resource request slots to be reserved for at least one system type based on at least one future reservation threshold accessible to the admission control component; and blocking resource requests from entering the system through the admission control component based on a number of available resource request slots and the at least one future reservation threshold. Other embodiments and aspects are also described herein.

摘要翻译： 本文提供了用于物理主机系统的准入控制的系统和方法。 一个方面提供在分布式计算系统的接纳控制组件处接收至少一个资源请求，该至少一个资源请求由至少一个系统类型组成; 使用所述分布式计算系统可访问的至少一个物理主机来处理所述至少一个资源请求; 基于接纳控制部件可访问的至少一个未来预定阈值来指定要为至少一个系统类型保留的资源请求时隙的数量; 以及基于许多可用资源请求时隙和所述至少一个未来预留阈值，阻止资源请求通过准入控制组件进入系统。 本文还描述了其它实施例和方面。