公开(公告)号：US09712448B2

公开(公告)日：2017-07-18

申请号：US13430948

申请日：2012-03-27

申请人： Wen Jie Wang ,  Hai Shan Wu ,  Bo Yang ,  Yi Xin Zhao

发明人： Wen Jie Wang ,  Hai Shan Wu ,  Bo Yang ,  Yi Xin Zhao

IPC分类号： H04L12/815 ,  H04L29/08 ,  H04L12/851

CPC分类号： H04L47/22 ,  H04L47/2425 ,  H04L67/1097 ,  H04L67/16

摘要： A proxy server and a hierarchical network system and a distributed workload management method. According to one embodiment of this disclosure, the proxy server includes: a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein the sum of the dispatch rate for respective service levels is less than or equal to a predetermined rate; and a request dispatcher configured to dispatch the requests of the corresponding service level in accordance with the dispatch rate determined by the rate controller. One aspect of the disclosure realizes a low overhead, highly scalable, simple and efficient workload management system to achieve QoS assurance and overload protection.

公开(公告)号：US20120317283A1

公开(公告)日：2012-12-13

申请号：US13592932

申请日：2012-08-23

申请人： Wen Jie Wang ,  Hai Shan Wu ,  Bo Yang ,  Yi Xin Zhao

发明人： Wen Jie Wang ,  Hai Shan Wu ,  Bo Yang ,  Yi Xin Zhao

IPC分类号： G06F15/173

CPC分类号： H04L47/22 ,  H04L47/2425 ,  H04L67/1097 ,  H04L67/16

摘要： A proxy server and a hierarchical network system and a distributed workload management method. According to one embodiment of this disclosure, the proxy server includes: a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein the sum of the dispatch rate for respective service levels is less than or equal to a predetermined rate; and a request dispatcher configured to dispatch the requests of the corresponding service level in accordance with the dispatch rate determined by the rate controller. One aspect of the disclosure realizes a low overhead, highly scalable, simple and efficient workload management system to achieve QoS assurance and overload protection.

摘要翻译： 代理服务器和分层网络系统以及分布式工作负载管理方法。 根据本公开的一个实施例，代理服务器包括：速率控制器，被配置为基于与请求的服务水平相关的测量的请求相关信息和服务质量参数，周期性地确定针对每个服务级别的请求的调度速率，其中 各个服务级别的调度率的总和小于或等于预定的速率; 以及请求分配器，被配置为根据由速率控制器确定的调度速率来分派对应服务级别的请求。 本公开的一个方面实现了低开销，高度可扩展，简单和高效的工作负载管理系统，以实现QoS保证和过载保护。

公开(公告)号：US20120254413A1

公开(公告)日：2012-10-04

申请号：US13430948

申请日：2012-03-27

申请人： Wen Jie Wang ,  Hai Shan Wu ,  Bo Yang ,  Yi Xin Zhao

发明人： Wen Jie Wang ,  Hai Shan Wu ,  Bo Yang ,  Yi Xin Zhao

IPC分类号： G06F11/30

CPC分类号： H04L47/22 ,  H04L47/2425 ,  H04L67/1097 ,  H04L67/16

摘要： A proxy server and a hierarchical network system and a distributed workload management method. According to one embodiment of this disclosure, the proxy server includes: a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein the sum of the dispatch rate for respective service levels is less than or equal to a predetermined rate; and a request dispatcher configured to dispatch the requests of the corresponding service level in accordance with the dispatch rate determined by the rate controller. One aspect of the disclosure realizes a low overhead, highly scalable, simple and efficient workload management system to achieve QoS assurance and overload protection.

公开(公告)号：US09071540B2

公开(公告)日：2015-06-30

申请号：US13592932

申请日：2012-08-23

申请人： Wen Jie Wang ,  Hai Shan Wu ,  Bo Yang ,  Yi Xin Zhao

发明人： Wen Jie Wang ,  Hai Shan Wu ,  Bo Yang ,  Yi Xin Zhao

IPC分类号： G06F15/173 ,  H04L12/815 ,  H04L29/08 ,  H04L12/851

CPC分类号： H04L47/22 ,  H04L47/2425 ,  H04L67/1097 ,  H04L67/16

摘要： A proxy server and a hierarchical network system and a distributed workload management method. According to one embodiment of this disclosure, the proxy server includes: a rate controller configured to, based on measured request-related information and service quality parameters relative to service levels of requests, periodically determine a dispatch rate for requests of each service level, wherein the sum of the dispatch rate for respective service levels is less than or equal to a predetermined rate; and a request dispatcher configured to dispatch the requests of the corresponding service level in accordance with the dispatch rate determined by the rate controller. One aspect of the disclosure realizes a low overhead, highly scalable, simple and efficient workload management system to achieve QoS assurance and overload protection.

摘要翻译： 代理服务器和分层网络系统以及分布式工作负载管理方法。 根据本公开的一个实施例，代理服务器包括：速率控制器，被配置为基于与请求的服务水平相关的测量的请求相关信息和服务质量参数，周期性地确定针对每个服务级别的请求的调度速率，其中 各个服务级别的调度率的总和小于或等于预定的速率; 以及请求分配器，被配置为根据由速率控制器确定的调度速率来分派对应服务级别的请求。 本公开的一个方面实现了低开销，高度可扩展，简单和高效的工作负载管理系统，以实现QoS保证和过载保护。

公开(公告)号：US07933284B2

公开(公告)日：2011-04-26

申请号：US12079680

申请日：2008-03-28

申请人： Zhi Yong Liang ,  Ling Shao ,  Hai Shan Wu ,  Wei Xue ,  Bo Yang ,  Yi Xin Zhao

发明人： Zhi Yong Liang ,  Ling Shao ,  Hai Shan Wu ,  Wei Xue ,  Bo Yang ,  Yi Xin Zhao

IPC分类号： H04L12/56

CPC分类号： H04L65/1006 ,  H04L1/1877 ,  H04L1/1887 ,  H04L47/50 ,  H04L47/6215 ,  H04L47/623 ,  H04L67/322 ,  H04L67/325

摘要： A method and apparatus for improving SIP server performance is disclosed. The apparatus comprises an enqueuer for determining whether a request packet entering into the server is a new request or a retransmitted request and its retransmission times and for enqueuing the request packet into different queues based on results of the determining step and a dequeuer for dequeuing the packet in the queues for processing based on a scheduling policy. The apparatus may further include a policy controller for communicating with the server, enqueuer, dequeuer, queues and user, to dynamically and automatically set, or set based on the user's instructions, the scheduling policy, number of different queues, each queue's capacity, scheduling, etc. based on the network and/or server load and/or based on different server applications.

摘要翻译： 公开了一种用于提高SIP服务器性能的方法和装置。 该装置包括：用于确定进入服务器的请求分组是否是新请求或重发请求及其重传次数并根据确定步骤的结果将请求分组排队到不同队列中的进位器和用于使分组出队的出局 在基于调度策略的处理队列中。 该装置还可以包括用于与服务器，进入者，出口人，队列和用户通信的策略控制器，以基于用户的指令来动态地和自动地设置或设置调度策略，不同队列的数量，每个队列的容量，调度 等等，基于网络和/或服务器负载和/或基于不同的服务器应用。

公开(公告)号：US20080253387A1

公开(公告)日：2008-10-16

申请号：US12079680

申请日：2008-03-28

申请人： Zhi Yong Liang ,  Ling Shao ,  Hai Shan Wu ,  Wei Xue ,  Bo Yang ,  Yi Xin Zhao

发明人： Zhi Yong Liang ,  Ling Shao ,  Hai Shan Wu ,  Wei Xue ,  Bo Yang ,  Yi Xin Zhao

IPC分类号： H04L12/56

CPC分类号： H04L65/1006 ,  H04L1/1877 ,  H04L1/1887 ,  H04L47/50 ,  H04L47/6215 ,  H04L47/623 ,  H04L67/322 ,  H04L67/325

摘要： A method and apparatus for improving SIP server performance is disclosed. The apparatus comprises an enqueuer for determining whether a request packet entering into the server is a new request or a retransmitted request and its retransmission times and for enqueuing the request packet into different queues based on results of the determining step and a dequeuer for dequeuing the packet in the queues for processing based on a scheduling policy. The apparatus may further include a policy controller for communicating with the server, enqueuer, dequeuer, queues and user, to dynamically and automatically set, or set based on the user's instructions, the scheduling policy, number of different queues, each queue's capacity, scheduling, etc. based on the network and/or server load and/or based on different server applications.

摘要翻译： 公开了一种用于提高SIP服务器性能的方法和装置。 该装置包括：用于确定进入服务器的请求分组是否为新请求或重发请求及其重传次数并根据确定步骤的结果将请求分组排队到不同队列中的进位器和用于使分组出队的出局 在基于调度策略的处理队列中。 该装置还可以包括用于与服务器，进入者，出口人，队列和用户通信的策略控制器，以基于用户的指令来动态地和自动地设置或设置调度策略，不同队列的数量，每个队列的容量，调度 等等，基于网络和/或服务器负载和/或基于不同的服务器应用。

公开(公告)号：US09043624B2

公开(公告)日：2015-05-26

申请号：US13130312

申请日：2009-11-04

申请人： Zhi Guo Gao ,  Li Li ,  Rui Xiong Tian ,  Hai Shan Wu ,  Bo Yang

发明人： Zhi Guo Gao ,  Li Li ,  Rui Xiong Tian ,  Hai Shan Wu ,  Bo Yang

IPC分类号： G06F1/32 ,  G06F9/50 ,  G06F9/455

CPC分类号： G06F1/329 ,  G06F1/3203 ,  G06F1/3206 ,  G06F1/3246 ,  G06F9/455 ,  G06F9/45558 ,  G06F9/5083 ,  G06F2009/45591 ,  G06F2009/45595 ,  H04L43/04 ,  H04L43/0888

摘要： A method and apparatus for power-efficiency management in a virtualized cluster system. The virtualized cluster system includes a front-end physical host and at least one back-end physical host, and each of the at least one back-end physical host comprises at least one virtual machine and a virtual machine manager. Flow characteristics of the virtualized cluster system are detected at a regular time cycle, then a power-efficiency management policy is generated for each of the at least one back-end physical host based on the detected flow characteristics, and finally the power-efficiency management policies are performed. The method can detect the real-time flow characteristics of the virtualized cluster system and make the power-efficiency management policies thereupon to control the power consumption of the system and perform admission control on the whole flow, thereby realizing optimal power saving while meeting the quality of service requirements.

摘要翻译： 一种虚拟化集群系统中功率效率管理的方法和装置。 虚拟化集群系统包括前端物理主机和至少一个后端物理主机，并且所述至少一个后端物理主机中的每一个包括至少一个虚拟机和虚拟机管理器。 以规则的时间周期检测虚拟化集群系统的流量特性，然后基于检测到的流量特性为至少一个后端物理主机中的每一个产生功率效率管理策略，最后是功率效率管理 执行策略。 该方法可以检测虚拟化集群系统的实时流量特性，使其功率管理策略能够控制系统的功耗，对整个流量进行准入控制，从而实现最优节能，同时满足质量 的服务要求。

公开(公告)号：US20110289330A1

公开(公告)日：2011-11-24

申请号：US13130312

申请日：2009-11-04

申请人： Zhi Guo Gao ,  Li Li ,  Rui Xiong Tian ,  Hai Shan Wu ,  Bo Yang

发明人： Zhi Guo Gao ,  Li Li ,  Rui Xiong Tian ,  Hai Shan Wu ,  Bo Yang

IPC分类号： G06F1/32

CPC分类号： G06F1/329 ,  G06F1/3203 ,  G06F1/3206 ,  G06F1/3246 ,  G06F9/455 ,  G06F9/45558 ,  G06F9/5083 ,  G06F2009/45591 ,  G06F2009/45595 ,  H04L43/04 ,  H04L43/0888

摘要： A method for power-efficiency management in a virtualized cluster system is disclosed, wherein the virtualized cluster system comprises a front-end physical host and at least one back-end physical host, and each of the at least one back-end physical host comprises at least one virtual machine and a virtual machine manager for managing the at least one virtual machine. In the method, flow characteristics of the virtualized cluster system are detected at a regular time cycle, then a power-efficiency management policy is generated for each of the at least one back-end physical host based on the detected flow characteristics, and finally the power-efficiency management policies are performed. The method can detect the real-time flow characteristics of the virtualized cluster system and make the power-efficiency management policies thereupon to control the power consumption of the system and perform admission control on the whole flow, thereby realizing optimal power saving while meeting the quality of service requirements, so that a virtualized cluster system with high power-efficiency can be provided.

摘要翻译： 公开了一种用于虚拟化集群系统中的功率效率管理的方法，其中所述虚拟集群系统包括前端物理主机和至少一个后端物理主机，并且所述至少一个后端物理主机中的每一个包括 至少一个虚拟机和虚拟机管理器，用于管理所述至少一个虚拟机。 在该方法中，以规则的时间周期检测虚拟集群系统的流量特性，然后基于检测到的流量特性为至少一个后端物理主机中的每一个产生功率效率管理策略，最后， 执行功率效率管理策略。 该方法可以检测虚拟化集群系统的实时流量特性，使其功率管理策略能够控制系统的功耗，对整个流量进行准入控制，从而实现最优节能，同时满足质量 的服务要求，从而可以提供具有高功率效率的虚拟化集群系统。

公开(公告)号：US08046423B2

公开(公告)日：2011-10-25

申请号：US12473313

申请日：2009-05-28

申请人： Thomas D. Haywood ,  Brian K. Smith ,  Michael J. Spreitzer ,  Lan Vuong ,  Hai Shan Wu

发明人： Thomas D. Haywood ,  Brian K. Smith ,  Michael J. Spreitzer ,  Lan Vuong ,  Hai Shan Wu

IPC分类号： G06F15/16 ,  G06F15/167

CPC分类号： G06F9/5016

摘要： A method, system and program product for controlling memory overload for a computer system. The invention determines heap utilization of a server; determines a maximum session lifetime a configured percentile of at least one session; determines a traffic rate (comprised of an average traffic rate received from a proxy server and a variance of traffic rate received from a proxy server); and calculates a maximum traffic rate, wherein the maximum traffic rate determines the heap utilization at a maximum heap percentage.

摘要翻译： 一种用于控制计算机系统的存储器过载的方法，系统和程序产品。 本发明确定服务器的堆利用率; 确定最大会话生存期至少一个会话的配置百分位数; 确定业务速率（由从代理服务器接收的平均业务速率和从代理服务器接收的业务速率差异组成）; 并计算最大流量速率，其中最大流量速率以最大堆百分比确定堆利用率。

公开(公告)号：US08977908B2

公开(公告)日：2015-03-10

申请号：US13596095

申请日：2012-08-28

申请人： Jie Qiu ,  Hai Shan Wu ,  Jie Yang ,  Tao Yu

发明人： Jie Qiu ,  Hai Shan Wu ,  Jie Yang ,  Tao Yu

IPC分类号： G06F11/00 ,  G06F11/07 ,  G06F11/34

CPC分类号： G06F11/073 ,  G06F11/076 ,  G06F11/3452 ,  G06F11/3466

摘要： A method for determining a suspect memory leak, including: sampling the throughput and memory usage of an application server; based on the sampled throughput, monitoring whether the throughput decrease continually, and based on the sampled memory usage, monitoring whether the memory usage remains stable within a predefined range; in response to a continual decrease of the throughput and the memory usage remaining stable within the predetermined range, determining that the application server is suspected of having a memory leak. Using the solution of the present invention can free an administrator of the burden of artificially identifying suspect servers, can identify a suspect server during runtime and further determine whether it actually has a memory leak.

摘要翻译： 一种用于确定可疑内存泄漏的方法，包括：对应用服务器的吞吐量和内存使用进行采样; 基于采样的吞吐量，监测吞吐量是否持续下降，并且基于采样的存储器使用情况，监视存储器使用是否在预定范围内保持稳定; 响应于吞吐量的持续降低和在预定范围内的存储器使用量保持稳定，确定应用服务器被怀疑具有存储器泄漏。 使用本发明的解决方案可以使管理员免除人为识别可疑服务器的负担，可以在运行时识别可疑服务器，并且进一步确定它是否实际上具有内存泄漏。