公开(公告)号：US07734726B2

公开(公告)日：2010-06-08

申请号：US09995087

申请日：2001-11-27

申请人： Paul Michael Dantzig ,  Daniel Manuel Dias ,  Richard Pervin King

发明人： Paul Michael Dantzig ,  Daniel Manuel Dias ,  Richard Pervin King

IPC分类号： G06F15/16 ,  G06F15/173 ,  G06F9/46

CPC分类号： G06F9/505 ,  G06F2209/509 ,  H04L29/06 ,  H04L67/1002 ,  H04L67/1008 ,  H04L67/1012 ,  H04L2029/06054

摘要： The present invention provides a method, apparatus, and computer implemented instructions for processing Web and other Internet or Intranet based services. The system for processing Web requests includes a Web server with a connection to the Internet or Intranet with a predefined network bandwidth, a set of primary Web and application server cluster nodes to process the requests, and a dispatcher to allocate requests to nodes; in addition, one or more offload server nodes are connected to the network. Client Web requests arrive at the dispatcher of the Web server, which determines whether the incoming request can be handled at the primary Web server cluster, whether all or part of the user Web request should be offloaded to one of the offload server nodes, or whether the request should be throttled. If the dispatcher determines that the request should be handled by the primary Web server cluster, it is appropriately routed to one of the nodes in the primary Web server cluster; else if the dispatcher determines that the request should be offloaded, one of the offload server nodes or service providers is selected, and the request is either routed to a primary server node with the appropriate indication to offload all or part of the request, or the request is routed to the selected offload service provider; otherwise, the request is throttled by either routing it to a node which returns information that the service is overloaded, or if the Web servers are too busy to provide even an overload indication, then the request is dropped.

摘要翻译： 本发明提供了一种用于处理Web和其他因特网或基于内联网的服务的方法，装置和计算机实现的指令。 用于处理Web请求的系统包括具有到具有预定义网络带宽的因特网或内联网的连接的Web服务器，用于处理请求的一组主Web和应用服务器集群节点以及向节点分配请求的调度器; 此外，一个或多个卸载服务器节点连接到网络。 客户端Web请求到达Web服务器的调度程序，该服务器确定是否可以在主Web服务器集群处理传入请求，是否将全部或部分用户Web请求卸载到卸载服务器节点之一，或是否 该请求应该被限制。 如果调度程序确定请求应由主Web服务器集群处理，则将其适当地路由到主Web服务器集群中的一个节点; 否则，如果分派器确定应该卸载该请求，则选择卸载服务器节点或服务提供者之一，并且该请求被路由到具有适当指示的主服务器节点以卸载所有或部分请求，或者 请求被路由到所选择的卸载服务提供商; 否则，通过将请求路由到返回服务超载的信息的节点或者如果Web服务器太忙而不能提供过载指示，则该请求被限制，则该请求被丢弃。

公开(公告)号：US08346909B2

公开(公告)日：2013-01-01

申请号：US10763135

申请日：2004-01-22

申请人： Asit Dan ,  Daniel Manuel Dias ,  Richard Pervin King ,  Avraham Leff ,  James Thomas Rayfield ,  Noshir Cavas Wadia

发明人： Asit Dan ,  Daniel Manuel Dias ,  Richard Pervin King ,  Avraham Leff ,  James Thomas Rayfield ,  Noshir Cavas Wadia

IPC分类号： G06F15/173

CPC分类号： G06F9/5083 ,  H04L41/5009 ,  H04L67/1008 ,  H04L67/1025 ,  H04L67/325

摘要： An on-demand manager provides an improved distributed data processing system for facilitating dynamic allocation of computing resources among multiple domains based on a current workload and service level agreements. Based on a service level agreement, the on-demand manager monitors and predicts the load on the system. If the current or predicted load cannot be handled with the current system configuration, the on-demand manager determines additional resources needed to handle the workload. If the service level agreement violations cannot be handled by reconfiguring resources at a domain, the on-demand manager sends a resource request to other domains. These other domains analyze their own commitments and may accept the resource request, reject the request, or counter-propose with an offer of resources and a corresponding service level agreement. Once the requesting domain has acquired resources, workload load balancers are reconfigured to allocate some of the workload from the requesting site to the acquired remote resources.

摘要翻译： 按需管理器提供改进的分布式数据处理系统，用于基于当前工作负载和服务级别协议来促进多个域之间的计算资源的动态分配。 根据服务级别协议，按需管理器监视和预测系统上的负载。 如果当前或预测的负载不能用当前系统配置来处理，则按需管理器确定处理工作负载所需的额外资源。 如果通过在域上重新配置资源不能处理服务级别协议违规，则按需管理器向其他域发送资源请求。 这些其他领域分析自己的承诺，并可以接受资源请求，拒绝请求或反提出资源提议和相应的服务级别协议。 一旦请求域已经获得资源，工作负载平衡器被重新配置以将一些工作负载从请求站点分配给所获取的远程资源。

公开(公告)号：US08352607B2

公开(公告)日：2013-01-08

申请号：US11952641

申请日：2007-12-07

申请人： Daniel Manuel Dias ,  Richard Pervin King ,  Zhen Liu ,  Mark Steven Squillante ,  Honghui Xia ,  Shun-Zheng Yu ,  Li Zhang

发明人： Daniel Manuel Dias ,  Richard Pervin King ,  Zhen Liu ,  Mark Steven Squillante ,  Honghui Xia ,  Shun-Zheng Yu ,  Li Zhang

IPC分类号： G06F15/173 ,  G01R31/08 ,  G06F7/00

CPC分类号： H04L29/06 ,  H04L41/142 ,  H04L43/16 ,  H04L47/122 ,  H04L67/1002 ,  H04L67/1008 ,  H04L67/101 ,  H04L67/1012 ,  H04L67/1021 ,  H04L67/1023 ,  H04L67/1029 ,  H04L67/22 ,  H04L69/329 ,  H04L2029/06054

摘要： Identifying traffic patterns to web sites based on templates that characterize the arrival of traffic to the web sites is provided. Based on these templates, determinations are made as to which web sites should be co-located so as to optimize resource allocation. Web sites whose templates are complimentary, i.e. a first web site having a peak in arrival traffic at time t1 and a second web site that has a trough in arrival traffic at time t1, are designated as being candidates for co-location. In addition, the templates identified for the traffic patterns of web sites are used to determine thresholds for offloading traffic to other servers. These thresholds include a first threshold at which offloading should be performed, a second threshold that takes into consideration the lead time needed to begin offloading, and a third threshold that takes into consideration a lag time needed to stop offloading of traffic.

摘要翻译： 提供了基于将流量到达网站到达的模板来识别网站的流量模式。 基于这些模板，确定哪些网站应该位于同一位置，以优化资源分配。 其模板是免费的网站，即在时间t1具有到达业务峰值的第一网站和在时间t1具有到达业务中的波谷的第二网站被指定为用于共同定位的候选。 此外，为网站的流量模式标识的模板用于确定将流量卸载到其他服务器的阈值。 这些阈值包括应当执行卸载的第一阈值，考虑开始卸载所需的前置时间的第二阈值以及考虑到停止流量卸载所需的滞后时间的第三阈值。

公开(公告)号：US06424992B2

公开(公告)日：2002-07-23

申请号：US08947361

申请日：1997-10-08

申请人： Murthy V. Devarakonda ,  Daniel Manuel Dias ,  German Sergio Goldszmidt ,  Guerney Douglass Holloway Hunt ,  Arun Kwangil Iyengar ,  Richard Pervin King ,  Rajat Mukherjee

发明人： Murthy V. Devarakonda ,  Daniel Manuel Dias ,  German Sergio Goldszmidt ,  Guerney Douglass Holloway Hunt ,  Arun Kwangil Iyengar ,  Richard Pervin King ,  Rajat Mukherjee

IPC分类号： G06F1300

CPC分类号： H04L67/1008 ,  H04L67/1002 ,  H04L67/1027

摘要： An affinity-based router and method for routing and load balancing in an encapsulated cluster of server nodes is disclosed. The system consists of a multi-node server, wherein any of the server nodes can handle a client request, but wherein clients have affinity to one or more of the server nodes that are preferred to handle a client request. Such affinity is due to state at the servers either due to previous routing requests, or data affinity at the server. At the multi-node server, a node may be designated as a TCP router. The address of the TCP router is given out to clients, and client requests are sent thereto. The TCP router selects one of the nodes in the multi-node server to process the client request, and routes the request to this server; in addition, the TCP router maintains affinity tables, containing affinity records, indicating which node a client was routed to. In processing the client request, the server nodes may determine that another node is better suited to handle the client request, and may reset the corresponding TCP router affinity table entry. The server nodes may also create, modify or delete affinity records in the TCP router affinity table. Subsequent requests from this client are routed to server nodes based on any affinity records, possibly combined on other information (such as load).

摘要翻译： 公开了一种基于亲和力的路由器和方法，用于在封装的服务器节点集群中进行路由和负载平衡。 该系统由多节点服务器组成，其中任何服务器节点可以处理客户端请求，但是其中客户端对于优先处理客户端请求的一个或多个服务器节点具有亲和力。 这种亲和力是由于在服务器处的状态是由于先前的路由请求或在服务器处的数据关联。 在多节点服务器上，可以将节点指定为TCP路由器。 将TCP路由器的地址发送给客户端，并向客户端发送客户端请求。 TCP路由器选择多节点服务器中的一个节点来处理客户端请求，并将请求路由到该服务器; 此外，TCP路由器维护包含亲和性记录的关联表，指示客户端被路由到哪个节点。 在处理客户端请求时，服务器节点可以确定另一个节点更适合处理客户机请求，并且可以重置对应的TCP路由器亲和性表项。 服务器节点还可以在TCP路由器亲和性表中创建，修改或删除关联记录。 来自该客户端的后续请求将基于任何关联记录路由到服务器节点，可能与其他信息（如加载）相结合。

公开(公告)号：US5907849A

公开(公告)日：1999-05-25

申请号：US865156

申请日：1997-05-29

申请人： Daniel Manuel Dias ,  Anant Deep Jhingran ,  Richard Pervin King ,  Christos Polyzois

发明人： Daniel Manuel Dias ,  Anant Deep Jhingran ,  Richard Pervin King ,  Christos Polyzois

IPC分类号： G06F11/14 ,  G06F17/00

CPC分类号： G06F11/2046 ,  G06F11/2033 ,  G06F11/2038 ,  G06F11/1662 ,  Y10S707/99952 ,  Y10S707/99953

摘要： A method and system for recovering from a failure of a processing node in a partitioned shared nothing database processing system are provided. The processing system may include a pair of processing nodes having twin-tailed-connected thereto a storage device. A first processing node of the pair of processing nodes has a first database instance running thereon which accesses a first data partition on the storage device prior to the failure. Upon detection of the failure, access to the first data partition on the storage device is provided to a third, spare processing node through the second processing node of the pair of processing nodes. The third processing node runs a replacement database instance for the first database instance which was running on the first processing node prior to the failure thereof. The replacement database instance accesses the first data partition on the storage device through the second processing node, thereby recovering from the failure of the first processing node. Access to the first data partition may include using a virtual shared disk utility having a server portion on the second processing node and a client portion on the third processing node.

摘要翻译： 提供了一种用于从分区共享数据库处理系统中的处理节点的故障中恢复的方法和系统。 处理系统可以包括一对具有双尾连接到其上的处理节点的存储装置。 该对处理节点的第一处理节点具有在其上运行的第一数据库实例，其在故障之前访问存储设备上的第一数据分区。 在检测到故障时，通过该对处理节点的第二处理节点向第三备用处理节点提供对存储设备上的第一数据分区的访问。 第三处理节点为在其失败之前在第一处理节点上运行的第一数据库实例运行替换数据库实例。 替换数据库实例通过第二处理节点访问存储设备上的第一数据分区，从而从第一处理节点的故障中恢复。 对第一数据分区的访问可以包括使用具有第二处理节点上的服务器部分的虚拟共享磁盘实用程序和第三处理节点上的客户端部分。

公开(公告)号：US07386611B2

公开(公告)日：2008-06-10

申请号：US10315335

申请日：2002-12-10

申请人： Daniel Manuel Dias ,  Richard Pervin King ,  Zhen Liu ,  Mark Steven Squillante ,  Honghui Xia ,  Shun-Zheng Yu ,  Li Zhang

发明人： Daniel Manuel Dias ,  Richard Pervin King ,  Zhen Liu ,  Mark Steven Squillante ,  Honghui Xia ,  Shun-Zheng Yu ,  Li Zhang

IPC分类号： G06F15/173

CPC分类号： H04L29/06 ,  H04L41/142 ,  H04L43/16 ,  H04L47/122 ,  H04L67/1002 ,  H04L67/1008 ,  H04L67/101 ,  H04L67/1012 ,  H04L67/1021 ,  H04L67/1023 ,  H04L67/1029 ,  H04L67/22 ,  H04L69/329 ,  H04L2029/06054

摘要： Apparatus and methods for identifying traffic patterns to web sites based on templates that characterize the arrival of traffic to the web sites are provided. Based on these templates, determinations are made as to which web sites should be co-located so as to optimize resource allocation. Specifically, web sites whose templates are complimentary, i.e. a first web site having a peak in arrival traffic at time t1 and a second web site that has a trough in arrival traffic at time t1, are designated as being candidates for co-location. In addition, the present invention uses the templates identified for the traffic patterns of web sites to determine thresholds for offloading traffic to other servers. These thresholds include a first threshold at which offloading should be performed, a second threshold that takes into consideration the lead time needed to begin offloading, and a third threshold that takes into consideration a lag time needed to stop all offloading of traffic to the other servers.

摘要翻译： 提供了基于表征网站到达流量的模板来识别网站的流量模式的装置和方法。 基于这些模板，确定哪些网站应该位于同一位置，以优化资源分配。 具体来说，其模板是免费的网站，即在时间t 1处具有到达业务峰值的第一网站和在时间t 1处具有到达业务波谷的第二网站被指定为用于共同定位的候选 。 此外，本发明使用为网站的流量模式识别的模板来确定将流量卸载到其他服务器的阈值。 这些阈值包括应该执行卸载的第一阈值，考虑到开始卸载所需的前置时间的第二阈值，以及考虑到停止对其他服务器的所有卸载流量所需的滞后时间的第三阈值 。

公开(公告)号：US5805785A

公开(公告)日：1998-09-08

申请号：US606765

申请日：1996-02-27

申请人： Daniel Manuel Dias ,  Richard Pervin King ,  Avraham Leff

发明人： Daniel Manuel Dias ,  Richard Pervin King ,  Avraham Leff

IPC分类号： G06F11/14 ,  G06F11/00

CPC分类号： G06F11/1438

摘要： A system and method for a general and extensible infrastructure providing monitoring and recovery of interdependent systems in a distributed/clustered system is disclosed. Subsystems, built without provision for high availability, are incorporated into the infrastructure without modification to core subsystem function. The infrastructure is comprised of one or more computing nodes connected by one or more interconnection networks, and running one or more distributed subsystems. The infrastructure monitors the computing nodes using one or more heartbeat and membership protocols, and monitors the said distributed subsystems by subsystem-specific monitors. Events detected by monitors are sent to event handlers. Event handlers process events by filtering them through activities such as event correlation, removal of duplicates, and rollup. Filtered events are given by Event Managers to Recovery Drivers which determine the recovery program corresponding to the event, and executing the recovery program or set of recovery actions by coordination among the recovery managers. Given failures of said event handlers or recovery managers, the infrastructure performs the additional steps of: coordinating among remaining event handlers and recovery managers to handle completion or termination of ongoing recovery actions, discovering the current state of the system by resetting the said monitors, and handling any new failure events that may have occurred in the interim.

摘要翻译： 公开了一种用于在分布式/集群系统中提供相互依赖系统的监视和恢复的通用和可扩展基础设施的系统和方法。 没有为高可用性提供配置的子系统被并入基础设施，而不改变核心子系统功能。 基础设施由一个或多个由一个或多个互连网络连接的计算节点组成，并运行一个或多个分布式子系统。 基础设施使用一个或多个心跳和成员资格协议监视计算节点，并通过子系统监视器来监视所述分布式子系统。 监视器检测到的事件将发送到事件处理程序。 事件处理程序通过过滤事件来处理事件，例如事件关联，删除重复项和汇总。 已过滤的事件由事件管理器提供给恢复驱动程序，其确定与事件相对应的恢复程序，以及通过恢复管理器之间的协调来执行恢复程序或一组恢复操作。 鉴于所述事件处理程序或恢复管理器的故障，基础架构执行以下附加步骤：在剩余事件处理程序和恢复管理器之间进行协调以处理正在进行的恢复操作的完成或终止，通过重置所述监视器来发现系统的当前状态，以及 处理可能在过渡期间发生的任何新的故障事件。

公开(公告)号：US06598121B2

公开(公告)日：2003-07-22

申请号：US09993837

申请日：2001-11-06

申请人： James R. H. Challenger ,  Paul Michael Dantzig ,  Daniel Manuel Dias ,  Arun Kwangil Iyengar ,  Eric M. Levy-Abegnoli

发明人： James R. H. Challenger ,  Paul Michael Dantzig ,  Daniel Manuel Dias ,  Arun Kwangil Iyengar ,  Eric M. Levy-Abegnoli

IPC分类号： G06F1200

CPC分类号： G06F12/0811 ,  G06F12/121

摘要： A system and method for hierarchically caching objects includes one or more level 1 nodes, each including at least one level 1 cache; one or more level 2 nodes within which the objects are permanently stored or generated upon request, each level 2 node coupled to at least one of the one or more level 1 nodes and including one or more level 2 caches; and means for storing, in a coordinated manner, one or more objects in at least one level 1 cache and/or at least one level 2 cache, based on a set of one or more criteria. Furthermore, in a system adapted to receive requests for objects from one or more clients, the system having a set of one or more level 1 nodes, each containing at least one level 1 cache, a method for managing a level 1 cache includes the steps of applying, for part of the at least one level 1 cache, a cache replacement policy designed to minimize utilization of a set of one or more resources in the system; and using, for other parts of the at least one level 1 cache, one or more other cache replacement policies designed to minimize utilization of one or more other sets of one or more resources in the system.

公开(公告)号：US06338117B1

公开(公告)日：2002-01-08

申请号：US09141979

申请日：1998-08-28

申请人： James R. H. Challenger ,  Paul Michael Dantzig ,  Daniel Manuel Dias ,  Arun Kwangil Iyengar ,  Eric M. Levy-Abegnoli

发明人： James R. H. Challenger ,  Paul Michael Dantzig ,  Daniel Manuel Dias ,  Arun Kwangil Iyengar ,  Eric M. Levy-Abegnoli

IPC分类号： G06F1200

CPC分类号： G06F12/0811 ,  G06F12/121

摘要： A system and method for hierarchically caching objects includes one or more level 1 nodes, each including at least one level 1 cache; one or more level 2 nodes within which the objects are permanently stored or generated upon request, each level 2 node coupled to at least one of the one or more level 1 nodes and including one or more level 2 caches; and a storage control device for storing, in a coordinated manner, one or more objects in at least one level 1 cache and/or at least one level 2 cache, based on a set of one or more criteria. Furthermore, in a system for receiving requests for objects from one or more clients, the system having a set of one or more level 1 nodes, each containing at least one level 1 cache, a method for managing a level 1 cache includes the steps of applying, for part of the at least one level 1 cache, a cache replacement policy designed to minimize utilization of a set of one or more resources in the system; and using, for other parts of the at least on level 1 cache, one or more other cache replacement policies designed to minimize utilization of one or more other sets of one or more resources in the system.

摘要翻译： 用于分级缓存对象的系统和方法包括一个或多个1级节点，每个节点包括至少一个级别1高速缓存; 一个或多个2级节点，其中对象在请求时永久地存储或生成，每个级别2节点耦合到一个或多个级别1节点中的至少一个并且包括一个或多个级别2高速缓存; 以及存储控制设备，用于基于一组或多个标准，以协调的方式存储至少一级1缓存和/或至少一级2缓存中的一个或多个对象。 此外，在用于从一个或多个客户端接收对象的请求的系统中，系统具有一个或多个1级节点的集合，每个节点包含至少一个级别1高速缓存，用于管理级别1高速缓存的方法包括以下步骤： 对所述至少一个级别1缓存的一部分应用设计为最小化所述系统中的一个或多个资源的集合的利用的高速缓存替换策略; 以及为所述至少一级缓存的其他部分使用被设计为最小化所述系统中的一个或多个资源的一个或多个其他集合的利用的一个或多个其他高速缓存替换策略。

公开(公告)号：US06842783B1

公开(公告)日：2005-01-11

申请号：US09506603

申请日：2000-02-18

申请人： Richard Harold Boivie ,  Daniel Manuel Dias ,  Colin George Harrison ,  Eric M. Levy-Abegnoli ,  Jean A. Lorrain ,  Kiyoshi Maruyama ,  Pascal Pol Marie Thubert

发明人： Richard Harold Boivie ,  Daniel Manuel Dias ,  Colin George Harrison ,  Eric M. Levy-Abegnoli ,  Jean A. Lorrain ,  Kiyoshi Maruyama ,  Pascal Pol Marie Thubert

IPC分类号： G06F11/00 ,  G06F15/16 ,  G06F15/173 ,  H04L12/24 ,  H04L12/26

CPC分类号： H04L43/00 ,  H04L41/0896 ,  H04L41/5003 ,  H04L41/5019 ,  H04L43/0829 ,  H04L43/16 ,  H04L47/20 ,  H04L47/70 ,  H04L47/745

摘要： A method and system for controlling and guaranteeing a service level agreement (SLA) based on a communications outbound link bandwidth usage to a plurality of customers having electronic business activity hosted by at least one server as a server farm, includes monitoring the outbound communications bandwidth usage by each customer traffic to determine a level of service being provided to each customer with respect to the agreed service level agreement in each service cycle time per unit of time. The flow of incoming requests to each customer business activity application is controlled so as to guarantee a level of service previously agreed to the customer by queuing requests to the customer and by selectively dropping requests to the customer to guarantee the agreed service levels to the customer. The controlling process controls and guarantees each outbound link usage based service level agreement by controlling the flow of incoming requests to the at least one server.

摘要翻译： 一种用于控制和保证服务水平协议（SLA）的方法和系统，所述方法和系统基于对由至少一个服务器作为服务器场托管的具有电子商务活动的多个客户的通信出站链路带宽使用，包括监视出站通信带宽使用 通过每个客户流量来确定在每单位时间的每个服务周期时间内针对约定的服务水平协议来向每个客户提供的服务水平。 对每个客户业务活动应用的传入请求的流量进行控制，以便通过将请求排队到客户并且通过有选择地将请求删除给客户以保证向客户达成约定的服务级别来保证先前同意客户的服务水平。 控制过程通过控制到至少一个服务器的传入请求的流程来控制和保证每个出站链路使用基于服务级别的协议。