Reducing workload on a backend system using client side request throttling
    1.
    发明授权
    Reducing workload on a backend system using client side request throttling 失效
    使用客户端请求限制减少后端系统的工作负载

    公开(公告)号:US08200812B2

    公开(公告)日:2012-06-12

    申请号:US12651197

    申请日:2009-12-31

    IPC分类号: G06F15/173 G06F15/16

    摘要: Embodiments of the present invention address deficiencies of the art in respect to workload management of backend systems and provide a novel and non-obvious method, system and computer program product for limiting a request rate from a client based on a health state of a server system. In one embodiment of the invention, a computer-implemented method for limiting a request rate from a client based on a health state of a server system that includes monitoring a server system, determining a measure of health of the server system, sending the determined measure of health to a client submitting a request to the server system and receiving a subsequent request from the client that is delayed by a time period, wherein the time period is based at least in part upon the determined measure of health. The computer-implemented method can further include receiving server system CPU utilization, determining an approximate predicted real server response time of a transaction and sending the determined approximate predicted real server response time of a transaction to a client submitting a request to the server system.

    摘要翻译: 本发明的实施例解决了本领域在后端系统的工作负载管理方面的缺陷,并且提供了一种基于服务器系统的健康状态来限制来自客户端的请求速率的新颖且非显而易见的方法,系统和计算机程序产品 。 在本发明的一个实施例中,一种用于基于服务器系统的健康状态来限制来自客户端的请求速率的计算机实现的方法,所述服务器系统包括监视服务器系统,确定服务器系统的健康度量,发送所确定的测量 向客户端提交对服务器系统的请求并从客户端接收延迟时间段的后续请求,其中该时间段至少部分地基于所确定的健康度量。 计算机实现的方法还可以包括接收服务器系统CPU利用率,确定交易的近似预测的实际服务器响应时间,并将所确定的交易的近似预测真实服务器响应时间发送给向服务器系统提交请求的客户端。

    REDUCING WORKLOAD ON A BACKEND SYSTEM USING CLIENT SIDE REQUEST THROTTLING
    2.
    发明申请
    REDUCING WORKLOAD ON A BACKEND SYSTEM USING CLIENT SIDE REQUEST THROTTLING 失效
    使用客户端请求转向减少后台系统上的工作负载

    公开(公告)号:US20110161488A1

    公开(公告)日:2011-06-30

    申请号:US12651197

    申请日:2009-12-31

    IPC分类号: G06F15/173

    摘要: Embodiments of the present invention address deficiencies of the art in respect to workload management of backend systems and provide a novel and non-obvious method, system and computer program product for limiting a request rate from a client based on a health state of a server system. In one embodiment of the invention, a computer-implemented method for limiting a request rate from a client based on a health state of a server system that includes monitoring a server system, determining a measure of health of the server system, sending the determined measure of health to a client submitting a request to the server system and receiving a subsequent request from the client that is delayed by a time period, wherein the time period is based at least in part upon the determined measure of health. The computer-implemented method can further include receiving server system CPU utilization, determining an approximate predicted real server response time of a transaction and sending the determined approximate predicted real server response time of a transaction to a client submitting a request to the server system.

    摘要翻译: 本发明的实施例解决了本领域在后端系统的工作负载管理方面的缺陷,并且提供了一种基于服务器系统的健康状态来限制来自客户端的请求速率的新颖且非显而易见的方法,系统和计算机程序产品 。 在本发明的一个实施例中,一种用于基于服务器系统的健康状态来限制来自客户端的请求速率的计算机实现的方法,所述服务器系统包括监视服务器系统,确定服务器系统的健康度量,发送所确定的测量 向客户端提交对服务器系统的请求并从客户端接收延迟时间段的后续请求,其中该时间段至少部分地基于所确定的健康度量。 计算机实现的方法还可以包括接收服务器系统CPU利用率,确定交易的近似预测的实际服务器响应时间,并将所确定的交易的近似预测真实服务器响应时间发送给向服务器系统提交请求的客户端。

    Dynamic structural management of a distributed caching infrastructure
    5.
    发明授权
    Dynamic structural management of a distributed caching infrastructure 有权
    分布式缓存基础架构的动态结构管理

    公开(公告)号:US09390146B2

    公开(公告)日:2016-07-12

    申请号:US13406846

    申请日:2012-02-28

    IPC分类号: G06F15/16 G06F17/30

    摘要: Embodiments of the present invention provide a method, system and computer program product for the dynamic structural management of an n-Tier distributed caching infrastructure. In an embodiment of the invention, a method of dynamic structural management of an n-Tier distributed caching infrastructure includes establishing a communicative connection to a plurality of cache servers arranged in respective tier nodes in an n-Tier cache, collecting performance metrics for each of the cache servers in the respective tier nodes of the n-Tier cache, identifying a characteristic of a specific cache resource in a corresponding one of the tier nodes of the n-Tier crossing a threshold, and dynamically structuring a set of cache resources including the specific cache resource to account for the identified characteristic.

    摘要翻译: 本发明的实施例提供了一种用于n层分布式缓存基础设施的动态结构管理的方法,系统和计算机程序产品。 在本发明的一个实施例中,n层分布式缓存基础设施的动态结构管理方法包括:建立与n层缓存中相应层节点中排列的多个高速缓存服务器的通信连接, 在n层缓存的相应层节点中的高速缓存服务器,识别穿过阈值的n层的对应的一个层节点中的特定高速缓存资源的特性,以及动态地构建一组高速缓存资源,包括 特定的缓存资源来解释识别的特征。

    Dual timeout caching
    6.
    发明授权
    Dual timeout caching 有权
    双超时缓存

    公开(公告)号:US08296523B2

    公开(公告)日:2012-10-23

    申请号:US12651306

    申请日:2009-12-31

    IPC分类号: G06F12/00

    CPC分类号: G06F12/121

    摘要: Embodiments of the present invention provide a method, system and computer program product for dual timer fragment caching. In an embodiment of the invention, a dual timer fragment caching method can include establishing both a soft timeout and also a hard timeout for each fragment in a fragment cache. The method further can include managing the fragment cache by evicting fragments in the fragment cache subsequent to a lapsing of a corresponding hard timeout. The management of the fragment cache also can include responding to multiple requests by multiple requestors for a stale fragment in the fragment cache with a lapsed corresponding soft timeout by returning the stale fragment from the fragment cache to some of the requestors, by retrieving and returning a new form of the stale fragment to others of the requestors, and by replacing the stale fragment in the fragment cache with the new form of the stale fragment with a reset soft timeout and hard timeout.

    摘要翻译: 本发明的实施例提供了一种用于双计时器片段缓存的方法,系统和计算机程序产品。 在本发明的实施例中,双重定时器片段缓存方法可以包括为片段高速缓存中的每个片段建立软超时和硬超时。 该方法还可以包括通过在对应的硬超时的中断之后驱逐片段高速缓存中的片段来管理片段高速缓存。 片段缓存的管理还可以包括响应多个请求者对片段高速缓存中的陈旧片段的多个请求,通过将片段高速缓存中的过期片段返回给某些请求者,通过检索并返回 将新形式的陈旧片段提交给请求者的其他人,并通过重置软超时和硬超时将片段缓存中的陈旧片段替换为新形式的陈旧片段。

    Providing high availability to a hybrid application server environment containing non-java containers
    7.
    发明授权
    Providing high availability to a hybrid application server environment containing non-java containers 有权
    为包含非java容器的混合应用程序服务器环境提供高可用性

    公开(公告)号:US08972802B2

    公开(公告)日:2015-03-03

    申请号:US13559860

    申请日:2012-07-27

    IPC分类号: G06F11/00

    CPC分类号: G06F9/485 G06F2209/482

    摘要: A method, system and computer program product for providing high availability to a hybrid application server environment containing non-Java® containers. Each hybrid application server in the cluster includes a Java® container and a non-Java® container hosting Java® and non-Java® applications, respectively. Upon detecting the non-Java® container becoming unavailable (failing), an object, such as an MBean, identifies and deactivates those Java® application(s) that are dependent on the non-Java® application(s) deployed in the unavailable non-Java® container using dependency information stored in an application framework. The deactivated Java® application(s) are marked as being unavailable. A routing agent continues to send requests to those Java® application(s) that are not marked as being unavailable within that hybrid application server containing the unavailable non-Java® container. As a result of not deactivating the entire hybrid application server containing the unavailable non-Java® container, unimpacted applications continue to service requests thereby optimally using the resources.

    摘要翻译: 一种用于向包含非Java®容器的混合应用程序服务器环境提供高可用性的方法,系统和计算机程序产品。 集群中的每个混合应用程序服务器分别包含Java®容器和一个托管Java®和非Java®应用程序的非Java®容器。 当检测到非Java®容器变得不可用(失败)时,诸如MBean之类的对象识别和停用那些依赖于部署在不可用非Java应用程序中的非Java®应用程序的Java®应用程序 -Java®容器使用存储在应用程序框架中的依赖性信息。 停用的Java®应用程序被标记为不可用。 路由代理继续向包含不可用非Java®容器的混合应用程序服务器中未标记为不可用的Java®应用程序发送请求。 由于未禁用包含不可用非Java®容器的整个混合应用程序服务器的结果,未受限制的应用程序继续服务请求,从而最佳地使用资源。

    PROVIDING HIGH AVAILABILITY TO A HYBRID APPLICATION SERVER ENVIRONMENT CONTAINING NON-JAVA CONTAINERS
    8.
    发明申请
    PROVIDING HIGH AVAILABILITY TO A HYBRID APPLICATION SERVER ENVIRONMENT CONTAINING NON-JAVA CONTAINERS 有权
    为包含非JAVA容器的混合应用服务器环境提供高可用性

    公开(公告)号:US20140033205A1

    公开(公告)日:2014-01-30

    申请号:US13559860

    申请日:2012-07-27

    IPC分类号: G06F9/46

    CPC分类号: G06F9/485 G06F2209/482

    摘要: A method, system and computer program product for providing high availability to a hybrid application server environment containing non-Java® containers. Each hybrid application server in the cluster includes a Java® container and a non-Java® container hosting Java® and non-Java® applications, respectively. Upon detecting the non-Java® container becoming unavailable (failing), an object, such as an MBean, identifies and deactivates those Java® application(s) that are dependent on the non-Java® application(s) deployed in the unavailable non-Java® container using dependency information stored in an application framework. The deactivated Java® application(s) are marked as being unavailable. A routing agent continues to send requests to those Java® application(s) that are not marked as being unavailable within that hybrid application server containing the unavailable non-Java® container. As a result of not deactivating the entire hybrid application server containing the unavailable non-Java® container, unimpacted applications continue to service requests thereby optimally using the resources.

    摘要翻译: 一种用于向包含非Java®容器的混合应用程序服务器环境提供高可用性的方法,系统和计算机程序产品。 集群中的每个混合应用程序服务器分别包含Java®容器和一个托管Java®和非Java®应用程序的非Java®容器。 当检测到非Java®容器变得不可用(失败)时,诸如MBean之类的对象识别和停用那些依赖于部署在不可用非Java应用程序中的非Java®应用程序的Java®应用程序 -Java®容器使用存储在应用程序框架中的依赖性信息。 停用的Java®应用程序被标记为不可用。 路由代理继续向包含不可用非Java®容器的混合应用程序服务器中未标记为不可用的Java®应用程序发送请求。 由于未禁用包含不可用非Java®容器的整个混合应用程序服务器的结果,未受影响的应用程序继续服务请求,从而最佳地使用资源。

    Estimating the size of an in-memory cache
    9.
    发明授权
    Estimating the size of an in-memory cache 有权
    估计内存中缓存的大小

    公开(公告)号:US08140815B2

    公开(公告)日:2012-03-20

    申请号:US13219186

    申请日:2011-08-26

    IPC分类号: G06F12/00 G06F13/00 G06F13/28

    摘要: This Sampling Object Cache System (“SOCS”) estimates the size of an in-memory heap-based object cache without the need to serialize every object within the cache. SOCS samples objects at a user-determined rate and then computes a “sample size average” for each type of class—whether a top class, type of top class or non top class. Using these sample size averages, a statistically accurate measure of the overall size of the cache is calculated by adding together the total size of the objects in the cache for each class type.

    摘要翻译: 此采样对象缓存系统(“SOCS”)估计内存堆内对象缓存的大小,而无需序列化高速缓存中的每个对象。 SOCS以用户确定的速率对对象进行采样,然后针对每种类型的类来计算“样本大小平均值” - 无论是顶级类,顶级类还是非顶级类。 使用这些样本大小平均值,通过将每个类类型的缓存中的对象的总大小相加,计算出缓存总体大小的统计学上精确的度量。

    Defining enforcing and governing performance goals of a distributed caching infrastructure

    公开(公告)号:US09760405B2

    公开(公告)日:2017-09-12

    申请号:US12605136

    申请日:2009-10-23

    IPC分类号: G06F15/16 G06F9/50

    CPC分类号: G06F9/5016

    摘要: Embodiments of the present invention provide a method, system and computer program product for enforcing performance goals in an n-Tier distributed caching infrastructure. In an embodiment of the invention, a method of enforcing performance goals in an n-Tier distributed caching infrastructure can include establishing a communicative connection to multiple different cache servers arranged in respective tier nodes in an n-Tier cache. The method also can include collecting performance metrics for each of the cache servers in the respective tier nodes of the n-Tier cache and identifying a cache server amongst the cache servers in respective tier nodes of the n-Tier demonstrating a performance likely to breach at least one term of an SLA. Finally, the method can include applying a remedial measure to the identified cache server.