公开(公告)号：US20110270908A1

公开(公告)日：2011-11-03

申请号：US12768750

申请日：2010-04-28

申请人： Randall Kern ,  Parveen Patel ,  Lihua Yuan ,  Anil K. Ruia ,  Won Suk Yoo

发明人： Randall Kern ,  Parveen Patel ,  Lihua Yuan ,  Anil K. Ruia ,  Won Suk Yoo

IPC分类号： G06F15/16

CPC分类号： H04L45/24

摘要： Architecture that facilitates the capture of connection state of a connection established between a client and an intermediate server and forwards the state to one or more target servers. A software component at the target server (as well as the intermediate server) uses this connection state to reply back to the client directly, thereby bypassing the intermediate server. All packets from the client related to the request are received at the intermediate server and then forwarded to the target server. The migration can be accomplished without any change in the client operating system and client applications, without assistance from a gateway device such as a load balancer or the network, without duplication of all packets between the multiple servers, and without changes to the transport layer stack of the intermediate and target servers.

摘要翻译： 架构，便于捕获在客户端和中间服务器之间建立的连接的连接状态，并将状态转发到一个或多个目标服务器。 目标服务器（以及中间服务器）上的软件组件使用此连接状态直接回复客户端，从而绕过中间服务器。 来自客户端的与请求相关的所有数据包都在中间服务器处接收，然后转发到目标服务器。 无需客户端操作系统和客户端应用程序的任何更改即可完成迁移，无需网关设备（如负载平衡器或网络）进行协助，而不会在多个服务器之间复制所有数据包，而无需更改传输层堆栈 的中间和目标服务器。

公开(公告)号：US08478813B2

公开(公告)日：2013-07-02

申请号：US12768750

申请日：2010-04-28

申请人： Randall Kern ,  Parveen Patel ,  Lihua Yuan ,  Anil K. Ruia ,  Wok Suk Yoo

发明人： Randall Kern ,  Parveen Patel ,  Lihua Yuan ,  Anil K. Ruia ,  Wok Suk Yoo

IPC分类号： G06F15/16

CPC分类号： H04L45/24

摘要： Architecture that facilitates the capture of connection state of a connection established between a client and an intermediate server and forwards the state to one or more target servers. A software component at the target server (as well as the intermediate server) uses this connection state to reply back to the client directly, thereby bypassing the intermediate server. All packets from the client related to the request are received at the intermediate server and then forwarded to the target server. The migration can be accomplished without any change in the client operating system and client applications, without assistance from a gateway device such as a load balancer or the network, without duplication of all packets between the multiple servers, and without changes to the transport layer stack of the intermediate and target servers.

摘要翻译： 架构，便于捕获在客户端和中间服务器之间建立的连接的连接状态，并将状态转发到一个或多个目标服务器。 目标服务器（以及中间服务器）上的软件组件使用此连接状态直接回复客户端，从而绕过中间服务器。 来自客户端的与请求相关的所有数据包都在中间服务器处接收，然后转发到目标服务器。 无需客户端操作系统和客户端应用程序的任何更改即可完成迁移，无需网关设备（如负载平衡器或网络）进行协助，而不会在多个服务器之间复制所有数据包，而无需更改传输层堆栈 的中间和目标服务器。

公开(公告)号：US09807468B2

公开(公告)日：2017-10-31

申请号：US12485090

申请日：2009-06-16

申请人： Won Suk Yoo ,  Anil K. Ruia ,  Himanshu Patel ,  Ning Lin ,  Chittaranjan Pattekar

发明人： Won Suk Yoo ,  Anil K. Ruia ,  Himanshu Patel ,  Ning Lin ,  Chittaranjan Pattekar

IPC分类号： G06F15/16 ,  H04N21/643 ,  H04L29/06 ,  H04N21/231 ,  H04N21/61 ,  H04L29/08

CPC分类号： H04N21/64322 ,  H04L65/605 ,  H04L65/608 ,  H04L65/80 ,  H04L67/2819 ,  H04L67/2842 ,  H04L67/2852 ,  H04N21/23106 ,  H04N21/6125

摘要： A caching system segments content into multiple, individually cacheable chunks cached by a cache server that caches partial content and serves byte range requests with low latency and fewer duplicate requests to an origin server. The system receives a request from a client for a byte range of a content resource. The system determines the chunks overlapped by the specified byte range and sends a byte range request to the origin server for the overlapped chunks not already stored in a cache. The system stores the bytes of received responses as chunks in the cache and responds to the received request using the chunks stored in the cache. The system serves subsequent requests that overlap with previously requested ranges of bytes from the already retrieved chunks in the cache and makes requests to the origin server only for those chunks that a client has not previously requested.

公开(公告)号：US08073952B2

公开(公告)日：2011-12-06

申请号：US12427774

申请日：2009-04-22

申请人： Won Suk Yoo ,  Anil K. Ruia ,  Himanshu Patel ,  Ning Lin

发明人： Won Suk Yoo ,  Anil K. Ruia ,  Himanshu Patel ,  Ning Lin

IPC分类号： G06F15/173

CPC分类号： H04L67/1008 ,  H04L67/1002

摘要： A load balancing system is described herein that proactively balances client requests among multiple destination servers using information about anticipated loads or events on each destination server to inform the load balancing decision. The system detects one or more upcoming events that will affect the performance and/or capacity for handling requests of a destination server. Upon detecting the event, the system informs the load balancer to drain connections around the time of the event. Next, the event occurs on the destination server, and the system detects when the event is complete. In response, the system informs the load balancer to restore connections to the destination server. In this way, the system is able to redirect clients to other available destination servers before the tasks occur. Thus, the load balancing system provides more efficient routing of client requests and improves responsiveness.

摘要翻译： 这里描述了一种负载平衡系统，它使用关于每个目的地服务器上的预期负载或事件的信息来主动平衡多个目的地服务器之间的客户端请求以通知负载平衡决定。 系统检测将影响目标服务器请求的性能和/或容量的一个或多个即将到来的事件。 在检测到事件时，系统通知负载平衡器在事件发生的时间内排除连接。 接下来，事件发生在目标服务器上，系统检测事件何时完成。 作为响应，系统通知负载均衡器恢复与目标服务器的连接。 这样，在任务发生之前，系统能够将客户端重定向到其他可用的目标服务器。 因此，负载平衡系统提供更有效的客户端请求路由并提高响应能力。

公开(公告)号：US20110137888A1

公开(公告)日：2011-06-09

申请号：US12629904

申请日：2009-12-03

申请人： Won Suk Yoo ,  Venkat Raman Don ,  Anil K. Ruia ,  Ning Lin ,  Chittaranjan Pattekar

发明人： Won Suk Yoo ,  Venkat Raman Don ,  Anil K. Ruia ,  Ning Lin ,  Chittaranjan Pattekar

IPC分类号： G06F17/30 ,  G06F12/08

CPC分类号： G06F17/30902

摘要： An intelligent caching system is described herein that intelligently consolidates the name-value pairs in content requests containing query strings so that only substantially non-redundant responses are cached, thereby saving cache proxy resources. The intelligent caching system determines which name-value pairs in the query string can affect the redundancy of the content response and which name-value pairs can be ignored. The intelligent caching system organically builds the list of relevant name-value pairs by relying on a custom response header or other indication from the content server. Thus, the intelligent caching system results in fewer requests to the content server as well as fewer objects in the cache.

摘要翻译： 本文描述了一种智能缓存系统，其智能地整合包含查询字符串的内容请求中的名称 - 值对，使得仅基本上非冗余的响应被缓存，从而节省缓存代理资源。 智能缓存系统确定查询字符串中哪些名称 - 值对可以影响内容响应的冗余，哪些名称 - 值对可以被忽略。 智能缓存系统通过依赖于内容服务器的自定义响应头或其他指示来有机地构建相关名称 - 值对的列表。 因此，智能缓存系统导致对内容服务器的请求减少以及缓存中的较少对象。

公开(公告)号：US20100318632A1

公开(公告)日：2010-12-16

申请号：US12485090

申请日：2009-06-16

申请人： Won Suk Yoo ,  Anil K. Ruia ,  Himanshu Patel ,  Ning Lin ,  Chittaranjan Pattekar

发明人： Won Suk Yoo ,  Anil K. Ruia ,  Himanshu Patel ,  Ning Lin ,  Chittaranjan Pattekar

IPC分类号： G06F15/16 ,  G06F12/08

CPC分类号： H04N21/64322 ,  H04L65/605 ,  H04L65/608 ,  H04L65/80 ,  H04L67/2819 ,  H04L67/2842 ,  H04L67/2852 ,  H04N21/23106 ,  H04N21/6125

摘要： A caching system segments content into multiple, individually cacheable chunks cached by a cache server that caches partial content and serves byte range requests with low latency and fewer duplicate requests to an origin server. The system receives a request from a client for a byte range of a content resource. The system determines the chunks overlapped by the specified byte range and sends a byte range request to the origin server for the overlapped chunks not already stored in a cache. The system stores the bytes of received responses as chunks in the cache and responds to the received request using the chunks stored in the cache. The system serves subsequent requests that overlap with previously requested ranges of bytes from the already retrieved chunks in the cache and makes requests to the origin server only for those chunks that a client has not previously requested.

摘要翻译： 高速缓存系统将内容分成由高速缓存服务器缓存的多个单独可高速缓存的块，该高速缓存服务器缓存部分内容，并向原始服务器提供低延迟和较少重复请求的字节范围请求。 系统从客户端接收内容资源的字节范围的请求。 系统确定与指定字节范围重叠的块，并向原始服务器发送尚未存储在高速缓存中的重叠块的字节范围请求。 系统将接收到的响应的字节作为块存储在高速缓存中，并使用存储在高速缓存中的块来响应接收到的请求。 该系统提供与先前请求的字节范围重叠的后续请求，这些请求范围已经从高速缓存中检索到的块中，并且只向原始服务器请求客户端以前未请求的那些块。

公开(公告)号：US09514243B2

公开(公告)日：2016-12-06

申请号：US12629904

申请日：2009-12-03

申请人： Won Suk Yoo ,  Venkat Raman Don ,  Anil K. Ruia ,  Ning Lin ,  Chittaranjan Pattekar

发明人： Won Suk Yoo ,  Venkat Raman Don ,  Anil K. Ruia ,  Ning Lin ,  Chittaranjan Pattekar

IPC分类号： G06F17/30

CPC分类号： G06F17/30902

摘要： An intelligent caching system is described herein that intelligently consolidates the name-value pairs in content requests containing query strings so that only substantially non-redundant responses are cached, thereby saving cache proxy resources. The intelligent caching system determines which name-value pairs in the query string can affect the redundancy of the content response and which name-value pairs can be ignored. The intelligent caching system organically builds the list of relevant name-value pairs by relying on a custom response header or other indication from the content server. Thus, the intelligent caching system results in fewer requests to the content server as well as fewer objects in the cache.

摘要翻译： 本文描述了一种智能缓存系统，其智能地整合包含查询字符串的内容请求中的名称 - 值对，使得仅基本上非冗余的响应被缓存，从而节省缓存代理资源。 智能缓存系统确定查询字符串中哪些名称 - 值对可以影响内容响应的冗余，哪些名称 - 值对可以被忽略。 智能缓存系统通过依赖于内容服务器的自定义响应头或其他指示来有机地构建相关名称 - 值对的列表。 因此，智能缓存系统导致对内容服务器的请求减少以及缓存中的较少对象。

公开(公告)号：US09058252B2

公开(公告)日：2015-06-16

申请号：US12730271

申请日：2010-03-24

申请人： Won Suk Yoo ,  Wade A. Hilmo ,  Anil K. Ruia ,  Chittaranjan Pattekar ,  Venkat Raman Don

发明人： Won Suk Yoo ,  Wade A. Hilmo ,  Anil K. Ruia ,  Chittaranjan Pattekar ,  Venkat Raman Don

IPC分类号： G06F15/16 ,  G06F15/173 ,  G06F9/46 ,  G06F11/00 ,  H04L12/26

CPC分类号： G06F11/008 ,  H04L43/04 ,  H04L43/06 ,  H04L43/08

摘要： Requests for content can be received from clients and forwarded to servers, and responses to the requests can be received from the servers and forwarded to the clients. A health model can also be maintained. The health model can be based on information in the responses and possibly also on information in the requests, and the health model can indicate the health of the servers in responding to different types of requests. The health model may differentiate between health in responding to requests with different features in URLs of the requests, such as different namespaces and/or different extensions.

摘要翻译： 可以从客户端接收内容请求并转发到服务器，并且可以从服务器接收对请求的响应并转发给客户端。 还可以保持健康模式。 健康模型可以基于响应中的信息，也可以基于请求中的信息，健康模型可以指示服务器在响应不同类型的请求时的健康状况。 健康模型可以区分健康状况以响应请求的URL中具有不同特征的请求，例如不同的命名空间和/或不同的扩展。

公开(公告)号：US08046432B2

公开(公告)日：2011-10-25

申请号：US12425395

申请日：2009-04-17

申请人： Won Suk Yoo ,  Anil K. Ruia ,  Himanshu Patel ,  John A. Bocharov ,  Ning Lin

发明人： Won Suk Yoo ,  Anil K. Ruia ,  Himanshu Patel ,  John A. Bocharov ,  Ning Lin

IPC分类号： G06F15/16 ,  G06F15/167

CPC分类号： H04L67/2842 ,  H04L67/2833 ,  H04L67/2885

摘要： A live caching system is described herein that reduces the burden on origin servers for serving live content. In response to receiving a first request that results in a cache miss, the system forwards the first request to the next tier while “holding” other requests for the same content. If the system receives a second request while the first request is pending, the system will recognize that a similar request is outstanding and hold the second request by not forwarding the request to the origin server. After the response to the first request arrives from the next tier, the system shares the response with other held requests. Thus, the live caching system allows a content provider to prepare for very large events by adding more cache hardware and building out a cache server network rather than by increasing the capacity of the origin server.

摘要翻译： 这里描述了实时缓存系统，其减少了用于服务实况内容的原始服务器的负担。 响应于接收到导致高速缓存未命中的第一请求，系统将第一请求转发到下一层，同时“保持”其他对相同内容的请求。 如果系统在第一个请求未决时接收到第二个请求，则系统将识别出类似的请求未完成，并且通过不将请求转发给原始服务器来保持第二个请求。 在第一个请求的响应从下一个层次到达之后，系统与其他持有的请求共享响应。 因此，实时缓存系统允许内容提供商通过添加更多的高速缓存硬件和构建缓存服务器网络来准备非常大的事件，而不是增加源服务器的容量。

公开(公告)号：US20110131341A1

公开(公告)日：2011-06-02

申请号：US12626957

申请日：2009-11-30

申请人： Won Suk Yoo ,  Venkat Raman Don ,  Anil K. Ruia ,  Ning Lin ,  Chittaranjan Pattekar

发明人： Won Suk Yoo ,  Venkat Raman Don ,  Anil K. Ruia ,  Ning Lin ,  Chittaranjan Pattekar

IPC分类号： G06F15/16

CPC分类号： G06F16/9574

摘要： A selective pre-caching system reduces the amount of content cached at cache proxies by limiting the cached content to that content that a particular cache proxy is responsible for caching. This can substantially reduce the content stored on each cache proxy and reduces the amount of resources consumed for pre-caching in preparation for a particular event. The cache proxy receives a list of content items that and an indication of the topology of the cache network. The cache proxy uses the received topology to determine the content items in the received list of content items that the cache proxy is responsible for caching. The cache proxy then retrieves the determined content items so that they are available in the cache before client requests are received.

摘要翻译： 选择性预缓存系统通过将缓存内容限制为特定缓存代理负责缓存的内容来减少缓存代理缓存的内容量。 这可以显着减少存储在每个缓存代理上的内容，并且减少为预先缓存而消耗的资源量，以准备特定事件。 高速缓存代理接收内容项的列表以及高速缓存网络拓扑的指示。 缓存代理使用接收到的拓扑来确定缓存代理负责缓存的内容项的接收列表中的内容项。 缓存代理然后检索确定的内容项，使得它们在接收到客户端请求之前在高速缓存中可用。