-
公开(公告)号:US20210099532A1
公开(公告)日:2021-04-01
申请号:US16586641
申请日:2019-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Nalin Goel , Harvo Reyzell Jones
Abstract: A system and method for management of communications for components in a global accelerator system is provided. The global accelerator system includes client devices communicating with a global access point via a public network to access various endpoints that can host services. In turn, a global access point communicates to various endpoints, which are organized into different data centers, via a private network. To facilitate exchanges on behalf of different client devices, the global access points can characterize groupings of endpoints into subgroups or braids. Individual braid communications can be encapsulated and are routed at the data center by a networking equipment using 5-tuple information in packets. The components within individual braids can broadcast or multi-cast state information via management messages to ensure failover or mitigate duplicative processing.
-
公开(公告)号:US11451477B2
公开(公告)日:2022-09-20
申请号:US16586446
申请日:2019-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Nalin Goel , Harvo Reyzell Jones
IPC: H04L47/125 , H04L45/00 , H04L45/7453 , H04L61/4511 , H04L61/5007 , H04L61/5069 , H04L67/1001 , H04L45/02 , H04L67/10 , H04L67/14 , H04L69/16 , H04L69/40 , H04L61/5061 , H04L61/2514 , H04L61/2517
Abstract: A system and method for endpoint selection in a global accelerator system. The global accelerator system includes client devices communicating with a global access point to access various endpoints that can host services. Multiple endpoints are grouped geographically according to different data centers. Client service requests are received at a global access point, which in turns selects an endpoint to service the request. A selection mechanism utilized by the global access point implements a distribution algorithm that facilitates that distribution of endpoint requests according to a product of distribution criteria and geographic criteria. Additionally, the global access point can then identify individual endpoints within the group to process the request using a consistent hashing algorithm that ensures an endpoint can be continuously selected over the course of interaction with a client.
-
公开(公告)号:US10972554B1
公开(公告)日:2021-04-06
申请号:US16586641
申请日:2019-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Nalin Goel , Harvo Reyzell Jones
Abstract: A system and method for management of communications for components in a global accelerator system is provided. The global accelerator system includes client devices communicating with a global access point via a public network to access various endpoints that can host services. In turn, a global access point communicates to various endpoints, which are organized into different data centers, via a private network. To facilitate exchanges on behalf of different client devices, the global access points can characterize groupings of endpoints into subgroups or braids. Individual braid communications can be encapsulated and are routed at the data center by a networking equipment using 5-tuple information in packets. The components within individual braids can broadcast or multi-cast state information via management messages to ensure failover or mitigate duplicative processing.
-
公开(公告)号:US20210099396A1
公开(公告)日:2021-04-01
申请号:US16586510
申请日:2019-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Nalin Goel
IPC: H04L12/801 , H04L12/803
Abstract: A system and method for management of communications for components of a global accelerator system is provided. The global accelerator system includes client devices communicating with a global access point via a public network to access various endpoints that can host services. In turn, a global access point communicates to various endpoints, which are organized into different data centers, via a private network. A global access point creates and manages separate TCP connections between the client and global access point and the client and endpoint to improve first byte latency experienced by clients that leverage the data throughput resources of the private network.
-
公开(公告)号:US20210099386A1
公开(公告)日:2021-04-01
申请号:US16586446
申请日:2019-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Nalin Goel , Harvo Reyzell Jones
IPC: H04L12/803 , H04L29/12 , H04L12/721 , H04L29/08 , H04L12/743
Abstract: A system and method for endpoint selection in a global accelerator system. The global accelerator system includes client devices communicating with a global access point to access various endpoints that can host services. Multiple endpoints are grouped geographically according to different data centers. Client service requests are received at a global access point, which in turns selects an endpoint to service the request. A selection mechanism utilized by the global access point implements a distribution algorithm that facilitates that distribution of endpoint requests according to a product of distribution criteria and geographic criteria. Additionally, the global access point can then identify individual endpoints within the group to process the request using a consistent hashing algorithm that ensures an endpoint can be continuously selected over the course of interaction with a client.
-
公开(公告)号:US11552898B2
公开(公告)日:2023-01-10
申请号:US16586510
申请日:2019-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Nalin Goel
IPC: H04L47/34 , H04L47/125 , H04L47/193
Abstract: A system and method for management of communications for components of a global accelerator system is provided. The global accelerator system includes client devices communicating with a global access point via a public network to access various endpoints that can host services. In turn, a global access point communicates to various endpoints, which are organized into different data centers, via a private network. A global access point creates and manages separate TCP connections between the client and global access point and the client and endpoint to improve first byte latency experienced by clients that leverage the data throughput resources of the private network.
-
公开(公告)号:US11431577B1
公开(公告)日:2022-08-30
申请号:US17146317
申请日:2021-01-11
Applicant: Amazon Technologies, Inc.
Inventor: Nalin Goel , Jason Messer
IPC: H04L41/12 , H04L45/7453 , H04L45/16 , H04L41/0893
Abstract: A system and method for endpoint selection in a global accelerator system. The global accelerator system includes client devices communicating with a global access point to access various endpoints that can host services. The access points may calculate ranked lists of the plurality of endpoints based on a selection algorithm for the access points and select, for each access point, one of the plurality of endpoints based on the ranked lists before routing the received packets to the selected endpoints by each respective access point.
-
公开(公告)号:US11425042B2
公开(公告)日:2022-08-23
申请号:US16586485
申请日:2019-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Nalin Goel
IPC: H04L47/125 , H04L67/141 , H04L69/326 , H04L67/1001 , H04L61/4511
Abstract: A system and method for management of communications for components of a global accelerator system is provided. The global accelerator system includes client devices communicating with a global access point via a public network to access various endpoints that can host services. In turn, a global access point communicates to various endpoints, which are organized into different data centers, via a private network. The global access point creates and manages separate TCP connections between the client and global access point and the client and endpoint to improve latency experienced by clients. Additionally, each TCP connection can be managed by specifying different congestion control and windowing parameters to leverage higher throughput between the global access point and a selected endpoint.
-
公开(公告)号:US20210099387A1
公开(公告)日:2021-04-01
申请号:US16586485
申请日:2019-09-27
Applicant: Amazon Technologies, Inc.
Inventor: Nalin Goel
IPC: H04L12/803 , H04L29/08
Abstract: A system and method for management of communications for components of a global accelerator system is provided. The global accelerator system includes client devices communicating with a global access point via a public network to access various endpoints that can host services. In turn, a global access point communicates to various endpoints, which are organized into different data centers, via a private network. The global access point creates and manages separate TCP connections between the client and global access point and the client and endpoint to improve latency experienced by clients. Additionally, each TCP connection can be managed by specifying different congestion control and windowing parameters to leverage higher throughput between the global access point and a selected endpoint.
-
-
-
-
-
-
-
-