Invention Grant
- Patent Title: Systems and techniques for utilizing resource aware queues and/or service sharing in a multi-server environment
-
Application No.: US16568149Application Date: 2019-09-11
-
Publication No.: US11153371B2Publication Date: 2021-10-19
- Inventor: Ronald Yang , Vijayanth Devadhar , Manoj Cheenath
- Applicant: salesforce.com, inc.
- Applicant Address: US CA San Francisco
- Assignee: salesforce.com, inc.
- Current Assignee: salesforce.com, inc.
- Current Assignee Address: US CA San Francisco
- Agency: Jaffery Watson Mendonsa & Hamilton LLP
- Main IPC: G06N20/00
- IPC: G06N20/00 ; H04L29/08 ; H04L12/861 ; G06F16/2455 ; G06F9/50 ; H04L12/26 ; H04L12/803

Abstract:
Systems and techniques for utilizing resource aware queues and/or service sharing in a multi-server environment. According to an example, an application server employs a traffic light metaphor to represent a utilization level of resources of the application server by associating a traffic light with each resource. A mapping is maintained that associates service requests with corresponding sets of affected traffic lights. A deferred queue is maintained for each traffic light to facilitate throttling of service requests directed to the application server that involve a resource that is under pressure. Responsive to receiving a service request directed to the application server, the service request is added directly or indirectly to one of multiple queues maintained in front of the application server based on a priority associated with the service request. Service requests are serviced from the queues in accordance with a priority associated with the queues.
Public/Granted literature
Information query