公开(公告)号：US20210263663A1

公开(公告)日：2021-08-26

申请号：US16798008

申请日：2020-02-21

Applicant: salesforce.com, inc.

Inventor： Kaushal BANSAL ,  Rakesh Ganapathi KARANTH ,  Vaibhav TENDULKAR ,  Venkata Muralidhar TEJOMURTULA

IPC: G06F3/06 ,  G06N20/00 ,  G06N5/04

Abstract: Examples include maintaining a virtual pool of containers; receiving a request from a client for one of a plurality of services to performed; when the request includes client code, determining whether the request belongs to regular or priority queue based on two models; adding the request to an appropriate shard in the queue; getting the request from the selected one of the plurality of queues and assigning a container for the request from the virtual pool of containers, the client code to be executed in the container; and after the client code is executed in the container, deleting the container from the virtual pool.

公开(公告)号：US20210234890A1

公开(公告)日：2021-07-29

申请号：US16750892

申请日：2020-01-23

Applicant: salesforce.com, inc.

Inventor： Kaushal BANSAL ,  Vaibhav TENDULKAR ,  Rakesh Ganapathi KARANTH ,  Fangchen Richard SUN

IPC: H04L29/06 ,  G06N20/00 ,  G06N5/04

Abstract: Examples include a method of predictive rate limiting for performing services requested by a client in a cloud computing system. The method includes receiving a request from a client for one of a plurality of services to be performed, the client belonging to an organization; and determining a current threshold for the organization by applying a real time data model and a historical data model, the real time data model generating a first threshold at least in part by determining a number of requests received from the organization over a first preceding period of time; the historical data model generating a second threshold, the historical data model being generated by applying a machine learning model to historical data stored during processing of previous requests for the plurality of services from the organization over a second preceding period of time, the current threshold being the average of the first threshold and the second threshold. The method further includes performing the requested service when the current threshold is not exceeded; and denying the request when the current threshold is exceeded.