ADAPTIVE RATE THROTTLING FOR CLOUD-BASED SERVICE REQUESTS

    公开(公告)号:US20250016098A1

    公开(公告)日:2025-01-09

    申请号:US18398915

    申请日:2023-12-28

    Abstract: Some service providers (e.g., Microsoft's Office 365 services) throttle application or service requests an organization, a user, or device can request from a specific application or a suite of applications/services. This throttling can significantly impact performance for, not only the requesting user/device, but also for other tenants associated with that organization. To limit this imposed external throttling, an intelligent internal adaptive throttling or rate limiting may be implemented. In an embodiment, the system monitors throttling imposed by the service provider. Using this information, the system determines an optimal rate of calls that can made for that service to maximize throughput and performance. The system continuously monitors the throttling and in response dynamically modifies the internal target rate.

Patent Agency Ranking