Scenario

Rate limiter selection under bursty load

Your API is sized for 200 rps. Real traffic is not smooth: clients batch their work and fire it at the top of every minute, so you see 2,000 rps for a few seconds and near-silence between. Under 5% of requests may be rejected, and p99 must stay under 3 seconds. You cannot make the clients behave.

CallerslockedLimiter2 decisionsAPI2 decisionsStoreBackendlocked