---
title: "LLM rate limit calculator: RPM, TPM and concurrency | BroadRouter"
description: "Work out which LLM API limit binds first: requests per minute, tokens per minute or concurrency. Get max throughput and the parallel requests you need."
url: https://broadrouter.com/tools/llm-rate-limit-calculator/
lang: en
updated: 2026-11-16
publisher: BroadRouter (a BroadNet site); API by BroadNet Inference, https://inference.broadnet.ai
---

# LLM rate limit and concurrency calculator

Updated 2026-11-16

**In short:** Real throughput is the smallest of three ceilings: your RPM limit, TPM ÷ tokens per request, and concurrency × 60 ÷ latency in seconds. Little's law gives the requests you need in flight: requests per second × latency. For example, 20 in flight with 6-second responses allows 200 requests a minute. Enter your limits to see which binds first.

Free, no sign-up, runs in your browser: nothing you type is sent anywhere.

Limits and workloadPresetCustomBroadNet pay-as-you-go keyBroadNet plan session (Full Moon, Orbit, Meteor)BroadNet hourly key (BroadNet Gemma 4 VL 26B)

Requests per minute (RPM)Max requests in flightToken limitOne tokens-per-minute limit (input + output)Separate input and output limitsTokens per minute (TPM)Input TPMOutput TPMInput tokens per requestOutput tokens per requestAverage latency, secondsRequests to process (N)

| Limit | Your limit | Max requests / min | Tokens / min at that rate |
| --- | --- | --- | --- |

[Get a BroadNet API key](https://inference.broadnet.ai/?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-rate-limit-calculator&utm_content=tool) ·

A steady-state estimate: it assumes evenly spread traffic and the average latency you enter. Real traffic bursts, latency varies, and some providers count `max_tokens` rather than actual output against token limits, so keep 20–30% headroom and retry 429s with backoff.

[Report a wrong price or number](mailto:info@broadnet.ai?subject=Wrong%20price%20or%20number%20on%20LLM%20rate%20limit%20and%20concurrency%20calculator&body=Page%3A%20https%3A%2F%2Fbroadrouter.com%2Ftools%2Fllm-rate-limit-calculator%2F%0A%0AWhat%20looks%20wrong%20(model%2C%20figure%20shown%2C%20correct%20figure%20and%20a%20source%20link%20if%20you%20have%20one)%3A%0A) (email to info@broadnet.ai, with this page's link and your inputs filled in).

## How it works

1.  Pick a preset or enter your provider's limits: requests per minute, tokens per minute (combined, or separate input and output limits) and maximum requests in flight. Leave a box empty if that limit does not apply.
2.  Enter average input and output tokens per request and the average latency in seconds.
3.  Read the sustainable requests per minute under each limit, which one binds, and how many requests you need in flight (Little's law).
4.  Enter a batch size to see how long it takes to process. Copy the link to share the result.

## The formulas

```
max RPM under RPM limit         = RPM
max RPM under TPM limit         = TPM / (input + output tokens per request)
   (separate limits)            = min(input TPM / input, output TPM / output)
max RPM under concurrency limit = concurrency × 60 / latency_seconds
sustainable RPM                 = the smallest of the above
in flight needed (Little's law) = RPM / 60 × latency_seconds
time for N requests             = N / sustainable RPM  minutes
```

Little's law (L = λW) holds for any stable queue: the average number of requests in flight equals the arrival rate times how long each one takes. It is why slow reasoning models hit concurrency limits long before they hit request limits. See [rate limit](https://broadrouter.com/glossary/rate-limit/) and [tokens per second](https://broadrouter.com/glossary/tokens-per-second/).

## BroadNet Inference limits

| Access | Requests / min | In flight | Tokens / min |
| --- | --- | --- | --- |
| Pay-as-you-go key | 30 | 4 | Not published |
| Plan session (DeepSeek V4.1 Flash) | No meter | 1 per session | No meter |
| Hourly key (BroadNet Gemma 4 VL 26B) | 120 | 1 | 300,000 |

To compare BroadNet with other providers, see our open dataset of [LLM API free tiers and rate limits](https://broadrouter.com/data/llm-api-free-tiers-and-rate-limits/), which records what 14 providers publish, with sources.

## Worked example

A pay-as-you-go key allows 30 requests a minute and 4 in flight. With 6-second responses, concurrency allows 4 × 60 ÷ 6 = 40 requests a minute, so the 30 RPM limit binds. To reach 30 a minute you would need 30 ÷ 60 × 6 = 3 requests in flight. A batch of 10,000 requests then takes about 6 hours. A plan session at the same latency does 10 requests a minute, and two sessions do 20.

## When you hit the limit

-   Cap your client's concurrency at the provider's limit instead of letting requests queue and time out.
-   Retry 429 and 5xx responses with exponential backoff and jitter; fix 4xx errors first. [Error codes and retries](https://broadrouter.com/guides/errors-and-retries/).
-   Cut latency: lower `max_tokens`, set `reasoning_effort` to low, or stream.
-   Spread work across keys or plan sessions, within your provider's terms.

## Questions

### How do I calculate LLM API throughput from rate limits?

Work out the requests per minute each limit allows and take the smallest. RPM allows RPM. TPM allows TPM ÷ tokens per request. A concurrency limit allows concurrency × 60 ÷ latency in seconds. The smallest of the three is your real ceiling, and that limit is the one that binds.

### What is Little's law and how does it apply to LLM APIs?

Little's law says the average number of requests in flight equals arrival rate × time in system (L = λW). For an API: requests needed in flight = requests per second × average latency. At 2 requests a second and 8-second responses you need 16 in flight; with a concurrency cap of 4 you top out at 0.5 a second.

### Which limit binds first: RPM, TPM or concurrency?

For short prompts with fast answers, RPM usually binds. For long prompts or long answers, TPM binds. For reasoning models and long outputs, latency is high, so concurrency binds. Enter your numbers and the calculator names the binding limit.

### Why do I get 429 errors below my RPM limit?

Another limit is binding: tokens per minute, requests in flight, or a short-window burst limit. Some providers also count max\_tokens, not actual output, against token limits. Retry 429s with exponential backoff and jitter. [Error codes and retries](https://broadrouter.com/guides/errors-and-retries/).

### What are the BroadNet Inference rate limits?

A pay-as-you-go key allows 30 requests a minute and 4 requests in flight. A plan session runs one request at a time with no token meter. The $0.50 hourly key allows 120 requests a minute, 1 stream and 300,000 tokens a minute.

### How do I estimate latency?

Latency ≈ time to first token + output tokens ÷ output speed. At about 100 tokens a second, 2,000 output tokens (including reasoning) take about 20 seconds plus queueing. Log real response times; p50 is the right input here, and p95 tells you how much headroom to keep.

## Go deeper

-   [Error codes and when to retry](https://broadrouter.com/guides/errors-and-retries/)
-   [How to handle 429 rate limits](https://broadrouter.com/blog/handle-llm-api-429-rate-limits/)
-   [Glossary: rate limit](https://broadrouter.com/glossary/rate-limit/)
-   [Glossary: concurrency](https://broadrouter.com/glossary/concurrency/)
-   [How plan sessions work](https://broadrouter.com/guides/unlimited-llm-api-sessions/)

## More free tools

-   [**LLM API cost calculator**Price a workload on every model at once, with cache hits, reasoning and a flat-plan check.](https://broadrouter.com/tools/llm-api-cost-calculator/)
-   [**Speech-to-text cost calculator**Hours, calls or voice notes to a monthly transcription bill, against your current provider.](https://broadrouter.com/tools/speech-to-text-cost-calculator/)
-   [**LLM token counter**Exact token counts with each model's real tokenizer, with a token view and cost.](https://broadrouter.com/tools/token-counter/)
-   [**Arabic token counter**Arabic vs English token counts per tokenizer: the "Arabic tax" in tokens and money.](https://broadrouter.com/tools/arabic-token-counter/)
-   [**Tokens to words converter**Tokens ↔ words ↔ characters ↔ pages, by language and content type.](https://broadrouter.com/tools/tokens-to-words/)
-   [**Context window calculator**Will it fit? Window used per model, room left for output, cost to send.](https://broadrouter.com/tools/context-window-calculator/)
-   [**Flat-rate vs per-token LLM cost calculator**Break-even between an unlimited plan and paying per token, per agent.](https://broadrouter.com/tools/flat-rate-vs-per-token-calculator/)
-   [**Prompt caching savings calculator**Bill with and without caching, by prefix share and hit rate.](https://broadrouter.com/tools/prompt-caching-calculator/)
-   [**Image token calculator**Tokens and cost per image under each model's documented rule. Drop an image; nothing is uploaded.](https://broadrouter.com/tools/image-token-calculator/)
-   [**Self-hosting vs API cost calculator**GPU rental against your current API and BroadNet per-token and flat-plan prices: cost per 1M tokens and break-even volume.](https://broadrouter.com/tools/self-hosting-vs-api-calculator/)
-   [**Embedding cost calculator**Index, update and query costs for a corpus at OpenAI, Google, Voyage, Mistral and Jina list prices.](https://broadrouter.com/tools/embedding-cost-calculator/)
-   [**JSON schema generator for LLM structured output**Sample JSON to strict schema, Pydantic, Zod and a ready request.](https://broadrouter.com/tools/json-schema-generator/)
-   [**OpenAI-compatible API request builder**One request, copied as curl, Python, Node or the OpenAI SDKs.](https://broadrouter.com/tools/api-request-builder/)
-   [**Audio file splitter for speech-to-text limits**Chunk count, overlap and copy-ready ffmpeg commands to fit a transcription file-size limit.](https://broadrouter.com/tools/audio-splitter-ffmpeg/)
-   [**Agent run cost estimator**Context growth per step, total tokens and cost of one agent run, with a DeepSeek session comparison.](https://broadrouter.com/tools/agent-run-cost-estimator/)
-   [**OpenAI to BroadNet migration helper**Paste OpenAI SDK code; get base URL, key and model edits, a diff and the checks that remain.](https://broadrouter.com/tools/openai-to-broadnet-migration/)
-   [**Arabic text normalizer**Tashkeel, tatweel, alef, ya, ta marbuta, digits and invisible characters, with a matching Python function.](https://broadrouter.com/tools/arabic-text-normalizer/)
-   [**RAG chunking calculator**Chunks, embedding tokens, input per query, context check and monthly LLM cost for a RAG pipeline.](https://broadrouter.com/tools/rag-chunking-calculator/)
-   [**max\_tokens calculator for reasoning models**Answer length + reasoning budget + margin = a max\_tokens that does not cut the answer off.](https://broadrouter.com/tools/reasoning-token-budget/)
-   [**LLM batch job planner**Run time, binding limit, cost per model and the flat sessions needed to finish a big job by a deadline.](https://broadrouter.com/tools/llm-batch-job-planner/)
-   [**LLM JSON output validator**Parse errors by line and column, safe repairs, cut-off detection and JSON Schema checks for model output.](https://broadrouter.com/tools/llm-json-output-validator/)
-   [**Prompt token diff**Two prompt versions side by side: changed lines, exact token delta and the monthly cost difference.](https://broadrouter.com/tools/prompt-token-diff/)

Try it on your real workload. New accounts start with $5 of credit for Gemma and transcription. DeepSeek, GLM and Qwen3.8 need a top-up.

[Get started](https://inference.broadnet.ai/account/?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-rate-limit-calculator&utm_content=page-cta) ·

**Sources**

-   [BroadNet Inference machine-readable prices (pricing.json)](https://inference.broadnet.ai/pricing.json?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-rate-limit-calculator&utm_content=sources)
-   [BroadNet Inference API reference, limits](https://inference.broadnet.ai/docs?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-rate-limit-calculator&utm_content=sources#limits)
-   [BroadNet Inference plans](https://inference.broadnet.ai/plans?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-rate-limit-calculator&utm_content=sources)
