---
title: "How to choose an LLM API provider - 20-point checklist"
description: "Twenty questions to ask before you pick an LLM API: pricing, limits, OpenAI compatibility, privacy, models, support and uptime, plus a scoring sheet and test plan."
url: https://broadrouter.com/blog/choose-llm-api-provider-checklist/
lang: en
updated: 2026-11-14
publisher: BroadRouter (a BroadNet site); API by BroadNet Inference, https://inference.broadnet.ai
---

# How to choose an LLM API provider: a 20-point checklist

By the BroadNet Inference team · 5 min read · Published 2026-11-14 · Updated 2026-11-16

Choose an LLM API provider by scoring it on six areas: total cost for your real workload, rate and concurrency limits, OpenAI compatibility, data retention and training terms, the models and context sizes you need, and support and reliability. Then run a one-week test with your own traffic before committing. Price per token alone is a poor guide.

## Key takeaways

-   Price your real workload, including cached input, reasoning tokens and retries, not the headline input price.
-   Concurrency limits break agents and batch jobs more often than requests-per-minute limits.
-   OpenAI compatibility keeps switching cheap, but check streaming usage, tool calls and error codes.
-   Get retention and training terms in writing; they differ between free and paid tiers.
-   Run a one-week trial with real traffic and log tokens, latency and errors before you commit.

**On this page**

1.  What will it really cost? (questions 1 to 4)
2.  Which limits will you hit first? (questions 5 to 7)
3.  How compatible is it with your code? (questions 8 to 10)
4.  What happens to your data? (questions 11 to 13)
5.  Does it have the models you need? (questions 14 to 16)
6.  Will it stay up, and who answers? (questions 17 to 20)
7.  How do you score providers against each other?
8.  How do you test a provider in one week?
9.  How BroadNet Inference answers the checklist

_[image: A chess knight and queen on a board, with the text "The right model. For the next move."]_

To choose an LLM API provider, score each candidate on six areas: the monthly cost of your real workload, rate and concurrency limits, OpenAI compatibility, data retention and training terms, the models you need, and support and reliability. Then test the top two with a week of real traffic. Below: 20 questions, a scoring sheet and the test plan.

Once you have picked, the [migration checklist](https://broadrouter.com/blog/openai-compatible-api-migration-checklist/) covers the switch itself, and [how to evaluate an LLM before switching](https://broadrouter.com/blog/evaluate-llm-before-switching/) covers quality testing in depth.

## What will it really cost? (questions 1 to 4)

1.  **What does my real workload cost per month?** Price input, [cached input](https://broadrouter.com/glossary/cached-input-tokens/) and output separately; the free [LLM API cost calculator](https://broadrouter.com/tools/llm-api-cost-calculator/) does this per model. Agents resend the same context, so cached input often dominates. Our [pricing explainer](https://broadrouter.com/blog/llm-api-pricing-explained/) walks through each line.
2.  **Are reasoning tokens billed as output?** Reasoning models can spend more tokens thinking than answering.
3.  **Is there a flat-rate option?** For always-on agents, a flat plan can beat per-token billing. See the [break-even math](https://broadrouter.com/blog/flat-rate-vs-pay-per-token-llm-api/).
4.  **Are prices machine-readable and dated?** A JSON price file lets you track changes and build cost alerts.

Our open dataset of [LLM API free tiers and rate limits](https://broadrouter.com/data/llm-api-free-tiers-and-rate-limits/) compares what 14 providers publish about free access, starting rate limits, card requirements and training on free-tier data, with the source and date for each value.

## Which limits will you hit first? (questions 5 to 7)

5.  **What are the requests-per-minute and concurrency limits?** Concurrency (requests in flight) is what stalls parallel agents and batch jobs. See [rate limits](https://broadrouter.com/glossary/rate-limit/) and [concurrency](https://broadrouter.com/glossary/concurrency/), and size your traffic against a limit with the [rate limit calculator](https://broadrouter.com/tools/llm-rate-limit-calculator/).
6.  **Is there a token cap, rolling window or weekly quota?** “Unlimited” plans often have one. Read [what unlimited really means](https://broadrouter.com/blog/what-unlimited-llm-api-really-means/).
7.  **What is the context window, and is it trimmed?** Check the real maximum per request, and whether the provider silently cuts long prompts.

## How compatible is it with your code? (questions 8 to 10)

8.  **Is it OpenAI-compatible, and how far?** A [base URL](https://broadrouter.com/glossary/base-url/) change should work. Then test streaming with usage, tool calls, structured output and error codes. The [migration checklist](https://broadrouter.com/blog/openai-compatible-api-migration-checklist/) lists what breaks.
9.  **Does it work with my tools?** SDKs, agent frameworks, IDE assistants. Check the provider’s [integration guides](https://broadrouter.com/integrations/).
10.  **Are model IDs stable?** You want versioned IDs and notice before a model is retired.

## What happens to your data? (questions 11 to 13)

11.  **Are prompts and outputs stored, and for how long?** Many providers keep API content for up to 30 days by default. Compare official wording in [LLM API data retention compared](https://broadrouter.com/blog/llm-api-data-retention-compared/).
12.  **Is my data used for training?** Check the default for your tier, in writing.
13.  **Can I sign a DPA, see subprocessors and restrict keys?** Use the [GDPR checklist](https://broadrouter.com/blog/gdpr-llm-api-checklist/) if you process EU personal data, and ask for IP allow-lists.

## Does it have the models you need? (questions 14 to 16)

14.  **Does the provider have the model sizes and capabilities I need?** Vision, tool calling, reasoning, long context, speech.
15.  **How does each model do on my tasks?** Build 30 to 50 real test cases and score them. Benchmarks are a first filter; [where to compare LLMs](https://broadrouter.com/blog/artificial-analysis-alternatives/) lists the leaderboards and what each measures. The [evaluation guide](https://broadrouter.com/blog/evaluate-llm-before-switching/) shows how to build the set and avoid judge bias.
16.  **Open-weight or closed?** Open-weight models can be hosted by several providers, which lowers lock-in. See [open-weight vs closed models](https://broadrouter.com/blog/open-weight-vs-closed-models/).

## Will it stay up, and who answers? (questions 17 to 20)

17.  **Is there a status page and incident history?**
18.  **Is there a written SLA for production?**
19.  **Who runs the GPUs?** Own hardware, a cloud, or resold capacity from another API. Each adds a party to the data and reliability path.
20.  **How do I reach a human?** Response times, channels, and whether support can see your request content.

## How do you score providers against each other?

Score each question 0 (no or unknown), 1 (partly) or 2 (yes, in writing). Weight the groups for your use case:

| Group | Questions | Weight for an agent | Weight for a regulated app |
| --- | --- | --- | --- |
| Pricing | 1 to 4 | High | Medium |
| Limits | 5 to 7 | High | Medium |
| Compatibility | 8 to 10 | Medium | Medium |
| Privacy | 11 to 13 | Medium | High |
| Models | 14 to 16 | High | High |
| Support and reliability | 17 to 20 | Medium | High |

An “unknown” scores 0 for a reason: if a provider cannot answer, you cannot rely on it.

## How do you test a provider in one week?

1.  Pick your top two providers from the scoring sheet.
2.  Route a share of real traffic to each through the same OpenAI SDK, with model IDs and base URLs in config.
3.  Log per request: model, prompt tokens, cached tokens, completion tokens, latency, status code. Never log content.
4.  Trigger your peak: run your batch job or parallel agents, and watch for 429s. The [errors and retries guide](https://broadrouter.com/guides/errors-and-retries/) shows correct back-off.
5.  Multiply the week’s tokens by about 4.3 and price the month for each provider.
6.  Score the outputs on your test set.

## How BroadNet Inference answers the checklist

| # | BroadNet Inference |
| --- | --- |
| 1, 4 | Per-token prices published in [pricing.json](https://inference.broadnet.ai/pricing.json?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-choose-llm-api-provider-checklist&utm_content=body), synced 2026-11-14 |
| 3 | Flat plans for [DeepSeek V4.1 Flash](https://broadrouter.com/models/deepseek-v4.1-flash/): $60 a month, $15 a week or $1 an hour per session |
| 5 | Pay-as-you-go: 30 requests a minute, 4 in flight; plan sessions run one request at a time |
| 6 | Plans: no token meter, no rolling window, no weekly cap |
| 7 | Up to 1,048,576 tokens on DeepSeek V4.1 Flash and GLM 5.3; the plans page says context is never trimmed |
| 8 | OpenAI-compatible at `https://inference.broadnet.ai/v1` |
| 11, 12 | No prompts or outputs retained; not used to train, fine-tune or evaluate models |
| 13 | IP allow-lists up to 32 entries; subprocessor list on request; ask for a DPA |
| 14 | Four chat models plus two speech-to-text models |
| 19 | BroadNet’s privacy statement says its own and hosted open-weight models run on BroadNet-owned or leased US hardware, with partner capacity as backup; partner-served models such as DeepSeek V4.1 Flash run with US inference partners under ZDR terms |

What we did not find in BroadNet’s docs or plans pages (checked 14 November 2026): an SLA, a status page or a model deprecation policy. Ask for them if they matter to you, and keep a second provider for critical paths. The catalogue is also smaller than an aggregator’s: if you need GPT, Claude or Gemini models, BroadNet is not the provider for that traffic. The $5 starting credit is enough for step 3 of the test plan on a light workload, but of the chat models it covers only Gemma 4 VL 26B (it also covers the two Transcribe models); the other chat models need a top-up.

Free tools for this

-   [LLM API cost calculator](https://broadrouter.com/tools/llm-api-cost-calculator/) Price a workload on every model at once, with cache hits, reasoning and a flat-plan check.
-   [LLM token counter](https://broadrouter.com/tools/token-counter/) Exact token counts with each model's real tokenizer, with a token view and cost.
-   [Context window calculator](https://broadrouter.com/tools/context-window-calculator/) Will it fit? Window used per model, room left for output, cost to send.

[All free tools](https://broadrouter.com/tools/)

## Terms in this article

[Token](https://broadrouter.com/glossary/token/)

A token is the unit of text a language model reads and writes: a word, part of a word, a punctuation mark or a byte sequence produced by the model's tokenizer. LLM APIs count, limit and usually bill usage in tokens.

[Concurrency](https://broadrouter.com/glossary/concurrency/)

Concurrency is the number of requests a client has in flight at the same time. LLM APIs often cap it per key or plan, separately from requests per minute, because each open request holds GPU capacity until its response has finished.

[Rate limit](https://broadrouter.com/glossary/rate-limit/)

A rate limit is a cap an API places on how much a client can use it in a time window, such as requests per minute or tokens per minute. Requests over the limit are refused, usually with HTTP 429 Too Many Requests, until usage falls back under it.

[Tool calling](https://broadrouter.com/glossary/tool-calling/)

Tool calling, also called function calling, is an LLM API feature in which the model returns a structured request to run a function the developer has defined, with JSON arguments. The application runs the function and sends the result back; the model never runs code itself.

[Pay-as-you-go](https://broadrouter.com/glossary/pay-as-you-go/)

Pay-as-you-go is a pricing model in which you pay only for what you use, metered per unit such as tokens, requests or audio minutes, with no subscription or minimum commitment. Most LLM APIs bill this way, from a prepaid balance or a periodic invoice.

[Base URL](https://broadrouter.com/glossary/base-url/)

A base URL is the fixed root address of an API, such as https://api.example.com/v1, that a client puts in front of every endpoint path, such as /chat/completions. In OpenAI-compatible SDKs, changing the base URL, together with the API key and model ID, points the same code at a different provider.

[Data processing agreement (DPA)](https://broadrouter.com/glossary/dpa/)

A data processing agreement (DPA) is the contract between a controller and a processor that governs how the processor handles personal data. GDPR Article 28(3) requires it and lists its contents: documented instructions, confidentiality, security, subprocessor rules, deletion or return of data, and audits.

[Input and output tokens](https://broadrouter.com/glossary/input-and-output-tokens/)

Input tokens are the tokens a language model reads in a request, including the system prompt, conversation history, tool definitions and images. Output tokens are the tokens it generates in reply, including any reasoning. LLM APIs usually price them separately, and output usually costs more.

## Questions

### What should I look for in an LLM API provider?

Total cost for your workload, rate and concurrency limits, OpenAI compatibility, data retention and training terms, the models and context sizes you need, and support and reliability. Score each, then test with real traffic.

### Is the cheapest LLM API the best choice?

Not always. Cached input prices, reasoning tokens, retries caused by rate limits and the engineering time to work around missing features can outweigh a lower list price. Compare the monthly bill for your real workload.

### How do I avoid vendor lock-in with an LLM API?

Use an OpenAI-compatible API through a standard SDK, keep model IDs and base URLs in configuration, avoid provider-only features in your core path, and keep a tested second provider.

### How long should I test an LLM API before committing?

About one week of real traffic is enough to see token use, cache hit rate, latency, error rates and rate-limit behaviour. Multiply the week by about 4.3 to estimate a month.

### What uptime should an LLM API provider offer?

Ask for a published status page, incident history and, for production use, a written SLA. If a provider has none, plan a fallback provider for your critical paths.

## Keep reading

-   [OpenAI-compatible API base URLs: 14 providers, checked](https://broadrouter.com/blog/openai-compatible-api-base-urls/)
-   [How to evaluate an LLM before switching providers](https://broadrouter.com/blog/evaluate-llm-before-switching/)
-   [Switching to an OpenAI-compatible API: a migration checklist](https://broadrouter.com/blog/openai-compatible-api-migration-checklist/)
-   [What "unlimited" really means in an LLM API plan](https://broadrouter.com/blog/what-unlimited-llm-api-really-means/)
-   [GDPR and LLM APIs: 15 questions to ask your provider](https://broadrouter.com/blog/gdpr-llm-api-checklist/)
-   [Open-weight vs closed AI models for business: cost, control, risk](https://broadrouter.com/blog/open-weight-vs-closed-models/)
-   [LLM API key security: storage, rotation and IP allow-lists](https://broadrouter.com/blog/llm-api-key-security/)
-   [Artificial Analysis alternatives: where to compare LLMs in 2026](https://broadrouter.com/blog/artificial-analysis-alternatives/)
-   [Live, on request, research: read a model catalogue clearly](https://broadrouter.com/blog/understand-model-status/)
-   [Guide: BroadNet Inference error codes and when to retry](https://broadrouter.com/guides/errors-and-retries/)
-   [Guide: Lock API keys to your servers with IP allow-lists](https://broadrouter.com/guides/api-keys-ip-allow-lists/)

Try it on your real workload. New accounts start with $5 of credit for Gemma and transcription. DeepSeek, GLM and Qwen3.8 need a top-up.

[Get started](https://inference.broadnet.ai/account/?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-choose-llm-api-provider-checklist&utm_content=page-cta) ·

**Sources**

-   [BroadNet Inference API reference: limits, errors, data (fetched 2026-11-14)](https://inference.broadnet.ai/docs?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-choose-llm-api-provider-checklist&utm_content=sources)
-   [BroadNet Inference machine-readable prices, pricing.json (fetched 2026-11-14)](https://inference.broadnet.ai/pricing.json?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-choose-llm-api-provider-checklist&utm_content=sources)
-   [BroadNet Inference plans (fetched 2026-11-14)](https://inference.broadnet.ai/plans?utm_source=broadrouter&utm_medium=referral&utm_campaign=blog-choose-llm-api-provider-checklist&utm_content=sources)
-   [BroadNet Inference privacy statement (effective September 2026; fetched 2026-11-14)](https://www.broadnet.ai/inference-privacy)
-   [OpenAI API reference, chat completions, the compatibility baseline (fetched 2026-11-14)](https://developers.openai.com/api/reference/resources/chat)
