---
title: "LLM batch job planner: run time, cost and sessions | BroadRouter"
description: "Plan a large LLM job: items, tokens, concurrency and RPM or TPM limits give the run time, the cost on each model and the sessions needed to meet a deadline."
url: https://broadrouter.com/tools/llm-batch-job-planner/
lang: en
updated: 2026-11-16
publisher: BroadRouter (a BroadNet site); API by BroadNet Inference, https://inference.broadnet.ai
---

# LLM batch job planner

Updated 2026-11-16

**In short:** A batch job takes requests ÷ the lowest of three rates: your RPM limit, TPM ÷ tokens per request, and concurrency × 60 ÷ seconds per request. 10,000 requests at BroadNet's published pay-as-you-go limit of 30 a minute take about 5.6 hours. BroadNet has no Batch API, so plan the run yourself: time, cost and sessions.

Free, no sign-up, runs in your browser: nothing you type is sent anywhere.

Batch jobItems to processRetried, %Requests sent again after errorsInput tokens per itemPrompt + item textOutput tokens per itemInclude reasoning tokensCached input, %Measured share of input read from cacheDeadline, hoursFor the sessions you need

Limits

Requests in flightRequests per minuteTokens per minute

Loaded: BroadNet's published pay-as-you-go key limits.

Output speed, tokens/sPer request. Default: BroadNet's stated typical, not guaranteedSeconds before outputQueue, prompt processing, network: measure it

Also price onDeepSeek V4.1 FlashGLM 5.3Qwen3.8 27BBroadNet Gemma 4 VL 26BAnother provider's model (428 in our price database)…Custom prices

Search a model by name

Prices are each model's cheapest listed standard price, read from providers' own pricing pages (newest check 2026-11-15).

Input, per 1MCached input, per 1MOutput, per 1MContext window, tokens (optional)

Run time

—

Requests a minute

—

Binding limit

—

Seconds per request

—

BroadNet Inference has no Batch API: you send each request yourself, and no batch discount applies. Speeds are BroadNet's stated typical figure or your own, not a guarantee.

## Which limit binds

Requests per minute each limit allows and the run time under that limit alone
| Limit | Requests a minute | Run time alone |
| --- | --- | --- |

## Cost of the job, pay as you go

Cost of the whole job on each model at pay-as-you-go prices
| Model | Job cost | Per 1,000 items | Context | Access |
| --- | --- | --- | --- | --- |

## Flat sessions to finish by the deadline

Sessions or hourly keys needed to finish by the deadline and their estimated charge
| Option | Sessions | Run time | Bought | Estimated charge |
| --- | --- | --- | --- | --- |

[See the plans](https://inference.broadnet.ai/plans?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-batch-job-planner&utm_content=tool) · [Get started](https://inference.broadnet.ai/account/?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-batch-job-planner&utm_content=tool-account) ·

Sign-up and keys are managed on inference.broadnet.ai. The starting credit covers BroadNet Gemma 4 VL 26B and Gemma hourly keys, plus transcription; DeepSeek V4.1 Flash, GLM 5.3, Qwen3.8 27B need a top-up, and plans are bought separately.

Estimates before tax. BroadNet prices synced 2026-11-14; other models use the cheapest standard price listed on a provider's own page in our database, without any batch discount. Session counts assume one request at a time per session and the speed you enter. BroadNet publishes no request or token rate for plan sessions on the pages we checked, so only latency limits them here.

[Report a wrong price or number](mailto:info@broadnet.ai?subject=Wrong%20price%20or%20number%20on%20LLM%20batch%20job%20planner&body=Page%3A%20https%3A%2F%2Fbroadrouter.com%2Ftools%2Fllm-batch-job-planner%2F%0A%0AWhat%20looks%20wrong%20(model%2C%20figure%20shown%2C%20correct%20figure%20and%20a%20source%20link%20if%20you%20have%20one)%3A%0A) (email to info@broadnet.ai, with this page's link and your inputs filled in).

## How it works

1.  Enter the number of items, the average input and output tokens per item (include reasoning tokens in output) and the share you expect to retry.
2.  Set your limits: requests in flight, requests per minute and tokens per minute, or load BroadNet's published limits for a pay-as-you-go or hourly key.
3.  Enter the output speed and the seconds before output starts. Measure them on a sample; the speed starts at BroadNet's stated typical figure.
4.  Read the run time and binding limit, the cost of the job on each BroadNet model and one model of your choice, and the flat sessions needed to finish by your deadline.

## The formulas

```
requests          = items × (1 + retry share)
seconds/request   = seconds before output + output tokens ÷ output speed
rate (per minute) = min( RPM,
                         TPM ÷ (input + output tokens),
                         in flight × 60 ÷ seconds/request )
run time          = requests ÷ rate
in flight needed  = rate × seconds/request ÷ 60      (Little's law)
sessions needed   = ⌈ requests ÷ ⌊ deadline seconds ÷ seconds/request ⌋ ⌉
```

The tokens-per-minute line counts input and output tokens. Some providers count the `max_tokens` you request instead of the tokens you get back, which makes that limit bind sooner: check your provider's documentation.

## Worked example

Classify 10,000 support tickets with 1,500 input and 300 output tokens each, on one BroadNet pay-as-you-go key (30 requests a minute, 4 in flight). At about 100 tokens a second plus 1 second before output, each request takes 4 seconds, so 4 in flight could reach 60 a minute, but the 30-a-minute limit binds: the run takes about 5 h 33 min. On DeepSeek V4.1 Flash at pay-as-you-go prices the job costs $4.18. On a DeepSeek session, one request at a time, one session finishes within 24 hours in about 11 h 7 min: 12 Meteor session hours at $1, $12 in total. Here pay as you go costs less and finishes sooner, because several requests run at once; sessions pay off when output is long or the work runs for weeks.

## How to run a batch without a Batch API

1.  Measure 50 to 100 real items first: average input, output and reasoning tokens, and seconds per request.
2.  Run a worker pool capped at your in-flight limit and pace starts to the requests-per-minute limit.
3.  On a 429, back off with jitter and retry; on a 5xx, retry with bounded exponential backoff. See [BroadNet errors and retries](https://broadrouter.com/guides/errors-and-retries/).
4.  Write results as they arrive, keyed by item ID, so a restart skips finished items.
5.  On flat sessions, give each worker its own session: one session serves one request at a time.

## Questions

### Does BroadNet Inference have a Batch API?

No. BroadNet's developer reference documents `/v1/chat/completions`, `/v1/audio/transcriptions` and `GET /v1/models`, plus account endpoints, but no batch or file-upload endpoint (checked 2026-11-15). You run a batch by sending the requests yourself, within your key's limits or on flat sessions. Batch prices and turnaround times from other providers do not apply.

### How long will my batch job take?

Divide the requests (retries included) by the lowest of three rates: your requests-per-minute limit, your tokens-per-minute limit ÷ tokens per request, and concurrency × 60 ÷ seconds per request. Seconds per request is the time before output starts plus output tokens ÷ output speed. The planner shows which limit binds.

### What limits does a BroadNet pay-as-you-go key have?

BroadNet publishes 30 requests per minute and 4 requests in flight per pay-as-you-go key. An hourly key for BroadNet Gemma 4 VL 26B allows one concurrent stream, 120 requests per minute and 300,000 tokens per minute. Your key details show the limits that apply to you.

### How many DeepSeek sessions do I need to finish by a deadline?

A session runs one request at a time, so one session finishes (deadline in seconds ÷ seconds per request) requests. Sessions needed = requests ÷ that number, rounded up. Each extra session costs the same. The planner prices them as Full Moon ($60 a month), Orbit ($15 a week), Meteor ($1 an hour).

### Is another provider's Batch API cheaper?

Often, if your results can wait. OpenAI's Batch API lists a 50% discount against its synchronous API with a 24-hour completion window, and Anthropic's Message Batches API also lists 50% off, with most batches finishing within an hour (both checked 2026-11-15). Price the same job on those models with the "Another provider's model" option, then halve it.

### Why is my real run slower than the estimate?

Output length varies per item, long inputs take time to process before output starts, and 429 responses force backoff. The speed field defaults to BroadNet's stated typical figure of about 100 tokens a second for its plans, which is not a guarantee. Measure a sample of 50 to 100 items and enter your own numbers.

## Go deeper

-   [LLM batch processing without a Batch API](https://broadrouter.com/blog/llm-batch-processing-without-batch-api/)
-   [LLM rate limit and concurrency calculator](https://broadrouter.com/tools/llm-rate-limit-calculator/)
-   [How to handle 429 rate limits](https://broadrouter.com/blog/handle-llm-api-429-rate-limits/)
-   [BroadNet errors and retries](https://broadrouter.com/guides/errors-and-retries/)
-   [How plan sessions work](https://broadrouter.com/guides/unlimited-llm-api-sessions/)
-   [Agent run cost estimator](https://broadrouter.com/tools/agent-run-cost-estimator/)

## More free tools

-   [**LLM API cost calculator**Price a workload on every model at once, with cache hits, reasoning and a flat-plan check.](https://broadrouter.com/tools/llm-api-cost-calculator/)
-   [**Speech-to-text cost calculator**Hours, calls or voice notes to a monthly transcription bill, against your current provider.](https://broadrouter.com/tools/speech-to-text-cost-calculator/)
-   [**LLM token counter**Exact token counts with each model's real tokenizer, with a token view and cost.](https://broadrouter.com/tools/token-counter/)
-   [**Arabic token counter**Arabic vs English token counts per tokenizer: the "Arabic tax" in tokens and money.](https://broadrouter.com/tools/arabic-token-counter/)
-   [**Tokens to words converter**Tokens ↔ words ↔ characters ↔ pages, by language and content type.](https://broadrouter.com/tools/tokens-to-words/)
-   [**Context window calculator**Will it fit? Window used per model, room left for output, cost to send.](https://broadrouter.com/tools/context-window-calculator/)
-   [**Flat-rate vs per-token LLM cost calculator**Break-even between an unlimited plan and paying per token, per agent.](https://broadrouter.com/tools/flat-rate-vs-per-token-calculator/)
-   [**Prompt caching savings calculator**Bill with and without caching, by prefix share and hit rate.](https://broadrouter.com/tools/prompt-caching-calculator/)
-   [**Image token calculator**Tokens and cost per image under each model's documented rule. Drop an image; nothing is uploaded.](https://broadrouter.com/tools/image-token-calculator/)
-   [**Self-hosting vs API cost calculator**GPU rental against your current API and BroadNet per-token and flat-plan prices: cost per 1M tokens and break-even volume.](https://broadrouter.com/tools/self-hosting-vs-api-calculator/)
-   [**Embedding cost calculator**Index, update and query costs for a corpus at OpenAI, Google, Voyage, Mistral and Jina list prices.](https://broadrouter.com/tools/embedding-cost-calculator/)
-   [**LLM rate limit and concurrency calculator**Which limit binds first: RPM, TPM or concurrency, with Little's law.](https://broadrouter.com/tools/llm-rate-limit-calculator/)
-   [**JSON schema generator for LLM structured output**Sample JSON to strict schema, Pydantic, Zod and a ready request.](https://broadrouter.com/tools/json-schema-generator/)
-   [**OpenAI-compatible API request builder**One request, copied as curl, Python, Node or the OpenAI SDKs.](https://broadrouter.com/tools/api-request-builder/)
-   [**Audio file splitter for speech-to-text limits**Chunk count, overlap and copy-ready ffmpeg commands to fit a transcription file-size limit.](https://broadrouter.com/tools/audio-splitter-ffmpeg/)
-   [**Agent run cost estimator**Context growth per step, total tokens and cost of one agent run, with a DeepSeek session comparison.](https://broadrouter.com/tools/agent-run-cost-estimator/)
-   [**OpenAI to BroadNet migration helper**Paste OpenAI SDK code; get base URL, key and model edits, a diff and the checks that remain.](https://broadrouter.com/tools/openai-to-broadnet-migration/)
-   [**Arabic text normalizer**Tashkeel, tatweel, alef, ya, ta marbuta, digits and invisible characters, with a matching Python function.](https://broadrouter.com/tools/arabic-text-normalizer/)
-   [**RAG chunking calculator**Chunks, embedding tokens, input per query, context check and monthly LLM cost for a RAG pipeline.](https://broadrouter.com/tools/rag-chunking-calculator/)
-   [**max\_tokens calculator for reasoning models**Answer length + reasoning budget + margin = a max\_tokens that does not cut the answer off.](https://broadrouter.com/tools/reasoning-token-budget/)
-   [**LLM JSON output validator**Parse errors by line and column, safe repairs, cut-off detection and JSON Schema checks for model output.](https://broadrouter.com/tools/llm-json-output-validator/)
-   [**Prompt token diff**Two prompt versions side by side: changed lines, exact token delta and the monthly cost difference.](https://broadrouter.com/tools/prompt-token-diff/)

Try it on your real workload. New accounts start with $5 of credit for Gemma and transcription. DeepSeek, GLM and Qwen3.8 need a top-up.

[Get started](https://inference.broadnet.ai/account/?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-batch-job-planner&utm_content=page-cta) ·

**Sources**

-   [BroadNet Inference machine-readable prices (pricing.json)](https://inference.broadnet.ai/pricing.json?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-batch-job-planner&utm_content=sources)
-   [BroadNet Inference API reference: endpoints, pay-as-you-go and hourly key limits, no batch endpoint (checked 2026-11-15)](https://inference.broadnet.ai/docs?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-batch-job-planner&utm_content=sources)
-   [BroadNet Inference plans: one request at a time per session; typical speed about 100 tokens per second (checked 2026-11-15)](https://inference.broadnet.ai/plans?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-batch-job-planner&utm_content=sources)
-   [OpenAI Batch API guide: 50% discount, 24-hour completion window, 50,000 requests per batch (checked 2026-11-15)](https://developers.openai.com/api/docs/guides/batch)
-   [Anthropic Message Batches API: 50% discount, most batches within an hour, 24-hour expiry (checked 2026-11-15)](https://platform.claude.com/docs/en/build-with-claude/batch-processing)
-   [BroadNet Inference prices](https://inference.broadnet.ai/pricing?utm_source=broadrouter&utm_medium=referral&utm_campaign=tools-llm-batch-job-planner&utm_content=sources)
