BroadRouter

Connect SillyTavern to BroadNet Inference (Custom OpenAI-compatible)

Updated

In SillyTavern's API Connections panel, choose Chat Completion, then Custom (OpenAI-compatible) as the Chat Completion Source. Set Custom Endpoint to https://inference.broadnet.ai/v1, paste your BroadNet key, type a model ID such as broadnet/qwen3.8-27b in Enter a Model ID, click Connect, then Test Message. Set Max Response Length to 1,000 tokens or more.

SillyTavern is an open-source chat front end, popular for character chat and roleplay. Its Custom (OpenAI-compatible) source connects the Chat Completion API type to any server with the generic OpenAI schema. BroadNet Inference serves standard chat completions at https://inference.broadnet.ai/v1. BroadRouter is BroadNet’s own site; the steps follow SillyTavern’s docs and its 1.19.0 release.

Setup

  1. Get a key. Create a pay-as-you-go key in the BroadNet console, buy an hourly key, or buy an unlimited plan.

  2. Open the API Connections panel.

  3. Set API to Chat Completion.

  4. Set Chat Completion Source to Custom (OpenAI-compatible).

  5. Fill in the custom form:

    Field Value
    Custom Endpoint (Base URL) https://inference.broadnet.ai/v1
    Custom API Key your BroadNet key
    Enter a Model ID broadnet/qwen3.8-27b
  6. Click Connect.

  7. Test it. Click Test Message. SillyTavern sends a simple prompt to the model; a reply means the connection works.

Don’t add /chat/completions to the URL. SillyTavern’s form says that suffix is added automatically.

Type the model ID rather than picking from Available Models. That list comes from /v1/models, which BroadNet’s docs describe as catalogue metadata for monitors. When we checked it on 15 November 2026 it listed only the two transcription models, which can’t chat.

Which model to pick

Model ID Context Notes
DeepSeek V4.1 Flash broadnet/deepseek-v4.1-flash 1,048,576 Long chats; the model on the unlimited plans
Qwen3.8 27B broadnet/qwen3.8-27b 262,144 Images; tested in Arabic by BroadNet
GLM 5.3 broadnet/glm-5.3 1,048,576 Text only; tools
BroadNet Gemma 4 VL 26B broadnet/gemma-4-26b-a4b 32,768 Runs on the $5 free credit and the hourly key

An unlimited plan suits long sessions because you don’t pay per token: a Meteor hour costs $1, an Orbit week $15 and a Full Moon month $60. Each plan session runs one request at a time.

Settings worth changing

  • Max Response Length (tokens). DeepSeek V4.1 Flash, GLM 5.3 and Qwen3.8 27B reason before they answer, and the reasoning counts toward this limit. Set 1,000 or more, or you may get blank replies.
  • Context Size (tokens). Match it to the model in the table. SillyTavern can’t read it from BroadNet.
  • Prompt Post-Processing. If a model rejects a prompt because of several system messages or role order, try Merge consecutive roles first, then Semi-strict. SillyTavern’s docs note that these options drop tool calls unless you pick the “with tools” variant.
  • Bypass status check. If SillyTavern warns that the API isn’t working but Test Message succeeds, tick this.

Troubleshooting

  • 401. The key is wrong, expired or out of allowance. Paste it again and click Connect.
  • 404 or “model not found”. The URL must end in /v1, and the ID must include the broadnet/ prefix. Paid models need a top-up; the $5 credit covers only broadnet/gemma-4-26b-a4b and the two Transcribe models.
  • Blank replies. Raise the response length. Why answers come back empty.
  • 429. A pay-as-you-go key allows 30 requests a minute and 4 in flight, and the hourly key and plan sessions run one stream. See errors and retries.

Questions

Why is the Available Models list wrong or empty for BroadNet?

SillyTavern fills it from /v1/models. When we checked on 15 November 2026, BroadNet's public /v1/models listed only its two transcription models. Type the chat model ID in Enter a Model ID instead.

Which BroadNet model is best for long roleplay chats?

DeepSeek V4.1 Flash has a 1,048,576-token context and is the model on BroadNet's flat-rate unlimited plans. Qwen3.8 27B is the one BroadNet tested in Arabic, including Gulf and Egyptian dialects.

Why do replies come back blank in SillyTavern?

BroadNet's chat models except Gemma 4 VL 26B reason before answering, and the reasoning counts toward max_tokens. SillyTavern's Max Response Length sets that limit, so raise it to 1,000 tokens or more.

Are there content rules?

Yes. BroadNet's Acceptable Use Policy applies to everything sent through the API, and it explicitly covers fictional and synthetic content in its ban on sexual content involving minors.

Read as MarkdownAsk ChatGPTAsk ClaudeAsk Perplexity