---
title: "Continue config.yaml with an OpenAI-compatible apiBase"
description: "Add BroadNet Inference models to the Continue IDE extension with provider openai and apiBase in config.yaml, including tool_use capabilities and context length."
url: https://broadrouter.com/guides/continue-dev-openai-compatible/
lang: en
updated: 2026-11-16
publisher: BroadRouter (a BroadNet site); API by BroadNet Inference, https://inference.broadnet.ai
---

# Use Continue with BroadNet Inference (config.yaml and apiBase)

Updated 2026-11-16

In ~/.continue/config.yaml, add a model with provider openai, model set to a BroadNet ID such as broadnet/glm-5.3, apiBase set to https://inference.broadnet.ai/v1 and apiKey set to your BroadNet key. Add capabilities tool\_use for Agent mode and set contextLength and maxTokens under defaultCompletionOptions.

Continue is an open-source AI assistant for VS Code and JetBrains. It reaches OpenAI-compatible servers through its `openai` provider with an `apiBase` override, as shown in [Continue’s OpenAI provider docs](https://docs.continue.dev/customize/model-providers/top-level/openai). BroadNet Inference fits that pattern: same request shape, different base URL and model IDs.

## Setup

1.  **Get a BroadNet key** from the console. See [API keys](https://broadrouter.com/guides/api-keys-ip-allow-lists/).
2.  **Open the local config.** It lives at `~/.continue/config.yaml` on macOS and Linux and `%USERPROFILE%\.continue\config.yaml` on Windows. In the IDE, open the configs dropdown above the chat input and click the gear icon next to **Local Config**.
3.  **Add the models.**

```yaml
name: My Config
version: 0.0.1
schema: v1
models:
  - name: BroadNet GLM 5.3
    provider: openai
    model: broadnet/glm-5.3
    apiBase: https://inference.broadnet.ai/v1
    apiKey: your-broadnet-key
    roles:
      - chat
      - edit
      - apply
    capabilities:
      - tool_use
    defaultCompletionOptions:
      contextLength: 1048576
      maxTokens: 8000
  - name: BroadNet Qwen3.8 27B
    provider: openai
    model: broadnet/qwen3.8-27b
    apiBase: https://inference.broadnet.ai/v1
    apiKey: your-broadnet-key
    capabilities:
      - tool_use
      - image_input
    defaultCompletionOptions:
      contextLength: 262144
      maxTokens: 8000
```

4.  **Save and pick the model** in the model selector in the Continue panel.

Keep the file out of version control, because it holds the key.

## What the fields do

-   `provider: openai` makes Continue send standard chat-completions requests.
-   `apiBase` replaces the default OpenAI address. Don’t append `/chat/completions`; Continue adds the path.
-   `capabilities` overrides Continue’s autodetection. Its reference says `tool_use` is required for Agent mode and `image_input` enables image uploads. Continue can’t detect these for custom IDs, so set them.
-   `contextLength` and `maxTokens` sit under `defaultCompletionOptions`. Reasoning counts toward `maxTokens` on BroadNet, so leave room.
-   `roles` defaults to chat, edit, apply and summarize. We left out `autocomplete`: these models reason before answering, which suits chat and edits better than keystroke-level completion.

## Which model to pick

| Use | Model | Why |
| --- | --- | --- |
| Chat and Agent mode | `broadnet/glm-5.3` | Tools and structured output, 1M context |
| Screenshots, Arabic | `broadnet/qwen3.8-27b` | Tools and image input, 262K context |
| Long chats on a flat plan | `broadnet/deepseek-v4.1-flash` | Unlimited plans, 1M context; tools not listed |

For DeepSeek V4.1 Flash, drop `tool_use` unless your own test shows tool calls work, and set `contextLength: 1048576`. Prices for every model are on the [pricing page](https://broadrouter.com/pricing/). The [GLM 5.3 model page](https://broadrouter.com/models/glm-5.3/) has its limits.

## Troubleshooting

-   **401.** Check `apiKey`. A wrong, expired or out-of-allowance pay-as-you-go key returns 401.
-   **Model errors on the first request.** `model` must be the exact BroadNet ID, with the `broadnet/` prefix. GLM 5.3, Qwen3.8 27B and DeepSeek V4.1 Flash need a top-up; the $5 starting credit covers BroadNet Gemma 4 VL 26B and the two Transcribe models.
-   **Empty or cut-off replies.** Raise `maxTokens`. [Why answers come back empty](https://broadrouter.com/guides/reasoning-tokens-empty-response/).
-   **429.** A pay-as-you-go key allows 30 requests a minute and 4 at once. Agent mode makes many calls in a row; add backoff in your workflow or space out runs. See [errors and retries](https://broadrouter.com/guides/errors-and-retries/).
-   **Several agents at once on a plan key.** Each [unlimited plan session](https://broadrouter.com/guides/unlimited-llm-api-sessions/) runs one request at a time. Give each parallel agent its own session.
-   **Wrong endpoint.** Continue’s docs mention `useLegacyCompletionsEndpoint` and `useResponsesApi`. Don’t set the legacy option; BroadNet serves `/v1/chat/completions`. Continue uses `/responses` by default only for OpenAI’s o-series and GPT-5 models, so BroadNet IDs use chat completions without extra settings.

## Terms in this guide

[Pay-as-you-go](https://broadrouter.com/glossary/pay-as-you-go/)

Pay-as-you-go is a pricing model in which you pay only for what you use, metered per unit such as tokens, requests or audio minutes, with no subscription or minimum commitment. Most LLM APIs bill this way, from a prepaid balance or a periodic invoice.

[Tool calling](https://broadrouter.com/glossary/tool-calling/)

Tool calling, also called function calling, is an LLM API feature in which the model returns a structured request to run a function the developer has defined, with JSON arguments. The application runs the function and sends the result back; the model never runs code itself.

[API key](https://broadrouter.com/glossary/api-key/)

An API key is a secret string that identifies and authorizes a client calling an API. LLM APIs usually expect it in an Authorization: Bearer header, and anyone who holds the key can make requests that are billed to the account that owns it.

[Base URL](https://broadrouter.com/glossary/base-url/)

A base URL is the fixed root address of an API, such as https://api.example.com/v1, that a client puts in front of every endpoint path, such as /chat/completions. In OpenAI-compatible SDKs, changing the base URL, together with the API key and model ID, points the same code at a different provider.

[Chat Completions API](https://broadrouter.com/glossary/chat-completions-api/)

The Chat Completions API is OpenAI's HTTP endpoint, POST /v1/chat/completions, that takes a model name and a list of role-tagged messages and returns the model's next message. Its request and response shape became the common format that OpenAI-compatible providers and SDKs reuse.

[Concurrency](https://broadrouter.com/glossary/concurrency/)

Concurrency is the number of requests a client has in flight at the same time. LLM APIs often cap it per key or plan, separately from requests per minute, because each open request holds GPU capacity until its response has finished.

[Prepaid credit](https://broadrouter.com/glossary/prepaid-credit/)

Prepaid credit is money added to an API account before use. Each request deducts its cost from the balance, and when the balance runs out, metered requests stop until you top up. It caps spend at what you have paid in.

[Rate limit](https://broadrouter.com/glossary/rate-limit/)

A rate limit is a cap an API places on how much a client can use it in a time window, such as requests per minute or tokens per minute. Requests over the limit are refused, usually with HTTP 429 Too Many Requests, until usage falls back under it.

## Questions

### Where is Continue's config.yaml?

The local file is ~/.continue/config.yaml on macOS and Linux and %USERPROFILE%\\.continue\\config.yaml on Windows. You can also open it from the gear icon next to Local Config in the configs dropdown.

### Why can't I use Agent mode with my BroadNet model?

Continue needs the tool\_use capability for Agent mode. Add capabilities with tool\_use to the model entry, and pick a model BroadNet lists with tools, such as broadnet/glm-5.3.

### Why does Continue return an empty answer?

The reasoning used up maxTokens before the answer started. Raise maxTokens under defaultCompletionOptions to a few thousand.

### Should I use config.json or config.yaml for Continue?

Use config.yaml. Continue's docs label config.json and its reference as deprecated, and all current examples use YAML with schema v1.

## Related guides

-   [Use Cline with BroadNet Inference (OpenAI Compatible provider)](https://broadrouter.com/guides/cline-openai-compatible/)
-   [Why a reasoning model returns an empty answer](https://broadrouter.com/guides/reasoning-tokens-empty-response/)
-   [Use the OpenAI Node.js SDK with BroadNet Inference](https://broadrouter.com/guides/openai-node-sdk/)
-   [BroadNet Inference error codes and when to retry](https://broadrouter.com/guides/errors-and-retries/)
-   [All tools that work with BroadNet Inference](https://broadrouter.com/integrations/): SDKs, coding agents, chat UIs and automation tools, with exact settings for each

Try it on your real workload. New accounts start with $5 of credit for Gemma and transcription. DeepSeek, GLM and Qwen3.8 need a top-up.

[Get started](https://inference.broadnet.ai/account/?utm_source=broadrouter&utm_medium=referral&utm_campaign=guides-continue-dev-openai-compatible&utm_content=page-cta) ·

**Sources**

-   [Continue docs, OpenAI provider and OpenAI-compatible servers (checked 2026-11-14)](https://docs.continue.dev/customize/model-providers/top-level/openai)
-   [Continue docs, config.yaml reference (checked 2026-11-14)](https://docs.continue.dev/reference)
-   [Continue docs, local configuration (checked 2026-11-14)](https://docs.continue.dev/customize/deep-dives/configuration)
-   [BroadNet Inference API reference](https://inference.broadnet.ai/docs?utm_source=broadrouter&utm_medium=referral&utm_campaign=guides-continue-dev-openai-compatible&utm_content=sources)
