← All models
Qwen logo

Qwen3 8B

qwen/qwen3-8b

Qwen3 8B is a dense instruction-tuned model with a hybrid thinking mode for switching between reasoning and direct answers. It offers strong general reasoning and multilingual performance for its size, with tool calling and a 32K context window. A sensible default for agent loops and high-volume tasks that do not need a frontier model.

Get an API key

Endpoints

Each row is one provider serving these weights at one precision. Prices are per million tokens.

QuantisationContextMax outInputOutputCached in
AWQ int4free128K8KFreeFree
Undisclosed128K8K$0.05$0.15

Agent config

Paste this into your coding agent and it can configure itself. The timeout is derived from this variant's measured throughput, not a guess — a long generation that outlives a client's default ceiling is the most common way a working request looks broken.

# Infersia — qwen/qwen3-8b
# Paste this to your agent. Values are measured, not aspirational.

provider:
  type: openai-compatible
  base_url: https://api.infersia.com/v1
  api_key: ${INFERSIA_API_KEY}   # from https://infersia.com/dashboard/keys
  model: qwen/qwen3-8b

limits:
  max_input_tokens: 131072      # hard limit — over this returns HTTP 413
  max_output_tokens: 8192
  timeout_seconds: 600                  # no throughput measured yet; 600 is a safe default

features:
  streaming: true
  tools: true
  vision: false
  reasoning: true   # OFF by default; send chat_template_kwargs.enable_thinking=true to opt in
  prompt_caching: false

pricing_usd_per_million_tokens:
  input: 0.05
  output: 0.15

What Undisclosed means

This model is served on capacity we buy rather than hardware we operate, so we cannot verify the precision it is served at. We would rather say that than print a figure we are guessing at.

Call it

curlbash
curl https://api.infersia.com/v1/chat/completions \
  -H "Authorization: Bearer $INFERSIA_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "qwen/qwen3-8b",
    "messages": [{"role": "user", "content": "Hello"}],
    "stream": true
  }'

Pin a provider with qwen/qwen3-8b@infersia, or take the cheapest with the bare id. Add :free for the rate-limited free tier where one exists.