Community: 3.1 9B A2B

moondream3.1-9b-a2b

3.1 9B A2B costs $0.390 per million input tokens and $3.25 per million output tokens, supports 32K context, and is available through the OpenAI-compatible API.

3.1 is the successor to 3 Preview: a distinct 9B mixture-of-experts vision-language checkpoint with 2B active parameters, for visual question answering, captioning, OCR, and visual reasoning. It accepts text or one image with optional reasoning, a 32,000-token context, and up to 4,096 output tokens.

Modalities

Text + Image → Text

Input / output price

$0.390 / $3.25 per 1M

Context

32K · max output 4K

Capabilities

ReasoningVision

Pricing

Billed per token actually used and deducted from your credits.

ItemUSD per 1M tokens
Input$0.390
Output$3.25
Cached input$0.195

Calculator

Drag the sliders to estimate what this model will cost.

Per request
$0.00377
Per day
$1.89
Per month (30 days)
$56.55

3.1 9B A2B: input $0.39/M · output $3.25/M · cached input $0.195/M

Request with these settings
curl https://api.geniusrelaygpt.com/v1/chat/completions \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "moondream3.1-9b-a2b", "max_tokens": 800,
       "messages": [{"role": "user", "content": "…"}]}'

Code samples

OpenAI-compatible. Set the base URL to https://api.geniusrelaygpt.com/v1 and the model to moondream3.1-9b-a2b.

curl https://api.geniusrelaygpt.com/v1/chat/completions \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "moondream3.1-9b-a2b",
    "stream": true,
    "messages": [{"role": "user", "content": "Hello"}]
  }'

Use it in a client: Cursor · Cline · SillyTavern · Codex

Parameters

Common OpenAI parameters can be passed as-is.

temperaturetop_pmax_tokensstreamstoppresence_penaltyfrequency_penaltyseed

FAQ

How is 3.1 9B A2B billed?
Input is $0.390 and output is $3.25 per million tokens; cached input is $0.195. The charge for every request is listed in Usage Logs in the console.
How long is the context window?
32K tokens. In a long conversation every turn is billed for the full input, so keep the history under control.
Does it support streaming?
Yes. Add "stream": true to the request to receive server-sent events in the OpenAI format.
3.1 9B A2B API pricing · GeniusRelay