Meta: Llama 3.2 3b Instruct
llama-3.2-3b-instruct
Llama 3.2 3b Instruct costs $0.065 per million input tokens and $0.429 per million output tokens, supports 131K context, and is available through the OpenAI-compatible API.
Small model optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summarization
Modalities
Text → Text
Input / output price
$0.065 / $0.429 per 1M
Context
131K · max output 8K
Capabilities
Pricing
Billed per token actually used and deducted from your credits.
| Item | USD per 1M tokens |
|---|---|
| Input | $0.065 |
| Output | $0.429 |
| Cached input | $0.0325 |
Calculator
Drag the sliders to estimate what this model will cost.
- Per request
- $0.00054
- Per day
- $0.2691
- Per month (30 days)
- $8.07
Llama 3.2 3b Instruct: input $0.065/M · output $0.429/M · cached input $0.0325/M
curl https://api.geniusrelaygpt.com/v1/chat/completions \
-H "Authorization: Bearer $API_KEY" \
-H "Content-Type: application/json" \
-d '{"model": "llama-3.2-3b-instruct", "max_tokens": 800,
"messages": [{"role": "user", "content": "…"}]}'Code samples
OpenAI-compatible. Set the base URL to https://api.geniusrelaygpt.com/v1 and the model to llama-3.2-3b-instruct.
curl https://api.geniusrelaygpt.com/v1/chat/completions \
-H "Authorization: Bearer $API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "llama-3.2-3b-instruct",
"stream": true,
"messages": [{"role": "user", "content": "Hello"}]
}'Use it in a client: Cursor · Cline · SillyTavern · Codex
Parameters
Common OpenAI parameters can be passed as-is.
temperaturetop_pmax_tokensstreamstoppresence_penaltyfrequency_penaltyseedFAQ
- How is Llama 3.2 3b Instruct billed?
- Input is $0.065 and output is $0.429 per million tokens; cached input is $0.0325. The charge for every request is listed in Usage Logs in the console.
- How long is the context window?
- 131K tokens. In a long conversation every turn is billed for the full input, so keep the history under control.
- Does it support streaming?
- Yes. Add "stream": true to the request to receive server-sent events in the OpenAI format.