GeniusRelay
EN中文Sign upConsole

Meta: Llama 3.1 8b Instruct

llama-3.1-8b-instruct

CompareAPIGet an API keyGet an API key

Fast and efficient for simple purposes.

Modalities

Text → Text

Input / output price

$0.026 / $0.052 per 1M

Context

131K · max output 16K

Capabilities

Tool callingOpen weights

Pricing

Billed per token actually used and deducted from your credits.

ItemUSD per 1M tokens
Input$0.026
Output$0.052
Cached input$0.013

Calculator

Drag the sliders to estimate what this model will cost.

Per request
$0.00012
Per day
$0.0598
Per month (30 days)
$1.79

Llama 3.1 8b Instruct: input $0.026/M · output $0.052/M · cached input $0.013/M

Request with these settings
curl https://api.geniusrelaygpt.com/v1/chat/completions \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "llama-3.1-8b-instruct", "max_tokens": 800,
       "messages": [{"role": "user", "content": "…"}]}'

Code samples

OpenAI-compatible. Set the base URL to https://api.geniusrelaygpt.com/v1 and the model to llama-3.1-8b-instruct.

curl https://api.geniusrelaygpt.com/v1/chat/completions \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-8b-instruct",
    "stream": true,
    "messages": [{"role": "user", "content": "Hello"}]
  }'

Use it in a client: Cursor · Cline · SillyTavern · Codex

Parameters

Common OpenAI parameters can be passed as-is.

temperaturetop_pmax_tokensstreamstoppresence_penaltyfrequency_penaltyseed

FAQ

How is Llama 3.1 8b Instruct billed?
Input is $0.026 and output is $0.052 per million tokens; cached input is $0.013. The charge for every request is listed in Usage Logs in the console.
How long is the context window?
131K tokens. In a long conversation every turn is billed for the full input, so keep the history under control.
Does it support streaming?
Yes. Add "stream": true to the request to receive server-sent events in the OpenAI format.