GeniusRelay
Sign upConsole

Meta: Llama 3.1 8B (decentralized)

meta-llama-3-1-8b-instruct-fp8

CompareAPIGet an API keyGet an API key

Llama 3.1 8B (decentralized) costs $0.026 per million input tokens and $0.039 per million output tokens, supports 128K context, and is available through the OpenAI-compatible API.

Meta's Llama 3.1 8B model on an open permissionless network

Modalities

Text → Text

Input / output price

$0.026 / $0.039 per 1M

Context

128K · max output 16K

Capabilities

Open weights

Pricing

Billed per token actually used and deducted from your credits.

ItemUSD per 1M tokens
Input$0.026
Output$0.039
Cached input$0.013

Calculator

Drag the sliders to estimate what this model will cost.

Per request
$0.00011
Per day
$0.0546
Per month (30 days)
$1.64

Llama 3.1 8B (decentralized): input $0.026/M · output $0.039/M · cached input $0.013/M

Request with these settings
curl https://api.geniusrelaygpt.com/v1/chat/completions \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "meta-llama-3-1-8b-instruct-fp8", "max_tokens": 800,
       "messages": [{"role": "user", "content": "…"}]}'

Code samples

OpenAI-compatible. Set the base URL to https://api.geniusrelaygpt.com/v1 and the model to meta-llama-3-1-8b-instruct-fp8.

curl https://api.geniusrelaygpt.com/v1/chat/completions \
  -H "Authorization: Bearer $API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "meta-llama-3-1-8b-instruct-fp8",
    "stream": true,
    "messages": [{"role": "user", "content": "Hello"}]
  }'

Use it in a client: Cursor · Cline · SillyTavern · Codex

Parameters

Common OpenAI parameters can be passed as-is.

temperaturetop_pmax_tokensstreamstoppresence_penaltyfrequency_penaltyseed

FAQ

How is Llama 3.1 8B (decentralized) billed?
Input is $0.026 and output is $0.039 per million tokens; cached input is $0.013. The charge for every request is listed in Usage Logs in the console.
How long is the context window?
128K tokens. In a long conversation every turn is billed for the full input, so keep the history under control.
Does it support streaming?
Yes. Add "stream": true to the request to receive server-sent events in the OpenAI format.
Llama 3.1 8B (decentralized) API pricing · GeniusRelay