Celon

Meta Llama 3.1 70B Instruct Turbo

Chat

Built by Meta · United States · llama.com

Meta chat model.

How to use

model: "meta-llama/meta-llama-3.1-70b-instruct-turbo"

Cap quality here and save

Hard questions go to this model, easy ones drop to something cheaper. Set a savings target (0–0.8) and the router tunes itself until realized savings converge on it.

{
  "model": "celon/auto",
  "celon": {
    "anchor": "meta-llama/meta-llama-3.1-70b-instruct-turbo",
    "savings_target": 0.4
  }
}

Naming a model directly gets you that model — savings controls don't apply.

Context

131K

Max output

Input $/1M

$0.40

Output $/1M

$0.40

Features

Tool callingJSON

Serving providers

DeepInfra

Providers

Price, latency, and uptime per provider serving this model. Celon routes each request to the fastest and cheapest of them. Click a row for regions and data policies.

Loading provider metrics…

Performance

Measured latency (lower is better) and throughput (higher is better) per provider.

Speed

Loading provider metrics…