Celon

Wizardlm 2 8x22b

ChatInput: TextReleased Apr 16, 2024

Built by Microsoft · United States · microsoft.com

WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is...

How to use

model: "microsoft/wizardlm-2-8x22b"

Cap quality here and save

Hard questions go to this model, easy ones drop to something cheaper. Set a savings target (0–0.8) and the router tunes itself until realized savings converge on it.

{
  "model": "celon/auto",
  "celon": {
    "anchor": "microsoft/wizardlm-2-8x22b",
    "savings_target": 0.4
  }
}

Naming a model directly gets you that model — savings controls don't apply.

Context

66K

Max output

8K

Input $/1M

$0.48

Output $/1M

$0.48

Features

JSON

Serving providers

DeepInfraNovita

Providers

Price, latency, and uptime per provider serving this model. Celon routes each request to the fastest and cheapest of them. Click a row for regions and data policies.

Loading provider metrics…

Performance

Benchmark quality scores, and measured speed per provider.

Quality

GPQA DiamondPhD-level science questions
43.4%

At each model's best reasoning effort. Benchmarks it wasn't run on are omitted.

Speed

Loading provider metrics…