ModelsCompareBest forBenchmarksStatusPricingAPI
Compare / head-to-head

Claude Haiku 4.5vsGemma 4 E4B

Claude Haiku 4.5 leads 1 of 1 shared benchmark. Claude Haiku 4.5 has the larger context window (200K tokens).

Benchmarks from cited public sources; pricing from official pages; status from official provider feeds.

Shared benchmarks
1 – 0
Claude Haiku 4.5 leads
Cheaper per token
list price, input + output
Larger context
Claude Haiku 4.5
200K tokens
Provider uptime (30d)
100% · 100%
Anthropic · Google
Claude Haiku 4.5
Anthropic · released 2025-10-15
textvision
Context
200K
Max out
64K
Input /1M
$1
Output /1M
$5
Cached /1M
$0.1
Scores
4 · 4 core
Gemma 4 E4B
Google · released 2026-04-02
textvisionaudio
Context
128K
Max out
Input /1M
Output /1M
Cached /1M
Scores
4 · 3 core
Quality

Benchmark matrix

BenchmarkClaude Haiku 4.5Gemma 4 E4BΔEdge
Reported by both · 1
GPQA Diamond71.2% epoch58.6% +12.6 ptClaude Haiku 4.5
Only Claude Haiku 4.5 reports · 3
SWE-bench Verified73.3% not reported
OTIS Mock AIME 2024-2025 (Epoch AI run)66.7% epochnot reported
SimpleQA Verified13.2% epochnot reported
Only Gemma 4 E4B reports · 3
MMLU-Pronot reported69.4%
AIME 2026not reported42.5%
LiveCodeBench v6not reported52%
Scores tagged "epoch" or "matharena" are independent runs, used only where the lab has not published its own; ⚠ marks rows MathArena flags as released after the competition. Higher is better on every row. Δ is Claude Haiku 4.5 minus Gemma 4 E4B in the benchmark's own unit. "Not reported" means the lab has not published that figure; it is not a zero. ↗ opens the source.
Specs & pricing

Side by side

SpecClaude Haiku 4.5Gemma 4 E4BEdge
Context window200K tokens128K tokensClaude Haiku 4.5
Max output64K tokens
Input price / 1M$1
Output price / 1M$5
Cached input / 1M$0.1
Input + output / 1M
Lower is cheaper. List prices; batch, tool and regional fees excluded.
$6
Modalitiestext · visiontext · vision · audioGemma 4 E4B
Released2025-10-152026-04-02
Cited benchmark scores44
Reliability

Provider status

All providers
More matchups

Claude Haiku 4.5 vs …

Built by Respan
Which one wins on your data?

Public benchmarks are a starting point. Run Claude Haiku 4.5 and Gemma 4 E4B on your own prompts with Respan evals, or route to either through one gateway key with automatic failover.