Compare / head-to-head

GPT-6.1 SolvsQwen3 235B-A22B Thinking 2507

GPT-6.1 Sol leads 6 of 6 shared benchmarks. Qwen3 235B-A22B Thinking 2507 is 4.7x cheaper per token. GPT-6.1 Sol has the larger context window (1.1M tokens).

Benchmarks from cited public sources; pricing from official pages; status from official provider feeds.

Shared benchmarks
6 – 0
GPT-6.1 Sol leads
Cheaper per token
Qwen3 235B-A22B Thinking 2507
4.7x cheaper, input + output
Larger context
GPT-6.1 Sol
1.1M tokens
Providers
2 providers
OpenAI · Qwen
GPT-6.1 Sol
OpenAI · released 2026-09-29
textvision
Context
1.1M
Max out
128K
Input /1M
$2 ↗
Output /1M
$10 ↗
Cached /1M
$0.1
Scores
24 · 9 core
Qwen3 235B-A22B Thinking 2507
Qwen · released 2025-07-25
text
Context
262K
Max out
—
Input /1M
$0.23 ↗
Output /1M
$2.3 ↗
Cached /1M
—
Scores
23 · 10 core
Quality

Benchmark matrix

BenchmarkGPT-6.1 SolQwen3 235B-A22B Thinking 2507ΔEdge
Reported by both · 6
GPQA Diamond95.4% ↗epoch run80.1% ↗epoch run+15.3 ptGPT-6.1 Sol
LMArena Elo1483.2 ↗1400 ↗+83.2GPT-6.1 Sol
Chess Puzzles (Epoch AI run)61% ↗epoch run12% ↗epoch run+49 ptGPT-6.1 Sol
Mystery Game Puzzles (Epoch AI run)80% ↗epoch run9% ↗epoch run+71 ptGPT-6.1 Sol
OTIS Mock AIME 2024-2025 (Epoch AI run)100% ↗epoch run86.7% ↗epoch run+13.3 ptGPT-6.1 Sol
SimpleQA Verified73.9% ↗epoch run40.4% ↗epoch run+33.5 ptGPT-6.1 Sol
Only GPT-6.1 Sol reports · 18
APEX-Agents (Mercor)60% ↗not reported——
EBR-bench (Epoch AI run)54.3% ↗epoch runnot reported——
FrontierMath Tier 4 v2 (Epoch AI run)100% ↗epoch runnot reported——
FrontierMath Tiers 1-3 v2 (Epoch AI run)93.7% ↗epoch runnot reported——
Furniture Assembly (Epoch AI run)80% ↗epoch runnot reported——
LiveBench Agentic Coding (LiveBench)56.8% ↗not reported——
LiveBench Coding (LiveBench)80.7% ↗not reported——
LiveBench Data Analysis (LiveBench)82.7% ↗not reported——
LiveBench Instruction Following (LiveBench)74.2% ↗not reported——
LiveBench Language (LiveBench)90.1% ↗not reported——
LiveBench Mathematics (LiveBench)96.8% ↗not reported——
LiveBench Reasoning (LiveBench)92.6% ↗not reported——
LMArena Agent (LMArena)0.1123 ↗not reported——
LMArena Vision (LMArena)1290.6 ↗not reported——
LMArena WebDev (LMArena)1757.8 ↗not reported——
SAGE (Vals AI)46.5% ↗not reported——
SimpleBench (SimpleBench)82.9% ↗not reported——
Terminal-Bench 4.0 (Vals AI)55.1% ↗not reported——
Only Qwen3 235B-A22B Thinking 2507 reports · 17
MMLU-Pronot reported84.4% ↗——
AIME25not reported92.3% ↗——
Arena-Hard v2not reported79.7% ↗——
BFCL-v3not reported71.9% ↗——
GPQAnot reported81.1% ↗——
HLE (text-only)not reported18.2% ↗——
HMMT25not reported83.9% ↗——
IFEvalnot reported87.8% ↗——
LiveBench 20241125not reported78.4% ↗——
LiveCodeBench v6 (25.02-25.05)not reported74.1% ↗——
MMLU-Reduxnot reported93.8% ↗——
OJBenchnot reported32.5% ↗——
SuperGPQAnot reported64.9% ↗——
TAU2-Airlinenot reported58% ↗——
TAU2-Retailnot reported71.9% ↗——
Vending-Bench 2 (Andon Labs)not reported-11.34 ↗——
WeirdML (Håvard Tveit Ihle)not reported41% ↗——
Scores tagged "epoch" or "matharena" are independent runs, used only where the lab has not published its own; ⚠ marks rows MathArena flags as released after the competition. Higher is better on every row. Δ is GPT-6.1 Sol minus Qwen3 235B-A22B Thinking 2507 in the benchmark's own unit. "Not reported" means the lab has not published that figure; it is not a zero. ↗ opens the source.
Specs & pricing

Side by side

SpecGPT-6.1 SolQwen3 235B-A22B Thinking 2507Edge
Context window1.1M tokens262K tokensGPT-6.1 Sol
Max output128K tokens——
Input price / 1M$2 ↗$0.23 ↗Qwen3 235B-A22B Thinking 2507
Output price / 1M$10 ↗$2.3 ↗Qwen3 235B-A22B Thinking 2507
Cached input / 1M$0.1 ↗——
Input + output / 1M
Lower is cheaper. List prices; batch, tool and regional fees excluded.
$12$2.53Qwen3 235B-A22B Thinking 2507
Modalitiestext · visiontextGPT-6.1 Sol
Released2026-09-292025-07-25—
Cited benchmark scores2423—
Reliability

Provider status

All providers →
Built by Respan
Which one wins on your data?

Public benchmarks are a starting point. Run GPT-6.1 Sol and Qwen3 235B-A22B Thinking 2507 on your own prompts with Respan evals, or route to either through one gateway key with automatic failover.