Compare / head-to-head

GPT-6 AstravsQwen3.5 4B

GPT-6 Astra leads 2 of 2 shared benchmarks. GPT-6 Astra has the larger context window (1.1M tokens).

Benchmarks from cited public sources; pricing from official pages; status from official provider feeds.

Shared benchmarks
2 – 0
GPT-6 Astra leads
Cheaper per token
—
list price, input + output
Larger context
GPT-6 Astra
1.1M tokens
Providers
2 providers
OpenAI · Qwen
GPT-6 Astra
OpenAI · released 2026-09-03
textvision
Context
1.1M
Max out
128K
Input /1M
$10 ↗
Output /1M
$50 ↗
Cached /1M
$1
Scores
39 · 9 core
Qwen3.5 4B
Qwen · released 2026-03-02
textvisionvideo
Context
262K
Max out
—
Input /1M
—
Output /1M
—
Cached /1M
—
Scores
16 · 5 core
Quality

Benchmark matrix

BenchmarkGPT-6 AstraQwen3.5 4BΔEdge
Reported by both · 2
GPQA Diamond96% ↗76.2% ↗+19.8 ptGPT-6 Astra
OTIS Mock AIME 2024-2025 (Epoch AI run)100% ↗epoch run55.8% ↗epoch run+44.2 ptGPT-6 Astra
Only GPT-6 Astra reports · 31
LMArena Elo1477.1 ↗not reported——
APEX-Agents (Mercor)64.7% ↗not reported——
AutomationBench 1.0.641.4% ↗not reported——
BALROG (BALROG)68.3% ↗not reported——
Chess Puzzles (Epoch AI run)72% ↗epoch runnot reported——
DeepSWE v1.1 (Datacurve)74.1% ↗not reported——
EBR-bench (Epoch AI run)76.2% ↗epoch runnot reported——
FrontierMath Tier 4 v2 (Epoch AI run)97.6% ↗epoch runnot reported——
FrontierMath Tiers 1-3 v2 (Epoch AI run)93.7% ↗epoch runnot reported——
FrontierSWE V2 (Proximal Labs)65.5% ↗not reported——
Furniture Assembly (Epoch AI run)80% ↗epoch runnot reported——
GSO Opt@1 (GSO)77.5% ↗not reported——
LiveBench Agentic Coding (LiveBench)57.3% ↗not reported——
LiveBench Coding (LiveBench)80.4% ↗not reported——
LiveBench Data Analysis (LiveBench)83% ↗not reported——
LiveBench Instruction Following (LiveBench)75.6% ↗not reported——
LiveBench Language (LiveBench)89.4% ↗not reported——
LiveBench Mathematics (LiveBench)96.8% ↗not reported——
LiveBench Reasoning (LiveBench)92.7% ↗not reported——
LMArena Agent (LMArena)0.1227 ↗not reported——
LMArena Vision (LMArena)1284.3 ↗not reported——
LMArena WebDev (LMArena)1787.7 ↗not reported——
MirrorCode (Epoch AI run)46.7% ↗epoch runnot reported——
Mystery Game Puzzles (Epoch AI run)84% ↗epoch runnot reported——
SAGE (Vals AI)46.4% ↗not reported——
SimpleBench (SimpleBench)86.5% ↗not reported——
SimpleQA Verified75.6% ↗epoch runnot reported——
Terminal-Bench 4.0 (Vals AI)59.6% ↗not reported——
Terminal-Bench Science 0.164.6% ↗not reported——
Vending-Bench 2 (Andon Labs)15514.7 ↗not reported——
WeirdML (Håvard Tveit Ihle)93.6% ↗not reported——
Only Qwen3.5 4B reports · 14
MMLU-Pronot reported79.1% ↗——
BFCL-V4not reported50.3% ↗——
HMMT Feb 25not reported74% ↗——
IFBenchnot reported59.2% ↗——
IFEvalnot reported89.8% ↗——
LiveCodeBench v6not reported55.8% ↗——
LongBench v2not reported50% ↗——
MMLU-Reduxnot reported88.8% ↗——
MMMLUnot reported76.1% ↗——
MMMUnot reported77.6% ↗——
MMMU-Pronot reported66.3% ↗——
OSWorld-Verifiednot reported35.6% ↗——
SuperGPQAnot reported52.9% ↗——
TAU2-Benchnot reported79.9% ↗——
Scores tagged "epoch" or "matharena" are independent runs, used only where the lab has not published its own; ⚠ marks rows MathArena flags as released after the competition. Higher is better on every row. Δ is GPT-6 Astra minus Qwen3.5 4B in the benchmark's own unit. "Not reported" means the lab has not published that figure; it is not a zero. ↗ opens the source.
Specs & pricing

Side by side

SpecGPT-6 AstraQwen3.5 4BEdge
Context window1.1M tokens262K tokensGPT-6 Astra
Max output128K tokens——
Input price / 1M$10 ↗——
Output price / 1M$50 ↗——
Cached input / 1M$1 ↗——
Input + output / 1M
Lower is cheaper. List prices; batch, tool and regional fees excluded.
$60——
Modalitiestext · visiontext · vision · videoQwen3.5 4B
Released2026-09-032026-03-02—
Cited benchmark scores3916—
Reliability

Provider status

All providers →
Built by Respan
Which one wins on your data?

Public benchmarks are a starting point. Run GPT-6 Astra and Qwen3.5 4B on your own prompts with Respan evals, or route to either through one gateway key with automatic failover.