Compare / head-to-head

GPT-6 AstravsInkling-Small

GPT-6 Astra leads 13 of 13 shared benchmarks. Inkling-Small is 40x cheaper per token. GPT-6 Astra has the larger context window (1.1M tokens).

Benchmarks from cited public sources; pricing from official pages; status from official provider feeds.

Shared benchmarks
13 – 0
GPT-6 Astra leads
Cheaper per token
Inkling-Small
40x cheaper, input + output
Larger context
GPT-6 Astra
1.1M tokens
Providers
2 providers
OpenAI · Thinking Machines Lab
GPT-6 Astra
OpenAI · released 2026-09-03
textvision
Context
1.1M
Max out
128K
Input /1M
$10 ↗
Output /1M
$50 ↗
Cached /1M
$1
Scores
39 · 9 core
Inkling-Small
Thinking Machines Lab · released 2026-07-30
textvisionaudio
Context
1M
Max out
—
Input /1M
$0.3 ↗
Output /1M
$1.2 ↗
Cached /1M
$0.06
Scores
29 · 12 core
Quality

Benchmark matrix

BenchmarkGPT-6 AstraInkling-SmallΔEdge
Reported by both · 13
GPQA Diamond96% ↗88.5% ↗epoch run+7.5 ptGPT-6 Astra
LMArena Elo1477.1 ↗1405.2 ↗+71.9GPT-6 Astra
Chess Puzzles (Epoch AI run)72% ↗epoch run18% ↗epoch run+54 ptGPT-6 Astra
FrontierMath Tier 4 v2 (Epoch AI run)97.6% ↗epoch run17.1% ↗epoch run+80.5 ptGPT-6 Astra
FrontierMath Tiers 1-3 v2 (Epoch AI run)93.7% ↗epoch run46.3% ↗epoch run+47.4 ptGPT-6 Astra
LMArena Agent (LMArena)0.1227 ↗-0.1033 ↗+0.2GPT-6 Astra
LMArena Vision (LMArena)1284.3 ↗1206.3 ↗+78GPT-6 Astra
LMArena WebDev (LMArena)1787.7 ↗1408.2 ↗+379.5GPT-6 Astra
Mystery Game Puzzles (Epoch AI run)84% ↗epoch run6% ↗epoch run+78 ptGPT-6 Astra
OTIS Mock AIME 2024-2025 (Epoch AI run)100% ↗epoch run90% ↗epoch run+10 ptGPT-6 Astra
SAGE (Vals AI)46.4% ↗32.7% ↗+13.7 ptGPT-6 Astra
SimpleQA Verified75.6% ↗epoch run20.6% ↗+55 ptGPT-6 Astra
Terminal-Bench 4.0 (Vals AI)59.6% ↗0% ↗+59.6 ptGPT-6 Astra
Only GPT-6 Astra reports · 20
APEX-Agents (Mercor)64.7% ↗not reported——
AutomationBench 1.0.641.4% ↗not reported——
BALROG (BALROG)68.3% ↗not reported——
DeepSWE v1.1 (Datacurve)74.1% ↗not reported——
EBR-bench (Epoch AI run)76.2% ↗epoch runnot reported——
FrontierSWE V2 (Proximal Labs)65.5% ↗not reported——
Furniture Assembly (Epoch AI run)80% ↗epoch runnot reported——
GSO Opt@1 (GSO)77.5% ↗not reported——
LiveBench Agentic Coding (LiveBench)57.3% ↗not reported——
LiveBench Coding (LiveBench)80.4% ↗not reported——
LiveBench Data Analysis (LiveBench)83% ↗not reported——
LiveBench Instruction Following (LiveBench)75.6% ↗not reported——
LiveBench Language (LiveBench)89.4% ↗not reported——
LiveBench Mathematics (LiveBench)96.8% ↗not reported——
LiveBench Reasoning (LiveBench)92.7% ↗not reported——
MirrorCode (Epoch AI run)46.7% ↗epoch runnot reported——
SimpleBench (SimpleBench)86.5% ↗not reported——
Terminal-Bench Science 0.164.6% ↗not reported——
Vending-Bench 2 (Andon Labs)15514.7 ↗not reported——
WeirdML (Håvard Tveit Ihle)93.6% ↗not reported——
Only Inkling-Small reports · 15
SWE-bench Verifiednot reported80.2% ↗——
AIME 2026not reported95.5% ↗——
ARC-AGI-1not reported84% ↗——
ARC-AGI-2not reported40.1% ↗——
BrowseComp (with context management)not reported77.4% ↗——
CharXiv RQnot reported77.4% ↗——
CharXiv RQ (with python)not reported81.3% ↗——
HMMT Feb 2026not reported90.2% ↗——
IFBenchnot reported82.2% ↗——
MCP Atlas (all)not reported79.2% ↗——
MMAUnot reported77% ↗——
SWE-bench Pro (public)not reported55.9% ↗——
Terminal-Bench 2.1 (best harness)not reported64.7% ↗——
Toolathlon Verifiednot reported54.4% ↗——
Toolathlon-Verified (HKUST)not reported54.4% ↗——
Scores tagged "epoch" or "matharena" are independent runs, used only where the lab has not published its own; ⚠ marks rows MathArena flags as released after the competition. Higher is better on every row. Δ is GPT-6 Astra minus Inkling-Small in the benchmark's own unit. "Not reported" means the lab has not published that figure; it is not a zero. ↗ opens the source.
Specs & pricing

Side by side

SpecGPT-6 AstraInkling-SmallEdge
Context window1.1M tokens1M tokensGPT-6 Astra
Max output128K tokens——
Input price / 1M$10 ↗$0.3 ↗Inkling-Small
Output price / 1M$50 ↗$1.2 ↗Inkling-Small
Cached input / 1M$1 ↗$0.06 ↗Inkling-Small
Input + output / 1M
Lower is cheaper. List prices; batch, tool and regional fees excluded.
$60$1.5Inkling-Small
Modalitiestext · visiontext · vision · audioInkling-Small
Released2026-09-032026-07-30—
Cited benchmark scores3929—
Reliability

Provider status

All providers →
More matchups

Inkling-Small vs …

Built by Respan
Which one wins on your data?

Public benchmarks are a starting point. Run GPT-6 Astra and Inkling-Small on your own prompts with Respan evals, or route to either through one gateway key with automatic failover.