Compare / head-to-head

Phi-4 Multimodal InstructvsQwen3.5 9B

Qwen3.5 9B leads 1 of 1 shared benchmark. Qwen3.5 9B has the larger context window (262K tokens).

Benchmarks from cited public sources; pricing from official pages; status from official provider feeds.

Shared benchmarks
0 – 1
Qwen3.5 9B leads
Cheaper per token
—
list price, input + output
Larger context
Qwen3.5 9B
262K tokens
Providers
2 providers
Microsoft · Qwen
Phi-4 Multimodal Instruct
Microsoft · released 2025-02-26
textvisionaudio
Context
128K
Max out
4K
Input /1M
—
Output /1M
—
Cached /1M
—
Scores
19 · 0 core
Qwen3.5 9B
Qwen · released 2026-03-02
textvisionvideo
Context
262K
Max out
—
Input /1M
—
Output /1M
—
Cached /1M
—
Scores
18 · 5 core
Quality

Benchmark matrix

BenchmarkPhi-4 Multimodal InstructQwen3.5 9BΔEdge
Reported by both · 1
MMMU55.1% ↗78.4% ↗-23.3 ptQwen3.5 9B
Only Phi-4 Multimodal Instruct reports · 18
AI2D82.3% ↗not reported——
BLINK61.3% ↗not reported——
ChartQA81.4% ↗not reported——
DocVQA93.2% ↗not reported——
InfoVQA72.7% ↗not reported——
InterGPS48.6% ↗not reported——
MathVista testmini62.4% ↗not reported——
MMBench (dev-en)86.7% ↗not reported——
MMMU-Pro (standard/vision)38.5% ↗not reported——
OCRBench84.4% ↗not reported——
POPE85.6% ↗not reported——
ScienceQA Visual97.5% ↗not reported——
Speech AI2D68.9% ↗not reported——
Speech ChartQA69% ↗not reported——
Speech DocVQA87.3% ↗not reported——
Speech InfoVQA63.7% ↗not reported——
TextVQA (val)75.6% ↗not reported——
Video-MME (16 frames)55% ↗not reported——
Only Qwen3.5 9B reports · 16
GPQA Diamondnot reported81.7% ↗——
MMLU-Pronot reported82.5% ↗——
BFCL-V4not reported66.1% ↗——
Chess Puzzles (Epoch AI run)not reported12% ↗epoch run——
HMMT Feb 25not reported83.2% ↗——
IFBenchnot reported64.5% ↗——
IFEvalnot reported91.5% ↗——
LiveCodeBench v6not reported65.6% ↗——
LongBench v2not reported55.2% ↗——
MMLU-Reduxnot reported91.1% ↗——
MMMLUnot reported81.2% ↗——
MMMU-Pronot reported70.1% ↗——
OSWorld-Verifiednot reported41.8% ↗——
OTIS Mock AIME 2024-2025 (Epoch AI run)not reported61.7% ↗epoch run——
SuperGPQAnot reported58.2% ↗——
TAU2-Benchnot reported79.1% ↗——
Scores tagged "epoch" or "matharena" are independent runs, used only where the lab has not published its own; ⚠ marks rows MathArena flags as released after the competition. Higher is better on every row. Δ is Phi-4 Multimodal Instruct minus Qwen3.5 9B in the benchmark's own unit. "Not reported" means the lab has not published that figure; it is not a zero. ↗ opens the source.
Specs & pricing

Side by side

SpecPhi-4 Multimodal InstructQwen3.5 9BEdge
Context window128K tokens262K tokensQwen3.5 9B
Max output4K tokens——
Input price / 1M———
Output price / 1M———
Cached input / 1M———
Input + output / 1M
Lower is cheaper. List prices; batch, tool and regional fees excluded.
———
Modalitiestext · vision · audiotext · vision · videoTie
Released2025-02-262026-03-02—
Cited benchmark scores1918—
Reliability

Provider status

All providers →
More matchups

Phi-4 Multimodal Instruct vs …

Built by Respan
Which one wins on your data?

Public benchmarks are a starting point. Run Phi-4 Multimodal Instruct and Qwen3.5 9B on your own prompts with Respan evals, or route to either through one gateway key with automatic failover.