- input
- $0.14
- cached
- $0.0028
- output
- $0.28
- Context
- 1.1Mtokens
- Released
- 1mo ago
- Size
- 161Bparameters
Cost/1M tokens
Benchmarks
DeepSWE is the primary coding benchmark where an exact model evaluation exists. Arena leaderboards and other sourced evaluations appear below; missing scores are not zero.
How it ranks
Against its predecessor, similarly priced models and the models ranked around it.
DeepSWE 1.1
Best pass@1 per model · Higher is better
Not evaluated in DeepSWE 1.1
Arena Text
Best Arena rating per model · Higher is better
Arena #86
- 1448
Step 5 PreviewNearby rank - 1448
MiMo-V2-ProNearby rank - 1448MiMo-V2.6-Flash
- 1447
GPT-5.4 MiniNearby rank - 1446
ERNIE 5.0Nearby rank - 1422
Claude Haiku 5.5Similar price - 1393Step 3.5 FlashSimilar price
- 1392MiMo-V2-FlashPredecessor
- 1360
Nemotron 3 SuperSimilar price - 1322GPT-4.1 NanoSimilar price
+56 vs MiMo-V2-Flash (predecessor) · Ahead of 4 of 4 similarly priced models
Arena WebDev
Best Arena rating per model · Higher is better
Arena #24
- 1646
Inkling 2 SmallNearby rank - 1641
Grok 4.7Nearby rank - 1638MiMo-V2.6-Flash
- 1632
Hy4 previewNearby rank - 1625Claude Fable 5Nearby rank
- 1609
Muse EmberSimilar price - 1594Claude Haiku 5.5Similar price
- 1577GPT-6 LunaSimilar price
- 1506Hy3Similar price
- 1331MiMo-V2-FlashPredecessor
+307 vs MiMo-V2-Flash (predecessor) · Ahead of 4 of 4 similarly priced models
Arena Vision
Best Arena rating per model · Higher is better
Arena #56
- 1250GPT-5.4 MiniNearby rank
- 1249Grok 4.7Nearby rank
- 1248MiMo-V2.6-Flash
- 1247
Gemini 2.5 ProNearby rank - 1247MiMo-V2.6-ProNearby rank
- 1234MiMo-V2.5Earlier version
- 1160Gemma 3 27BSimilar price
- 1128Llama 4 ScoutSimilar price
- 1089GPT-4.1 NanoSimilar price
- 1019
Nova Lite 1.0Similar price
Level with MiMo-V2.5 (earlier version, overlapping 95% CIs) · Ahead of 4 of 4 similarly priced models
Arena Search
Best Arena rating per model · Higher is better
Not ranked on Arena Search yet
Agent Arena
Best IPS score per model · Higher is better
Arena #33
- +0.017Muse EmberSimilar price
- +0.016GPT-6 LunaSimilar price
- +0.005Claude Haiku 5.5Similar price
- +0.002
GLM 5.2Nearby rank - +0.001
Qwen3.8 MaxNearby rank - -0.000MiMo-V2.6-Flash
- -0.002Grok 4.6Nearby rank
- -0.018GPT-5.6 TerraNearby rank
- -0.076Hy3Similar price
Ahead of 1 of 4 similarly priced models
Not evaluated in DeepSWE 1.1 as of 2026-09-22. Results are only shown for exact model versions in the official dataset. Official leaderboard.
All published scores
- Arena TextArena #861448
+56 vs MiMo-V2-Flash (predecessor)
- default144895% CI 1443 to 1453 · 22,354 votes
- Arena WebDevArena #241638
+307 vs MiMo-V2-Flash (predecessor)
- default163895% CI 1630 to 1645 · 8,890 votes
- Arena VisionArena #561248
Level with MiMo-V2.5 (earlier version, overlapping 95% CIs)
- default124895% CI 1239 to 1256 · 6,906 votes
- Agent ArenaArena #33-0.000
- default-0.00095% CI -0.011 to +0.010 · 3,948,227 observations
Arena ratings: Arena (lmarena-ai/leaderboard-dataset), licensed CC BY 4.0. Ratings come from pairwise human votes and are only comparable within one leaderboard; the interval is Arena's 95% confidence interval. Model names are matched to the Vertical Tabs catalog.