GPT-6.1 Sol launch post cover

Cost/1M tokens

input
$2.00
cached
$0.10
output
$10.00
cache write
$2.50
Context
1.1Mtokens
Released
1mo ago

Benchmarks

DeepSWE is the primary coding benchmark where an exact model evaluation exists. Arena leaderboards and other sourced evaluations appear below; missing scores are not zero.

How it ranks

Against its predecessor, similarly priced models and the models ranked around it.

DeepSWE 1.1

Best pass@1 per model · Higher is better

Not evaluated in DeepSWE 1.1

Arena Text

Best Arena rating per model · Higher is better

Arena #27

  1. 1526
    Gemini 4 CarbonSimilar price
  2. 1487
    Kimi K3Similar price
  3. 1483
    Gemini 3.6 FlashNearby rank
  4. 1483
    GLM 5.3Nearby rank
  5. 1482
    GPT-6.1 Sol
  6. 1482
    Claude Opus 4.8Nearby rank
  7. 1481
    GPT-5.5Nearby rank
  8. 1472
    Claude Sonnet 5.5Similar price
  9. 1457
    GPT-6 SolPredecessor
  10. 1354
    Command ASimilar price

+25 vs GPT-6 Sol (predecessor) · Ahead of 1 of 4 similarly priced models

Arena WebDev

Best Arena rating per model · Higher is better

Arena #6

  1. 1773
    Claude Sonnet 5.5Similar price
  2. 1768
    Gemini 4 CarbonSimilar price
  3. 1764
    GPT-6 AstraNearby rank
  4. 1743
    GPT-6.1 Sol
  5. 1742
    Claude Fable 5.1Nearby rank
  6. 1723
    Muse Wonder FullNearby rank
  7. 1676
    Qwen3.8 Max (0902)Similar price
  8. 1673
    GPT-6 SolPredecessor
  9. 1658
    Kimi K3Similar price

+70 vs GPT-6 Sol (predecessor) · Ahead of 2 of 4 similarly priced models

Arena Vision

Best Arena rating per model · Higher is better

Arena #12

  1. 1294
    Muse Spark 1.2Nearby rank
  2. 1293
    Gemini 3.8 FlashNearby rank
  3. 1293
    GPT-6.1 Sol
  4. 1291
    Muse Spark 1.3Nearby rank
  5. 1289
  6. 1280
    Grok 4.5Similar price
  7. 1280
  8. 1263
    Claude Sonnet 5.5Similar price
  9. 1258
    GPT-6 SolPredecessor
  10. 1199
    Mistral Medium 3.5Similar price

+34 vs GPT-6 Sol (predecessor) · Ahead of 2 of 4 similarly priced models

Arena Search

Best Arena rating per model · Higher is better

Arena #2

  1. 1255
    GPT-5.6 SolNearby rank
  2. 1248
    GPT-6.1 Sol
  3. 1245
    GPT-6 AstraNearby rank
  4. 1229
    GPT-6 SolPredecessor
  5. 1213
    Claude Opus 5.5Similar price
  6. 1205
    Grok 4.5Similar price
  7. 1142
    Sonar ProSimilar price
  8. 1138
    Sonar Reasoning ProSimilar price

+19 vs GPT-6 Sol (predecessor) · Ahead of 4 of 4 similarly priced models

Arena Document

Best Arena rating per model · Higher is better

Not ranked on Arena Document yet

Agent Arena

Best IPS score per model · Higher is better

Arena #7

  1. +0.170
    Gemini 4 CarbonSimilar price
  2. +0.160
    Claude Sonnet 5.5Similar price
  3. +0.148
    Claude Fable 5.1Nearby rank
  4. +0.145
    GPT-6 AstraNearby rank
  5. +0.125
    GPT-6.1 Sol
  6. +0.120
    GPT-6.1 TerraNearby rank
  7. +0.107
    Gemini 4 ArgonNearby rank
  8. +0.069
    GPT-6 SolPredecessor
  9. +0.026
    Grok 4.7Similar price
  10. +0.006
    Kimi K3Similar price

+0.055 vs GPT-6 Sol (predecessor) · Ahead of 2 of 4 similarly priced models

ARC-AGI-2

Best score per model · Higher is better

#2 of 85

  1. 95.0%
    GPT-6 AstraNearby rank
  2. 94.2%
    Gemini 4 CarbonSimilar price
  3. 94.2%
    GPT-6.1 Sol
  4. 93.8%
    Claude Fable 5.2Nearby rank
  5. 93.3%
    Claude Opus 5.5Nearby rank
  6. 89.6%
    GPT-6 SolPredecessor
  7. 83.9%
    Claude Sonnet 5.5Similar price
  8. 67.1%
    Grok 4.6Similar price
  9. 60.4%
    Kimi K3Similar price

+4.6 pts vs GPT-6 Sol (predecessor) · Ahead of 3 of 4 similarly priced models

FrontierMath-Tier-4-v2-Private

Best score per model · Higher is better

#1 of 72

  1. 100.0%
    Claude Fable 5.2Nearby rank
  2. 100.0%
    GPT-6.1 Sol
  3. 97.6%
    GPT-6 AstraNearby rank
  4. 95.1%
    Gemini 4 CarbonSimilar price
  5. 90.0%
    GPT-6 SolPredecessor
  6. 80.5%
    Claude Sonnet 5.5Similar price
  7. 39.0%
    Kimi K3Similar price
  8. 34.1%
    Qwen3.8 Max (0902)Similar price

+10.0 pts vs GPT-6 Sol (predecessor) · Ahead of 4 of 4 similarly priced models

FrontierMath-Tiers-1-3-v2-Private

Best score per model · Higher is better

#2 of 87

  1. 95.1%
    Claude Fable 5.2Nearby rank
  2. 93.7%
    GPT-6 AstraNearby rank
  3. 93.7%
    GPT-6.1 Sol
  4. 91.2%
    Claude Opus 5.5Nearby rank
  5. 90.9%
    GPT-6.1 TerraNearby rank
  6. 90.5%
    Gemini 4 CarbonSimilar price
  7. 89.8%
    GPT-6 SolPredecessor
  8. 88.8%
    Claude Sonnet 5.5Similar price
  9. 72.2%
    Kimi K3Similar price
  10. 66.0%
    Grok 4.6Similar price

+3.9 pts vs GPT-6 Sol (predecessor) · Ahead of 4 of 4 similarly priced models

GPQA diamond

Best score per model · Higher is better

#5 of 161

  1. 96.5%
    Gemini 4 CarbonSimilar price
  2. 95.6%
    Claude Sonnet 5.5Similar price
  3. 95.4%
    Gemini 3.8 FlashNearby rank
  4. 95.4%
    GPT-6.1 Sol
  5. 94.8%
    Gemini 3.7 FlashNearby rank
  6. 94.6%
    GPT-5.4 ProNearby rank
  7. 94.3%
    GPT-6 SolPredecessor
  8. 94.0%
    Grok 4.6Similar price
  9. 93.1%
    Kimi K3Similar price

+1.1 pts vs GPT-6 Sol (predecessor) · Ahead of 2 of 4 similarly priced models

OTIS Mock AIME 2024-2025

Best score per model · Higher is better

#1 of 158

  1. 100.0%
    Claude Sonnet 5.5Similar price
  2. 100.0%
    Gemini 4 ArgonSimilar price
  3. 100.0%
    GPT-6 AstraNearby rank
  4. 100.0%
    GPT-6 SolPredecessor
  5. 100.0%
    GPT-6.1 Sol
  6. 100.0%
    GPT-6.1 TerraNearby rank
  7. 100.0%
    Qwen3.8 Max (0902)Similar price
  8. 97.2%
    Kimi K3Similar price

Level with GPT-6 Sol (predecessor) · Ahead of 1 of 4 similarly priced models

SimpleQA Verified

Best score per model · Higher is better

#5 of 87

  1. 77.7%
    Gemini 4 CarbonSimilar price
  2. 76.0%
    Gemini 4 ArgonNearby rank
  3. 75.6%
    GPT-6 AstraNearby rank
  4. 73.9%
    GPT-6.1 Sol
  5. 73.5%
  6. 72.2%
    Claude Opus 5.5Nearby rank
  7. 60.7%
    GPT-6 SolPredecessor
  8. 56.0%
    Grok 4.7Similar price
  9. 50.6%
    Kimi K3Similar price
  10. 46.5%
    Claude Sonnet 5.5Similar price

+13.2 pts vs GPT-6 Sol (predecessor) · Ahead of 3 of 4 similarly priced models

Not evaluated in DeepSWE 1.1 as of 2026-09-22. Results are only shown for exact model versions in the official dataset. Official leaderboard.

Reasoning effort

ARC-AGI-2

Score by reasoning effort · Higher is better

All published scores

Benchmark compilation: Epoch AI, Capabilities & benchmarking (CC BY attribution). Scores are converted to percentages and model names matched to the Vertical Tabs catalog. Individual evaluations are credited to their original sources. External results may carry separate licences and evaluation configurations; do not interpret scores from different harnesses as directly comparable.

Arena ratings: Arena (lmarena-ai/leaderboard-dataset), licensed CC BY 4.0. Ratings come from pairwise human votes and are only comparable within one leaderboard; the interval is Arena's 95% confidence interval. Model names are matched to the Vertical Tabs catalog.

To give you the best experience, we use cookies for personalization, insights, and performance. Learn more.