Decision support
Claude Sonnet 5.5 vs Gemini 4 Carbon
Compare canonical objects directly. The useful dimensions change with the object type, so model and hardware comparisons stay separate.
Benchmark results
Head to head on 9 benchmarks both models report · 3 ties
Claude Sonnet 5.50leads
Gemini 4 Carbon6leads
Arena Text
Arena rating · Higher is better
Claude Sonnet 5.51472Arena #46CI 1466 to 1479
Gemini 4 CarbonBest1526+53 ahead · Arena #1CI 1516 to 1536
Runs and sources
Claude Sonnet 5.5- xhigh147295% CI 1466 to 1479 · 13,821 votes
Gemini 4 Carbon- high152695% CI 1516 to 1536 · 4,282 votes
- Tie, within 95% CI
Arena WebDev
Arena rating · Higher is better
Claude Sonnet 5.51773Arena #3CI 1763 to 1782
Gemini 4 Carbon1768Arena #4CI 1753 to 1783
Runs and sources
Claude Sonnet 5.5- high171595% CI 1707 to 1724 · 7,881 votes
- xhigh177395% CI 1763 to 1782 · 5,818 votes
Gemini 4 Carbon- high176895% CI 1753 to 1783 · 2,120 votes
Arena Vision
Arena rating · Higher is better
Claude Sonnet 5.51263Arena #43CI 1253 to 1273
Gemini 4 CarbonNot reported
Runs and sources
Claude Sonnet 5.5- xhigh126395% CI 1253 to 1273 · 4,257 votes
Gemini 4 CarbonNot reported
- Tie, within 95% CI
Agent Arena
IPS score · Higher is better
Claude Sonnet 5.5+0.160Arena #4CI +0.131 to +0.188
Gemini 4 Carbon+0.170Arena #3CI +0.163 to +0.177
Runs and sources
Claude Sonnet 5.5- max+0.16095% CI +0.131 to +0.188 · 1,274,623 observations
Gemini 4 Carbon- high+0.17095% CI +0.163 to +0.177 · 9,558,978 observations
ARC-AGI-2
Best published score · Higher is better
Claude Sonnet 5.583.9%#17 of 85
Gemini 4 CarbonBest94.2%+10.3 pts ahead · #2 of 85
Runs, sources and effort chart
Claude Sonnet 5.5- low24.0%
- medium32.8%
- high67.4%
- xhigh83.9%
Gemini 4 Carbon- low49.6%
- medium94.2%
- high92.1%
Source:External evaluation via Epoch AIOriginal-source terms applyFrontierMath-Tier-4-v2-Private
Best published score · Higher is better
Claude Sonnet 5.580.5%#11 of 72
Gemini 4 CarbonBest95.1%+14.6 pts ahead · #4 of 72
Runs and sources
Claude Sonnet 5.5- max80.5%
Gemini 4 Carbon- high95.1%
Source:Epoch AI evaluationFrontierMath-Tiers-1-3-v2-Private
Best published score · Higher is better
Claude Sonnet 5.588.8%#10 of 87
Gemini 4 CarbonBest90.5%+1.8 pts ahead · #6 of 87
Runs and sources
Claude Sonnet 5.5- max88.8%
Gemini 4 Carbon- high90.5%
Source:Epoch AI evaluationGPQA diamond
Best published score · Higher is better
Claude Sonnet 5.595.6%#4 of 161
Gemini 4 CarbonBest96.5%+0.9 pts ahead · #1 of 161
Runs and sources
Claude Sonnet 5.5- max95.6%
Gemini 4 Carbon- high96.5%
Source:Epoch AI evaluationHumanity's Last Exam
Best published score · Higher is better
Claude Sonnet 5.546.1%#4 of 34
Gemini 4 CarbonNot reported
Runs and sources
Claude Sonnet 5.5- xhigh46.1%
Gemini 4 CarbonNot reported
Source:External evaluation via Epoch AIOriginal-source terms apply- Tie
OTIS Mock AIME 2024-2025
Best published score · Higher is better
Claude Sonnet 5.5100.0%#1 of 158
Gemini 4 Carbon100.0%#1 of 158
Runs and sources
Claude Sonnet 5.5- max100.0%
Gemini 4 Carbon- high100.0%
Source:Epoch AI evaluation SimpleQA Verified
Best published score · Higher is better
Claude Sonnet 5.546.5%#39 of 87
Gemini 4 CarbonBest77.7%+31.2 pts ahead · #2 of 87
Runs and sources
Claude Sonnet 5.5- max46.5%
Gemini 4 Carbon- high77.7%
Source:Epoch AI evaluation
Each model's best published result is shown; "Not reported" means no matched evaluation, not a score of zero. Arena and DeepSWE ranks are the leaderboards' own; other ranks are among catalogue models with a score. Results from different harnesses or settings are not directly comparable.
Original-source terms apply to evaluations credited to their original publishers.
Benchmark compilation: Epoch AI, Capabilities & benchmarking (CC BY attribution). Scores are converted to percentages and model names matched to the Vertical Tabs catalog. Individual evaluations are credited to their original sources. External results may carry separate licences and evaluation configurations; do not interpret scores from different harnesses as directly comparable.
Arena ratings: Arena (lmarena-ai/leaderboard-dataset), licensed CC BY 4.0. Ratings come from pairwise human votes and are only comparable within one leaderboard; the interval is Arena's 95% confidence interval. Model names are matched to the Vertical Tabs catalog.
Model specifications
API pricing · USD per 1M tokens
Capabilities and modalities
Architecture and availability
A dash means the field is not reported. Provider-specific performance and pricing may differ.