Decision support
Claude Opus 4 vs Apple On-Device Model (2025)
Compare canonical objects directly. The useful dimensions change with the object type, so model and hardware comparisons stay separate.
Benchmark results
Arena Text
Arena rating · Higher is better
- Claude Opus 41426Arena #123CI 1422 to 1431
Apple On-Device Model (2025)Not reported
Runs and sources
Claude Opus 4- default142616K, thinking · 95% CI 1422 to 1431 · 35,852 votes
- default141495% CI 1410 to 1419 · 42,967 votes
Apple On-Device Model (2025)Not reported
Arena Vision
Arena rating · Higher is better
- Claude Opus 41208Arena #88CI 1192 to 1224
- Apple On-Device Model (2025)Not reported
Runs and sources
Claude Opus 4- default120816K, thinking · 95% CI 1192 to 1224 · 1,287 votes
- default118995% CI 1176 to 1202 · 2,166 votes
Apple On-Device Model (2025)Not reported
ARC-AGI-2
Best published score · Higher is better
- Claude Opus 48.6%#58 of 85
- Apple On-Device Model (2025)Not reported
Runs and sources
Claude Opus 4- default8.6%16K
- default4.5%8K
- default1.3%
- default0.0%1K
Apple On-Device Model (2025)Not reported
Source:External evaluation via Epoch AIOriginal-source terms applyFrontierMath-2025-02-28-Private
Best published score · Higher is better
- Claude Opus 44.5%#42 of 58
- Apple On-Device Model (2025)Not reported
Runs and sources
Claude Opus 4- default4.5%
- default4.1%27K
Apple On-Device Model (2025)Not reported
Source:Epoch AI evaluationFrontierMath-Tier-4-2025-07-01-Private
Best published score · Higher is better
- Claude Opus 44.2%#18 of 46
- Apple On-Device Model (2025)Not reported
Runs and sources
Claude Opus 4- default4.2%27K
- default0.0%
Apple On-Device Model (2025)Not reported
Source:Epoch AI evaluationGPQA diamond
Best published score · Higher is better
- Claude Opus 476.3%#97 of 161
- Apple On-Device Model (2025)Not reported
Runs and sources
Claude Opus 4- default76.3%16K
- default69.2%
Apple On-Device Model (2025)Not reported
Source:Epoch AI evaluationHumanity's Last Exam
Best published score · Higher is better
- Claude Opus 46.7%#28 of 34
- Apple On-Device Model (2025)Not reported
Runs and sources
Claude Opus 4- unknown6.7%
Apple On-Device Model (2025)Not reported
Source:External evaluation via Epoch AIOriginal-source terms applyOTIS Mock AIME 2024-2025
Best published score · Higher is better
- Claude Opus 464.4%#109 of 158
- Apple On-Device Model (2025)Not reported
Runs and sources
Claude Opus 4- default64.4%27K
- default60.0%16K
- default42.2%
Apple On-Device Model (2025)Not reported
Source:Epoch AI evaluationSWE-bench Verified
Best published score · Higher is better
- Claude Opus 470.7%#27 of 35
- Apple On-Device Model (2025)Not reported
Runs and sources
Claude Opus 4- default70.7%
Apple On-Device Model (2025)Not reported
Source:Epoch AI evaluation
Each model's best published result is shown; "Not reported" means no matched evaluation, not a score of zero. Arena and DeepSWE ranks are the leaderboards' own; other ranks are among catalogue models with a score. Results from different harnesses or settings are not directly comparable.
Original-source terms apply to evaluations credited to their original publishers.
Benchmark compilation: Epoch AI, Capabilities & benchmarking (CC BY attribution). Scores are converted to percentages and model names matched to the Vertical Tabs catalog. Individual evaluations are credited to their original sources. External results may carry separate licences and evaluation configurations; do not interpret scores from different harnesses as directly comparable.
Arena ratings: Arena (lmarena-ai/leaderboard-dataset), licensed CC BY 4.0. Ratings come from pairwise human votes and are only comparable within one leaderboard; the interval is Arena's 95% confidence interval. Model names are matched to the Vertical Tabs catalog.
Model specifications
API pricing · USD per 1M tokens
Capabilities and modalities
Architecture and availability
A dash means the field is not reported. Provider-specific performance and pricing may differ.