Decision support

Claude Sonnet 3.7 vs ERNIE 4.5

Compare canonical objects directly. The useful dimensions change with the object type, so model and hardware comparisons stay separate.

Benchmark results

  • Arena Text

    Arena rating · Higher is better

    • Claude Sonnet 3.7
      1388
      Arena #184CI 1384 to 1393
    • ERNIE 4.5
      Not reported
    Runs and sources
    Claude Sonnet 3.7
    • default138832K, thinking · 95% CI 1384 to 1393 · 38,126 votes
    • default137295% CI 1368 to 1376 · 42,553 votes
    ERNIE 4.5

    Not reported

  • Arena Vision

    Arena rating · Higher is better

    • Claude Sonnet 3.7
      1193
      Arena #98CI 1177 to 1208
    • ERNIE 4.5
      Not reported
    Runs and sources
    Claude Sonnet 3.7
    • default119332K, thinking · 95% CI 1177 to 1208 · 1,432 votes
    • default117595% CI 1166 to 1185 · 4,516 votes
    ERNIE 4.5

    Not reported

  • ARC-AGI-2

    Best published score · Higher is better

    • Claude Sonnet 3.7
      0.9%
      #76 of 85
    • ERNIE 4.5
      Not reported
    Runs and sources
    Claude Sonnet 3.7
    • default0.9%8K
    • default0.7%16K
    • default0.4%1K
    • default0.0%
    ERNIE 4.5

    Not reported

    Source:External evaluation via Epoch AIOriginal-source terms apply
  • FrontierMath-2025-02-28-Private

    Best published score · Higher is better

    • Claude Sonnet 3.7
      4.1%
      #44 of 58
    • ERNIE 4.5
      Not reported
    Runs and sources
    Claude Sonnet 3.7
    • default4.1%16K
    • default3.4%32K
    • default3.1%
    • default3.1%64K
    ERNIE 4.5

    Not reported

  • GPQA diamond

    Best published score · Higher is better

    • Claude Sonnet 3.7
      79.7%
      #88 of 161
    • ERNIE 4.5
      Not reported
    Runs and sources
    Claude Sonnet 3.7
    • default79.7%64K
    • default76.8%16K
    • default76.8%32K
    • default66.0%
    ERNIE 4.5

    Not reported

  • Humanity's Last Exam

    Best published score · Higher is better

    • Claude Sonnet 3.7
      8.0%
      #25 of 34
    • ERNIE 4.5
      Not reported
    Runs and sources
    Claude Sonnet 3.7
    • unknown8.0%
    ERNIE 4.5

    Not reported

    Source:External evaluation via Epoch AIOriginal-source terms apply
  • OSWorld

    Best published score · Higher is better

    • Claude Sonnet 3.7
      35.8%
      #8 of 10
    • ERNIE 4.5
      Not reported
    Runs and sources
    Claude Sonnet 3.7
    • default35.8%claude-3-7-sonnet-20250219 (50 steps)
    • default35.6%claude-3-7-sonnet-20250219 (100 steps)
    • default27.1%claude-3-7-sonnet-20250219 (15 steps)
    ERNIE 4.5

    Not reported

    Source:OS World WebsiteOriginal-source terms apply
  • OTIS Mock AIME 2024-2025

    Best published score · Higher is better

    • Claude Sonnet 3.7
      57.8%
      #115 of 158
    • ERNIE 4.5
      Not reported
    Runs and sources
    Claude Sonnet 3.7
    • default57.8%64K
    • default53.3%32K
    • default46.7%16K
    • default21.9%
    ERNIE 4.5

    Not reported

  • SWE-bench Verified

    Best published score · Higher is better

    • Claude Sonnet 3.7
      61.0%
      #31 of 35
    • ERNIE 4.5
      Not reported
    Runs and sources
    Claude Sonnet 3.7
    • default61.0%
    ERNIE 4.5

    Not reported

Each model's best published result is shown; "Not reported" means no matched evaluation, not a score of zero. Arena and DeepSWE ranks are the leaderboards' own; other ranks are among catalogue models with a score. Results from different harnesses or settings are not directly comparable.

Original-source terms apply to evaluations credited to their original publishers.

Benchmark compilation: Epoch AI, Capabilities & benchmarking (CC BY attribution). Scores are converted to percentages and model names matched to the Vertical Tabs catalog. Individual evaluations are credited to their original sources. External results may carry separate licences and evaluation configurations; do not interpret scores from different harnesses as directly comparable.

Arena ratings: Arena (lmarena-ai/leaderboard-dataset), licensed CC BY 4.0. Ratings come from pairwise human votes and are only comparable within one leaderboard; the interval is Arena's 95% confidence interval. Model names are matched to the Vertical Tabs catalog.

Model specifications

Release date
February 19, 2025
March 16, 2025
Context window
200K
—
Native context
—
—
Max output tokens
64,000
—
Knowledge cutoff
2024-10-31
—
Open weights
Closed
Closed
Parameter count
—
—

API pricing · USD per 1M tokens

Input
—
—
Output
—
—
Cached input
—
—
Cache write
—
—

Capabilities and modalities

Input modalities
text, image, file
text, image
Output modalities
text
text
Tool calling
Supported
—
Reasoning option
Supported
—
Supported options
tools, reasoning, temperature
—
Capabilities
—
—

Architecture and availability

Architecture
—
—
Model families
—
—
Tokenizer
—
—
Instruction format
—
—
License
—
proprietary
Providers
0
0
Provider endpoints
0
0
Ollama variants
0
0
Metadata source
ai-research
curated

A dash means the field is not reported. Provider-specific performance and pricing may differ.

To give you the best experience, we use cookies for personalization, insights, and performance. Learn more.