Sign Up

Decision support

Claude Sonnet 4 vs Kimi K3

Compare canonical objects directly. The useful dimensions change with the object type, so model and hardware comparisons stay separate.

ModelsHardware
Claude Sonnet 4

Anthropic

Sources:models.dev

Kimi K3

Moonshot AI

Sources:models.devOpenRouter

Benchmark results

Head to head on 4 benchmarks both models report

  • Claude Sonnet 40leads
  • Kimi K34leads

  • DeepSWE 1.1

    Best pass@1 · Higher is better

    • Claude Sonnet 4
      Not reported
    • Kimi K3
      68.5%
      #8 of 28
    Runs and sources
    Claude Sonnet 4

    Not reported

    Kimi K3
    • max68.5%mini-swe-agent · pass@4 89.4% · $4.65 / attempt
    Source:DeepSWE leaderboard, 2026-09-22Official source JSON

  • Arena Text

    Arena rating · Higher is better

    • Claude Sonnet 4
      1402
      Arena #165CI 1397 to 1406
    • Kimi K3
      Best1487
      +85 ahead · Arena #19CI 1483 to 1491
    Runs and sources
    Claude Sonnet 4
    • default140232K, thinking · 95% CI 1397 to 1406 · 34,078 votes
    • default139195% CI 1387 to 1395 · 39,126 votes
    Kimi K3
    • max148795% CI 1483 to 1491 · 40,867 votes
    Source:Arena Text leaderboard, 2026-11-09

  • Arena WebDev

    Arena rating · Higher is better

    • Claude Sonnet 4
      Not reported
    • Kimi K3
      1658
      Arena #18CI 1652 to 1664
    Runs and sources
    Claude Sonnet 4

    Not reported

    Kimi K3
    • max165895% CI 1652 to 1664 · 22,405 votes
    Source:Arena WebDev leaderboard, 2026-11-10

  • Arena Vision

    Arena rating · Higher is better

    • Claude Sonnet 4
      1206
      Arena #90CI 1189 to 1223
    • Kimi K3
      Not reported
    Runs and sources
    Claude Sonnet 4
    • default120632K, thinking · 95% CI 1189 to 1223 · 1,141 votes
    • default118995% CI 1174 to 1203 · 1,803 votes
    Kimi K3

    Not reported

    Source:Arena Vision leaderboard, 2026-11-09

  • Agent Arena

    IPS score · Higher is better

    • Claude Sonnet 4
      Not reported
    • Kimi K3
      +0.006
      Arena #28CI -0.001 to +0.012
    Runs and sources
    Claude Sonnet 4

    Not reported

    Kimi K3
    • max+0.00695% CI -0.001 to +0.012 · 16,124,377 observations
    Source:Agent Arena leaderboard, 2026-11-11

  • ARC-AGI-2

    Best published score · Higher is better

    • Claude Sonnet 4
      5.9%
      #60 of 85
    • Kimi K3
      Best60.4%
      +54.5 pts ahead · #36 of 85
    Runs and sources
    Claude Sonnet 4
    • default5.9%16K
    • default2.1%8K
    • default1.3%
    • default0.8%1K
    Kimi K3
    • low12.4%
    • high55.0%
    • max60.4%
    Source:External evaluation via Epoch AIOriginal-source terms apply

  • FrontierMath-2025-02-28-Private

    Best published score · Higher is better

    • Claude Sonnet 4
      4.1%
      #44 of 58
    • Kimi K3
      Not reported
    Runs and sources
    Claude Sonnet 4
    • default4.1%
    Kimi K3

    Not reported

    Source:Epoch AI evaluation

  • FrontierMath-Tier-4-2025-07-01-Private

    Best published score · Higher is better

    • Claude Sonnet 4
      0.0%
      #39 of 46
    • Kimi K3
      Not reported
    Runs and sources
    Claude Sonnet 4
    • default0.0%
    Kimi K3

    Not reported

    Source:Epoch AI evaluation

  • FrontierMath-Tier-4-v2-Private

    Best published score · Higher is better

    • Claude Sonnet 4
      Not reported
    • Kimi K3
      39.0%
      #28 of 72
    Runs and sources
    Claude Sonnet 4

    Not reported

    Kimi K3
    • max39.0%
    Source:Epoch AI evaluation

  • FrontierMath-Tiers-1-3-v2-Private

    Best published score · Higher is better

    • Claude Sonnet 4
      Not reported
    • Kimi K3
      72.2%
      #26 of 87
    Runs and sources
    Claude Sonnet 4

    Not reported

    Kimi K3
    • max72.2%
    Source:Epoch AI evaluation

  • GPQA diamond

    Best published score · Higher is better

    • Claude Sonnet 4
      79.2%
      #89 of 161
    • Kimi K3
      Best93.1%
      +13.9 pts ahead · #21 of 161
    Runs and sources
    Claude Sonnet 4
    • default79.2%59K
    • default78.3%32K
    • default75.8%16K
    • default66.7%
    Kimi K3
    • low84.8%
    • high91.9%
    • max93.1%
    Source:Epoch AI evaluation

  • Humanity's Last Exam

    Best published score · Higher is better

    • Claude Sonnet 4
      5.5%
      #30 of 34
    • Kimi K3
      Not reported
    Runs and sources
    Claude Sonnet 4
    • unknown5.5%
    Kimi K3

    Not reported

    Source:External evaluation via Epoch AIOriginal-source terms apply

  • OSWorld

    Best published score · Higher is better

    • Claude Sonnet 4
      43.9%
      #7 of 10
    • Kimi K3
      Not reported
    Runs and sources
    Claude Sonnet 4
    • default43.9%claude-4-sonnet-20250514 (50 steps)
    • default41.4%claude-4-sonnet-20250514 (100 steps)
    • default31.2%claude-4-sonnet-20250514 (15 steps)
    Kimi K3

    Not reported

    Source:OS World WebsiteOriginal-source terms apply

  • OTIS Mock AIME 2024-2025

    Best published score · Higher is better

    • Claude Sonnet 4
      71.1%
      #91 of 158
    • Kimi K3
      Best97.2%
      +26.1 pts ahead · #32 of 158
    Runs and sources
    Claude Sonnet 4
    • default71.1%32K
    • default68.9%59K
    • default53.3%16K
    • default28.9%
    Kimi K3
    • low68.9%
    • high93.3%
    • max97.2%
    Source:Epoch AI evaluation

  • SimpleQA Verified

    Best published score · Higher is better

    • Claude Sonnet 4
      Not reported
    • Kimi K3
      50.6%
      #29 of 87
    Runs and sources
    Claude Sonnet 4

    Not reported

    Kimi K3
    • max50.6%
    Source:Epoch AI evaluation

Each model's best published result is shown; "Not reported" means no matched evaluation, not a score of zero. Arena and DeepSWE ranks are the leaderboards' own; other ranks are among catalogue models with a score. Results from different harnesses or settings are not directly comparable.

Original-source terms apply to evaluations credited to their original publishers.

DeepSWE 1.1 results: official leaderboard, data generated 2026-09-22. Only exact model versions in the official dataset are matched.

Benchmark compilation: Epoch AI, Capabilities & benchmarking (CC BY attribution). Scores are converted to percentages and model names matched to the Vertical Tabs catalog. Individual evaluations are credited to their original sources. External results may carry separate licences and evaluation configurations; do not interpret scores from different harnesses as directly comparable.

Arena ratings: Arena (lmarena-ai/leaderboard-dataset), licensed CC BY 4.0. Ratings come from pairwise human votes and are only comparable within one leaderboard; the interval is Arena's 95% confidence interval. Model names are matched to the Vertical Tabs catalog.

Model specifications

Release date
May 22, 2025
July 16, 2026
Context window
200K
1M
Native context
—
1M
Max output tokens
64,000
943,718
Knowledge cutoff
2025-03-31
—
Open weights
Closed
Open weights
Parameter count
—
2.8T

API pricing · USD per 1M tokens

Input
—
$0.192
Output
—
$16.00
Cached input
—
$0.182
Cache write
—
—

Capabilities and modalities

Input modalities
text, image, file
text, image, video
Output modalities
text
text
Tool calling
Supported
Supported
Reasoning option
Supported
Supported
Supported options
tools, reasoning, temperature
frequency_penalty, include_reasoning, logit_bias, logprobs, max_tokens, min_p, presence_penalty, reasoning, reasoning_effort, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_logprobs, top_p
Capabilities
—
vision, thinking, completion, tools

Architecture and availability

Architecture
—
kimi-k3
Model families
—
kimi-k3
Tokenizer
—
Other
Instruction format
—
—
License
—
—
Providers
0
18
Provider endpoints
0
54
Ollama variants
0
1
Metadata source
ai-research
ai-research

A dash means the field is not reported. Provider-specific performance and pricing may differ.

To give you the best experience, we use cookies for personalization, insights, and performance. Learn more.