Decision support

OpenELM 3B vs Mistral 7B Instruct v0.3

Compare canonical objects directly. The useful dimensions change with the object type, so model and hardware comparisons stay separate.

Benchmark results

  • GPQA diamond

    Best published score · Higher is better

    • OpenELM 3B
      Not reported
    • Mistral 7B Instruct v0.3
      15.2%
      #160 of 161
    Runs and sources
    OpenELM 3B

    Not reported

    Mistral 7B Instruct v0.3
    • default15.2%
  • OTIS Mock AIME 2024-2025

    Best published score · Higher is better

    • OpenELM 3B
      Not reported
    • Mistral 7B Instruct v0.3
      0.3%
      #158 of 158
    Runs and sources
    OpenELM 3B

    Not reported

    Mistral 7B Instruct v0.3
    • default0.3%

Each model's best published result is shown; "Not reported" means no matched evaluation, not a score of zero. Arena and DeepSWE ranks are the leaderboards' own; other ranks are among catalogue models with a score. Results from different harnesses or settings are not directly comparable.

Benchmark compilation: Epoch AI, Capabilities & benchmarking (CC BY attribution). Scores are converted to percentages and model names matched to the Vertical Tabs catalog. Individual evaluations are credited to their original sources. External results may carry separate licences and evaluation configurations; do not interpret scores from different harnesses as directly comparable.

Model specifications

Release date
April 23, 2024
May 22, 2024
Context window
—
33K
Native context
—
—
Max output tokens
—
32,768
Knowledge cutoff
—
—
Open weights
Open weights
Open weights
Parameter count
3B
7B

API pricing · USD per 1M tokens

Input
—
—
Output
—
—
Cached input
—
—
Cache write
—
—

Capabilities and modalities

Input modalities
text
text
Output modalities
text
text
Tool calling
—
Supported
Reasoning option
—
—
Supported options
—
tools, temperature
Capabilities
—
—

Architecture and availability

Architecture
—
—
Model families
—
—
Tokenizer
—
—
Instruction format
—
—
License
apple-amlr
Apache 2.0
Providers
0
0
Provider endpoints
0
0
Ollama variants
0
0
Metadata source
curated
ai-research

A dash means the field is not reported. Provider-specific performance and pricing may differ.

To give you the best experience, we use cookies for personalization, insights, and performance. Learn more.