Decision support

Tulu 2 DPO 70B vs Mixtral 8x7B Instruct v0.1

Compare canonical objects directly. The useful dimensions change with the object type, so model and hardware comparisons stay separate.

Benchmark results

  • Arena Text

    Arena rating · Higher is better

    • Tulu 2 DPO 70B
      Not reported
    • Mixtral 8x7B Instruct v0.1
      1197
      Arena #354CI 1193 to 1202
    Runs and sources
    Tulu 2 DPO 70B

    Not reported

    Mixtral 8x7B Instruct v0.1
    • default119795% CI 1193 to 1202 · 73,503 votes
  • GPQA diamond

    Best published score · Higher is better

    • Tulu 2 DPO 70B
      Not reported
    • Mixtral 8x7B Instruct v0.1
      30.6%
      #155 of 161
    Runs and sources
    Tulu 2 DPO 70B

    Not reported

    Mixtral 8x7B Instruct v0.1
    • default30.6%

Each model's best published result is shown; "Not reported" means no matched evaluation, not a score of zero. Arena and DeepSWE ranks are the leaderboards' own; other ranks are among catalogue models with a score. Results from different harnesses or settings are not directly comparable.

Benchmark compilation: Epoch AI, Capabilities & benchmarking (CC BY attribution). Scores are converted to percentages and model names matched to the Vertical Tabs catalog. Individual evaluations are credited to their original sources. External results may carry separate licences and evaluation configurations; do not interpret scores from different harnesses as directly comparable.

Arena ratings: Arena (lmarena-ai/leaderboard-dataset), licensed CC BY 4.0. Ratings come from pairwise human votes and are only comparable within one leaderboard; the interval is Arena's 95% confidence interval. Model names are matched to the Vertical Tabs catalog.

Model specifications

Release date
December 8, 2023
December 11, 2023
Context window
—
33K
Native context
—
—
Max output tokens
—
32,768
Knowledge cutoff
—
—
Open weights
Open weights
Open weights
Parameter count
69B
46.7B

API pricing · USD per 1M tokens

Input
—
—
Output
—
—
Cached input
—
—
Cache write
—
—

Capabilities and modalities

Input modalities
text
text
Output modalities
text
text
Tool calling
—
—
Reasoning option
—
—
Supported options
—
temperature
Capabilities
—
—

Architecture and availability

Architecture
—
—
Model families
—
—
Tokenizer
—
—
Instruction format
—
—
License
AI2 ImpACT Low-Risk License
Apache 2.0
Providers
0
0
Provider endpoints
0
0
Ollama variants
0
0
Metadata source
curated
ai-research

A dash means the field is not reported. Provider-specific performance and pricing may differ.

To give you the best experience, we use cookies for personalization, insights, and performance. Learn more.