Directory
Hardware
Compare GPU/CPU chips, prompt-processing (prefill) speed and inference generation speed. Token rates are measured for specific models and runtimes, not theoretical hardware specifications.
4 hardware models · Showing 1–4
| Select hardware to compare | Hardware | GPU / CPU chip | Prefill (tok/s) | Inference (tok/s) | RAM / VRAM |
|---|---|---|---|---|---|
| GeForce RTX 3090 | — | — | 24 GB GPU | ||
| GeForce RTX 4090 | — | — | 24 GB GPU | ||
| GeForce RTX 5090 | — | — | 32 GB GPU | ||
| Tesla P100 SXM2 16 GB | — | — | 16 GB GPU |