NVIDIA · Datacenter System
DGX-2 (V100 32 GB)
Volta
Prefill · prompt processing
Not benchmarked
Inference · generation speed
Not benchmarked
GPU / CPU chip
Tesla V100 32 GB / 2× Intel Xeon Platinum 8168
RAM / VRAM
512 GB GPU total
1,536 GB system RAM
No verified model-specific throughput measurement is published here yet. Prefill and generation rates depend on the model, precision, batch size and runtime.
Hardware specifications
| Product family | DGX-2 |
| Model / configuration | DGX-2 |
| Released | 2018 |
| Manufacturer | NVIDIA |
| Hardware category | Datacenter System |
| Architecture | Volta |
| Form factor | 10U rack |
| CPU | 2× Intel Xeon Platinum 8168 |
| CPU cores | 48 |
| Accelerator model | Tesla V100 32 GB |
| Accelerator count | 16 |
| Interconnect | 12× NVSwitch |
Where to buy
No verified retailer listings have been added for this hardware yet.
Retailer links do not guarantee stock or a current price.
Observed prices
No source-backed price observations recorded yet.
Historical observations retain their original currency. Prices are not converted or adjusted for regional taxes.
Memory & bandwidth
| Primary memory (comparison) | 512 GB GPU total |
| Memory technology | HBM2 (16 GPUs) |
| Memory per GPU | 32 GB |
| Total GPU memory | 512 GB |
| CPU system RAM | 1,536 GB |
| GPU / system bandwidth | — |
| Power | 10,000 W |
System memory, aggregate GPU memory and memory available to one accelerator are separate measurements. Do not treat total multi-GPU memory as a single unified pool.
System & deployment
| Networking | 8× 100 GbE / EDR InfiniBand |
| Storage | 8× 3.84 TB NVMe SSD |
System accelerators
Inference runtimes
No verified runtime compatibility records for this configuration yet.
Runtime support is not a model throughput or memory-fit benchmark.