Inference provider
Catalogue
Available models
| Model | Endpoint | Context | Input /M | Output /M | Cached input /M | Cache write /M | Uptime 1d |
|---|---|---|---|---|---|---|---|
| venice | 160K | $0.27 | $0.39 | $0.13 | — | 95.04% | |
| venice | 1M | $0.10 | $0.19 | $0.02 | — | 100.00% | |
| venice | 1M | $0.13 | $0.26 | $0.03 | — | 100.00% | |
| venice | 1M | $1.65 | $3.30 | $0.33 | — | 98.33% | |
| venice | 1M | $1.65 | $4.95 | $0.17 | — | 93.75% | |
| venice/fp8 | 1M | $0.30 | $1.20 | $0.0075 | — | 99.93% | |
| venice/fp4 | 198K | $0.43 | $1.75 | $0.08 | — | 100.00% | |
| venice/fp4 | 198K | $0.40 | $1.93 | $0.08 | — | 28.89% | |
| venice/fp8 | 128K | $0.06 | $0.40 | $0.01 | — | 100.00% | |
| venice/fp8 | 198K | $1.00 | $3.20 | $0.20 | — | 85.71% | |
| venice/fp8 | 200K | $1.40 | $4.40 | $0.26 | — | 100.00% | |
| venice/fp8 | 1M | $1.40 | $4.40 | $0.26 | — | 99.86% | |
| venice | 1M | $1.40 | $4.40 | $0.26 | — | 95.99% | |
| venice | 1.0M | $0.15 | $0.50 | $0.03 | — | 96.78% | |
| venice/bf16 | 256K | $0.13 | $0.40 | $0.05 | — | 99.72% | |
| venice/fp4 | 256K | $0.12 | $0.36 | $0.09 | — | 100.00% | |
| venice | 256K | $0.53 | $3.32 | $0.21 | — | 100.00% | |
| venice/int4 | 256K | $0.75 | $3.50 | $0.16 | — | 94.25% | |
| venice/int4 | 256K | $0.75 | $3.50 | $0.16 | — | 100.00% | |
| venice/fp8 | 1M | $0.40 | $2.00 | $0.08 | — | 78.92% | |
| venice/fp8 | 1M | $0.18 | $0.35 | $0.00375 | — | 56.13% | |
| venice | 198K | $0.27 | $0.95 | $0.03 | — | 99.04% | |
| venice/fp8 | 524K | $0.30 | $1.20 | $0.06 | — | 99.41% | |
| venice/fp8 | 256K | $0.09 | $0.25 | — | — | 98.40% | |
| venice/fp8 | 256K | $0.63 | $3.13 | $0.19 | — | 99.68% | |
| venice/fp8 | 128K | $0.15 | $0.75 | — | — | 99.17% | |
| venice/fp8 | 128K | $0.45 | $3.50 | — | — | 97.80% | |
| venice/fp8 | 256K | $0.35 | $1.50 | $0.04 | — | 86.38% | |
| venice/fp8 | 128K | $0.21 | $1.90 | $0.10 | — | 99.93% | |
| venice | 128K | $0.75 | $4.50 | — | — | 72.34% | |
| venice | 256K | $0.15 | $1.00 | $0.05 | — | 100.00% | |
| venice/fp8 | 256K | $0.10 | $0.15 | — | — | 100.00% | |
| venice/fp8 | 256K | $0.33 | $3.25 | — | — | 99.62% | |
| venice/fp8 | 256K | $0.10 | $1.00 | — | — | 96.41% | |
| venice | 262K | $2.00 | $6.00 | $0.25 | — | 95.69% | |
| venice/fp8 | 262K | $0.45 | $3.20 | — | — | 100.00% | |
| Uncensored | venice/fp16 | 128K | $0.20 | $0.90 | — | — | 100.00% |
| venice/int4 | 128K | $0.03 | $0.15 | $0.03 | — | 99.24% |
