Text Generation on 1,500-token output
138Single-stream Sustained Throughput (tok/s)XFP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| XFPModel=Qwen3.5-122B-A10B, Hardware=RTX PRO 6000 Blackwell, Tensor Parallelism=2, Quantization=XFP, quantize-on-load, Effective bits=~3.97, VRAM / GPU=57 / 96 GiB, GPU util. (single-stream)=98% / 98%, GPU power (single-stream)=240 / 240 W2026.05 | 138 | 137 |