Attention Latency on Qwen3-30B-A3B-Instruct-2507 (32K Context)
1Speedup FactorDense
Evaluation results
| Method | Links | |
|---|---|---|
| DenseGPU=H200 SXM, TP=2, Batch Size=4, Chunk Size=10242026.05 | 1 | |
| CompactAttention-FPGPU=H200 SXM, TP=2, Batch Size=4, Chunk Size=10242026.05 | 0.83 | |
| QUOKAGPU=H200 SXM, TP=2, Batch Size=4, Chunk Size=10242026.05 | 0.81 | |
| FlashPrefillGPU=H200 SXM, TP=2, Batch Size=4, Chunk Size=10242026.05 | 0.77 |