PrefixLM Attention on Llama3.1 405B (q=128, k=8) (1k)
122.22PrefixLM Attention TFLOPS (1k)CuBridge
Evaluation Results
| Method | Links | |
|---|---|---|
| CuBridgeImplementation=CuBridge2026.05 | 122.22 | |
| FlexAttentionImplementation=PyTorch FlexAttention2026.05 | 107.89 | |
| Qimeng AttnImplementation=Qimeng Attention2026.05 | 76.01 | |
| TorchImplementation=Standard PyTorch2026.05 | 14.64 |