Combo Attention (PrefixLM+Softcap+Sigmoid) on Llama2-7b (q=32, k=32) (1k)
80.03Throughput (TFLOPS)CuBridge
Evaluation results
| Method | Links | |
|---|---|---|
| CuBridgeImplementation=CuBridge2026.05 | 80.03 | |
| Qimeng AttnImplementation=Qimeng Attention2026.05 | 17.78 | |
| TorchImplementation=Standard PyTorch2026.05 | 8.33 |