GPU Serving Throughput (4096 Prompt / 512 Decode Tokens)
274.61Throughput (tok/s)RW-TTT full
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RW-TTT fullTrace=uniform2026.05 | 274.61 | 33.53 | 9.31 | 3.44 | |
| Phase groupingTrace=uniform2026.05 | 226.24 | 33.39 | 7.67 | 2.84 | |
| RW-TTT fullTrace=bursty update2026.05 | 177.55 | 33.38 | 6.02 | 2.23 | |
| RW-TTT fullTrace=all-update stress2026.05 | 174.66 | 33.42 | 5.92 | 2.19 | |
| 3 serial replicasTrace=uniform2026.05 | 79.78 | 32.5 | 2.7 | 1 | |
| Serial TTTTrace=uniform2026.05 | 29.51 | — | 1 | — |