LLM Training Throughput on Llama3-8B (2k SeqLen, train)
2,862.22Training Throughput (samples/sec)Megatron-LM
Evaluation Results
| Method | Links | |
|---|---|---|
| Megatron-LM2026.05 | 2,862.22 | |
| ZeRO-12026.05 | 2,498.13 | |
| AGoQ2026.05 | 2,148.82 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| Megatron-LM2026.05 | 2,862.22 | |
| ZeRO-12026.05 | 2,498.13 | |
| AGoQ2026.05 | 2,148.82 |