LLM Training Throughput on Llama3-8B (8k SeqLen, train)
8,188.41Training Throughput (samples/sec)Megatron-LM
Evaluation Results
| Method | Links | |
|---|---|---|
| Megatron-LM2026.05 | 8,188.41 | |
| ZeRO-12026.05 | 7,848.12 | |
| AGoQ2026.05 | 7,755.74 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| Megatron-LM2026.05 | 8,188.41 | |
| ZeRO-12026.05 | 7,848.12 | |
| AGoQ2026.05 | 7,755.74 |