LLM Training Throughput on Llama3-8B (4k SeqLen, train)
4,626.94Training Throughput (samples/sec)Megatron-LM
Evaluation Results
| Method | Links | |
|---|---|---|
| Megatron-LM2026.05 | 4,626.94 | |
| ZeRO-12026.05 | 4,261.65 | |
| AGoQ2026.05 | 3,968.2 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| Megatron-LM2026.05 | 4,626.94 | |
| ZeRO-12026.05 | 4,261.65 | |
| AGoQ2026.05 | 3,968.2 |