LLM Training Throughput on Llama3-8B (2k SeqLen, train)
2,862.22Training Throughput (samples/sec)Megatron-LM
Evaluation results
| Method | Links | |
|---|---|---|
| Megatron-LM2026.05 | 2,862.22 | |
| ZeRO-12026.05 | 2,498.13 | |
| AGoQ2026.05 | 2,148.82 |
| Method | Links | |
|---|---|---|
| Megatron-LM2026.05 | 2,862.22 | |
| ZeRO-12026.05 | 2,498.13 | |
| AGoQ2026.05 | 2,148.82 |