LLM Training
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
LLM Training 8k sequence length Llama3-8B (train)
8,188.41Training Throughput (samples/sec)
3
LLM Training 4k sequence length Llama3-8B (train)
4,626.94Training Throughput (samples/sec)
3
LLM Training 2k sequence length Llama3-8B (train)
2,862.22Training Throughput (samples/sec)
3