List your company

Synthetic Throughput Benchmark

Benchmarks

TaskDatasetSOTA resultTrendResults
Synthetic Throughput Benchmark 125M, T=1024, mb=8 single H100
159.8Throughput (tokens/s)
8