Hardware Efficiency Benchmark
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Hardware Efficiency Benchmark
150.9FPS
21
Hardware Efficiency Benchmark (test)
6.5Latency (GPU) (ms)
5
Hardware Efficiency Benchmark Single H100 125M scale T=1024, mb=8
93.8H100 Throughput (tokens/s)
3