Synthetic Generation Workload
Benchmarks
TaskDatasetSOTA resultTrendResults
Synthetic Generation Workload 512 prompt + 1024 generation tokens
52.1Throughput (tokens/s)
8
Synthetic Generation Workload 512 prompt + 512 generation tokens
51.7Throughput (tokens/s)
8
Synthetic Generation Workload 512 prompt + 32 generation tokens
35.1Throughput (tokens/s)
8