List your company

General Generation Workload

Benchmarks

TaskDatasetSOTA resultTrendResults
General Generation Workload inference latency 1000 tokens
72.51Prefill Latency (ms)
3