List your company

ResearchFormerly WizWand

LLM Prompt Length

Benchmarks

TaskDatasetSOTA resultTrendResults

LLM Prefill throughput

LLM Prompt Length 2048 (pp2048)

4,447Prefill Throughput (tok/s)

36

LLM Prefill throughput

LLM Prompt Length 1024

4,748Prefill Throughput (tok/s)

36