List your company

WebLLM

Benchmarks

TaskDatasetSOTA resultTrendResults
WebLLM macOS Apple M2 16GB unified memory
46.4Decode Throughput (tok/s)
6
WebLLM Windows 11 RTX PRO 2000 Blackwell 8GB
51.1Decode Throughput (tok/s)
4