LLM Generation Latency on Llama-2-7B
22.1Latency (LAN)Protocol 2 (SIGMA)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Protocol 2 (SIGMA)Response Length=12026.02 | 22.1 | 22.2 | |
| Protocol 2 (SIGMA)Response Length=22026.02 | 44.4 | 44.4 | |
| Protocol 2 (SIGMA)Response Length=52026.02 | 118.3 | 118.9 | |
| Protocol 2 (SIGMA)Response Length=102026.02 | 227.7 | 236.6 | |
| zkLLMResponse Length=12026.02 | 369.7 | — | |
| zkLLMResponse Length=22026.02 | 726.5 | — | |
| Protocol 2 (SIGMA)Response Length=502026.02 | 1,189 | 1,194 | |
| zkLLMResponse Length=52026.02 | 1,798.1 | — | |
| Protocol 2 (SIGMA)Response Length=1002026.02 | 2,260 | 2,301 | |
| zkLLMResponse Length=102026.02 | 3,889.3 | — | |
| zkLLMResponse Length=502026.02 | 19,550.8 | — | |
| zkLLMResponse Length=1002026.02 | 35,860.1 | — |