LLM Inference Verification on Llama-2 7B
0.17Verification Latency (s)Protocol 2 (SIGMA)
Evaluation results
| Method | Links | |
|---|---|---|
| Protocol 2 (SIGMA)Response Length=12026.02 | 0.17 | |
| Protocol 2 (SIGMA)Response Length=22026.02 | 0.35 | |
| Protocol 2 (SIGMA)Response Length=52026.02 | 0.91 | |
| zkLLMResponse Length=12026.02 | 1.24 | |
| Protocol 2 (SIGMA)Response Length=102026.02 | 1.87 | |
| zkLLMResponse Length=22026.02 | 2.51 | |
| Protocol 2 (SIGMA)Response Length=502026.02 | 3.73 | |
| zkLLMResponse Length=52026.02 | 6.32 | |
| zkLLMResponse Length=102026.02 | 11.8 | |
| Protocol 2 (SIGMA)Response Length=1002026.02 | 18.27 | |
| zkLLMResponse Length=502026.02 | 59.24 | |
| zkLLMResponse Length=1002026.02 | 117.3 |