Question Answering on SQuAD (F1 Score)
59.4F1 ScoreQZO
Evaluation results
| Method | Links | |
|---|---|---|
| QZOModel=Llama-2-13B, Precision=2 bits, Memory Profiling=5.78GB, Evaluation Protocol=Zeroth-order optimization2025.05 | 59.4 | |
| Zero-Shot-QModel=Llama-2-13B, Precision=2 bits, Memory Profiling=N/A, Evaluation Protocol=Zero-shot2025.05 | 55.4 |