Question Answering on BoolQ (Accuracy and Delta)
91.7AccuracyOurs (1-vec)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Ours (1-vec)Model=Llama-3.1-8B, Params (%)=0.001%2026.02 | 91.7 | 0.1 | |
| Ours r=1Model=Llama-3.1-8B, Params (%)=0.003%2026.02 | 91.3 | -0.6 | |
| JoLAModel=Llama-3.1-8B, Params (%)=0.003%2026.02 | 90.5 | -1.1 | |
| Ours (1-vec)Model=Qwen 3 4B, Params (%)=0.003%2026.02 | 90.4 | -1 | |
| LoFITModel=Qwen 3 4B, Params (%)=0.003%2026.02 | 90.2 | -1.2 | |
| Ours r=1Model=Qwen 3 4B, Params (%)=0.005%2026.02 | 90 | -1.4 | |
| LoFITModel=Llama-3.1-8B, Params (%)=0.001%2026.02 | 89.9 | -1.7 | |
| JoLAModel=Qwen 3 4B, Params (%)=0.007%2026.02 | 89.6 | -1.8 | |
| Ours r=1Model=Llama-3.2-1B, Params (%)=0.005%2026.02 | 86.2 | -2 | |
| Ours (1-vec)Model=Llama-3.2-1B, Params (%)=0.003%2026.02 | 86.1 | -2.1 | |
| JoLAModel=Llama-3.2-1B, Params (%)=0.007%2026.02 | 83.6 | -4.6 | |
| Ours r=1Model=gemma-3-1b, Params (%)=0.005%2026.02 | 83.1 | -0.2 | |
| LoFITModel=Llama-3.2-1B, Params (%)=0.003%2026.02 | 83 | -5.2 | |
| LoFITModel=gemma-3-1b, Params (%)=0.003%2026.02 | 75.8 | -7.5 | |
| JoLAModel=gemma-3-1b, Params (%)=0.007%2026.02 | 75.1 | -8.2 | |
| Ours (1-vec)Model=gemma-3-1b, Params (%)=0.003%2026.02 | 74.2 | -9.1 |