Reading Comprehension on SQuAD v2.0
50.64Disambiguation ScoreRandom
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RandomModel=Llama-3.1-8B-Instruct2026.03 | 50.64 | 52.39 | 1.75 | |
| IFRModel=Llama-3.1-8B-Instruct2026.03 | 50.16 | 62.51 | 12.35 | |
| GradientModel=Llama-3.1-8B-Instruct2026.03 | 49.95 | 46.68 | -3.27 | |
| RolloutModel=Llama-3.1-8B-Instruct2026.03 | 40.58 | 69.43 | 28.85 | |
| Input X GradientModel=Llama-3.1-8B-Instruct2026.03 | 34.07 | 63.22 | 29.15 | |
| Last layerModel=Llama-3.1-8B-Instruct2026.03 | 21.96 | 82.04 | 60.08 | |
| DePassModel=Llama-3.1-8B-Instruct2026.03 | 19.29 | 78.45 | 59.16 | |
| Integrated GradientsModel=Llama-3.1-8B-Instruct2026.03 | 17.92 | 79.53 | 61.61 | |
| Dual Path Attribution (DPA)Model=Llama-3.1-8B-Instruct2026.03 | 17.73 | 92.51 | 74.78 | |
| MeanModel=Llama-3.1-8B-Instruct2026.03 | 17.06 | 89.46 | 72.4 |