Attribution Quality Evaluation on TyDi QA
0.107Log-Prob DropRandom
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RandomTop-k=k = 1, Backbone=Qwen2.5-7B2025.06 | 0.107 | 69.4 | |
| RandomTop-k=k = 3, Backbone=Qwen2.5-7B2025.06 | 0.269 | 60.5 | |
| RandomTop-k=k = 5, Backbone=Qwen2.5-7B2025.06 | 0.436 | 54.1 | |
| ContextCiteTop-k=k = 1, Backbone=Qwen2.5-7B2025.06 | 0.496 | 50.9 | |
| ContextCiteTop-k=k = 3, Backbone=Qwen2.5-7B2025.06 | 0.719 | 44.3 | |
| CAMABTop-k=k = 1, Backbone=Qwen2.5-7B2025.06 | 0.732 | 43 | |
| SHAPTop-k=k = 1, Backbone=Qwen2.5-7B2025.06 | 0.738 | 44.8 | |
| ContextCiteTop-k=k = 5, Backbone=Qwen2.5-7B2025.06 | 0.792 | 42.3 | |
| SHAPTop-k=k = 3, Backbone=Qwen2.5-7B2025.06 | 0.992 | 36.2 | |
| CAMABTop-k=k = 3, Backbone=Qwen2.5-7B2025.06 | 0.994 | 34.8 | |
| SHAPTop-k=k = 5, Backbone=Qwen2.5-7B2025.06 | 1.072 | 34.7 | |
| CAMABTop-k=k = 5, Backbone=Qwen2.5-7B2025.06 | 1.081 | 32.5 |