Component-level attribution on IOI
0Dissimilarity (dis.)Norm-only
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Norm-onlyBase Model=Qwen3-4B-Instruct-25072026.03 | 0 | 28.68 | 28.68 | |
| GradientBase Model=Qwen3-4B-Instruct-25072026.03 | 0 | 29.54 | 29.54 | |
| AtPBase Model=Qwen3-4B-Instruct-25072026.03 | 0 | 32.25 | 32.25 | |
| Dual Path Attribution (DPA)Base Model=Qwen3-4B-Instruct-25072026.03 | 0 | 54.91 | 54.91 | |
| AtPModel=Llama-2-7B-Chat2026.03 | 0 | 76.3 | 76.3 | |
| Dual Path Attribution (DPA)Model=Llama-2-7B-Chat2026.03 | 0 | 127.16 | 127.16 | |
| AtPModel Backbone=Mistral-7B-Instruct-v0.32026.03 | 0 | 104.5 | 104.5 | |
| Dual Path Attribution (DPA)Model Backbone=Mistral-7B-Instruct-v0.32026.03 | 0 | 172.15 | 172.15 | |
| GradientModel=Llama-3.1-8B-Instruct2026.03 | 0 | 30.95 | 30.95 | |
| AtPModel=Llama-3.1-8B-Instruct2026.03 | 0 | 84.39 | 84.39 | |
| Dual Path Attribution (DPA)Model=Llama-3.1-8B-Instruct2026.03 | 0 | 86.87 | 86.87 | |
| MLP-onlyBase Model=Qwen3-4B-Instruct-25072026.03 | 0.01 | 27.56 | 27.55 | |
| GradientModel=Llama-2-7B-Chat2026.03 | 0.01 | 30.69 | 30.68 | |
| Norm-onlyModel=Llama-3.1-8B-Instruct2026.03 | 0.01 | 65.02 | 65.01 | |
| IFRBase Model=Qwen3-4B-Instruct-25072026.03 | 0.02 | 28.59 | 28.57 | |
| GradientModel Backbone=Mistral-7B-Instruct-v0.32026.03 | 0.02 | 56 | 55.98 | |
| IFRModel=Llama-3.1-8B-Instruct2026.03 | 0.02 | 29.15 | 29.13 | |
| Norm-onlyModel=Llama-2-7B-Chat2026.03 | 0.05 | 66.98 | 66.93 | |
| Norm-onlyModel Backbone=Mistral-7B-Instruct-v0.32026.03 | 0.1 | 54.59 | 54.49 | |
| IFRModel Backbone=Mistral-7B-Instruct-v0.32026.03 | 0.13 | 29.81 | 29.68 | |
| Attn-onlyModel=Llama-3.1-8B-Instruct2026.03 | 0.15 | 93.07 | 92.92 | |
| Attn-onlyModel Backbone=Mistral-7B-Instruct-v0.32026.03 | 0.3 | 94.67 | 94.37 | |
| IFRModel=Llama-2-7B-Chat2026.03 | 0.48 | 28.86 | 28.38 | |
| Attn-onlyModel=Llama-2-7B-Chat2026.03 | 0.53 | 91.39 | 90.86 | |
| Attn-onlyBase Model=Qwen3-4B-Instruct-25072026.03 | 0.66 | 83.11 | 82.45 | |
| MLP-onlyModel=Llama-3.1-8B-Instruct2026.03 | 0.87 | 27.53 | 26.66 | |
| MLP-onlyModel Backbone=Mistral-7B-Instruct-v0.32026.03 | 2.82 | 27.66 | 24.84 | |
| MLP-onlyModel=Llama-2-7B-Chat2026.03 | 5.59 | 27.58 | 21.99 | |
| RandomModel=Llama-3.1-8B-Instruct2026.03 | 21.85 | 27.54 | 5.69 | |
| RandomBase Model=Qwen3-4B-Instruct-25072026.03 | 22.63 | 27.55 | 4.92 | |
| RandomModel=Llama-2-7B-Chat2026.03 | 24.07 | 27.67 | 3.6 | |
| RandomModel Backbone=Mistral-7B-Instruct-v0.32026.03 | 25.27 | 27.6 | 2.33 |