Circuit localization on Mechanistic Interpretability Benchmark (MIB)
83IOIIFR
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| IFRModel=Llama 3.12026.01 | 83 | 22 | 48 | 64 | 76 | 59 | |
| RandomModel=Llama 3.12026.01 | 74 | 75 | 74 | 74 | 74 | 74 | |
| NAP (CF)Model=Llama 3.1, Ablation type=Counterfactual2026.01 | 29 | 28 | 32 | 69 | 69 | 45 | |
| NAP-IG (CF)Model=Llama 3.1, Ablation type=Counterfactual2026.01 | 19 | 18 | 33 | 67 | 67 | 41 | |
| EAP (mean)Model=Llama 3.12026.01 | 4 | 7 | 16 | 28 | 20 | 15 | |
| EAP (CF)Model=Llama 3.1, Ablation type=Counterfactual2026.01 | 1 | 1 | 9 | 11 | 18 | 8 | |
| EAP-IG-inp. (CF)Model=Llama 3.1, Ablation type=Counterfactual2026.01 | 1 | 0 | 14 | 11 | 22 | 10 | |
| EAP-IG-act. (CF)Model=Llama 3.1, Ablation type=Counterfactual2026.01 | 1 | 0 | 13 | 30 | 37 | 16 | |
| RelPModel=Llama 3.1, Handling=replacement model with straight-through gradients2026.01 | 1 | 0 | 11 | 15 | 15 | 8 |