Circuit Recovery on Aggregate IOI, MCQA, Arithmetic, ARC
87CPR Faithfulness ScoreNAP-IG-Inputs
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| NAP-IG-InputsMethod Category=NAP-IG-Inputs, Transfer Setting=Gold (Upper Bound)2026.04 | 87 | — | — | — | — | — | — | — | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=Gold (Upper Bound)2026.04 | 68 | — | — | — | — | — | — | — | |
| NAPMethod Category=NAP, Transfer Setting=Gold (Upper Bound)2026.04 | 66 | — | — | — | — | — | — | — | |
| NAP-IG-InputsMethod Category=NAP-IG-Inputs, Transfer Setting=DFA (Far/Zero-Shot)2026.04 | 31 | — | — | — | — | — | — | — | |
| NAPMethod Category=NAP, Transfer Setting=DFA (Far/Zero-Shot)2026.04 | 31 | — | — | — | — | — | — | — | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=DFA (Far/Zero-Shot)2026.04 | 30 | — | — | — | — | — | — | — | |
| NAP-IG-InputsMethod Category=NAP-IG-Inputs, Transfer Setting=DFA (In-Distribution)2026.04 | 29 | — | — | — | — | — | — | — | |
| NAP-IG-InputsMethod Category=NAP-IG-Inputs, Transfer Setting=DFA (Near-Distribution)2026.04 | 29 | — | — | — | — | — | — | — | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=DFA (In-Distribution)2026.04 | 28 | — | — | — | — | — | — | — | |
| NAPMethod Category=NAP, Transfer Setting=DFA (In-Distribution)2026.04 | 27 | — | — | — | — | — | — | — | |
| NAPMethod Category=NAP, Transfer Setting=DFA (Near-Distribution)2026.04 | 27 | — | — | — | — | — | — | — | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=DFA (Near-Distribution)2026.04 | 27 | — | — | — | — | — | — | — | |
| BaselineMethod Category=Baseline, Transfer Setting=Random Alignment2026.04 | 26 | — | — | — | — | — | — | — | |
| NAPMethod Category=NAP, Transfer Setting=Gold (Upper Bound), Source Model=Llama-3 (1B), Target Model=Llama-3 (3B)2026.04 | — | 0.25 | 0.35 | 0.25 | 0.25 | 0.37 | 0.34 | 0.3 | |
| NAPMethod Category=NAP, Transfer Setting=DFA (In-Distribution), Source Model=Llama-3 (1B), Target Model=Llama-3 (3B)2026.04 | — | 0.32 | 0.49 | 0.26 | 0.26 | 0.46 | 0.52 | 0.39 | |
| NAPMethod Category=NAP, Transfer Setting=DFA (Near-Distribution), Source Model=Llama-3 (1B), Target Model=Llama-3 (3B)2026.04 | — | — | — | 0.39 | 0.25 | 0.44 | 0.48 | 0.39 | |
| NAPMethod Category=NAP, Transfer Setting=DFA (Far/Zero-Shot), Source Model=Llama-3 (1B), Target Model=Llama-3 (3B)2026.04 | — | 0.27 | 0.46 | 0.28 | 0.26 | 0.44 | 0.48 | 0.37 | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=Gold (Upper Bound), Source Model=Llama-3 (1B), Target Model=Llama-3 (3B)2026.04 | — | 0.38 | 0.35 | 0.25 | 0.25 | 0.43 | 0.35 | 0.33 | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=DFA (In-Distribution), Source Model=Llama-3 (1B), Target Model=Llama-3 (3B)2026.04 | — | 0.33 | 0.39 | 0.53 | 0.45 | 0.41 | 0.44 | 0.42 | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=DFA (Near-Distribution), Source Model=Llama-3 (1B), Target Model=Llama-3 (3B)2026.04 | — | — | — | 0.72 | 0.28 | 0.41 | 0.37 | 0.44 | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=DFA (Far/Zero-Shot), Source Model=Llama-3 (1B), Target Model=Llama-3 (3B)2026.04 | — | 0.33 | 0.46 | 0.82 | 0.28 | 0.34 | 0.51 | 0.46 | |
| Random AlignmentMethod Category=Baseline, Transfer Setting=Random Alignment, Source Model=Llama-3 (1B), Target Model=Llama-3 (3B)2026.04 | — | 0.25 | 0.25 | 0.25 | 0.25 | 0.25 | 0.25 | 0.25 |