Circuit Recovery Evaluation Suite (IOI, MCQA, Arithmetic, ARC) Llama-3 (3B to 8B) Transfer (test)
46Arithmetic (+) ScoreNAP-IG-Inputs
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| NAP-IG-InputsMethod Category=NAP-IG-Inputs, Transfer Setting=Gold (Upper Bound), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 46 | 63 | 1.02 | 37 | 97 | 94 | 73 | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=DFA (In-Distribution), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 46 | 50 | 0.54 | 53 | 53 | 56 | 52 | |
| NAP-IG-InputsMethod Category=NAP-IG-Inputs, Transfer Setting=DFA (In-Distribution), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 45 | 49 | 0.26 | 45 | 30 | 34 | 38 | |
| NAPMethod Category=NAP, Transfer Setting=DFA (In-Distribution), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 40 | 23 | 0.27 | 40 | 29 | 28 | 31 | |
| NAPMethod Category=NAP, Transfer Setting=DFA (Near-Distribution), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 36 | — | — | 37 | 28 | 29 | 32 | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=Gold (Upper Bound), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 33 | 35 | 0.6 | 31 | 59 | 63 | 47 | |
| NAP-IG-InputsMethod Category=NAP-IG-Inputs, Transfer Setting=DFA (Near-Distribution), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 29 | — | — | 67 | 34 | 34 | 41 | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=DFA (Far/Zero-Shot), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 28 | 44 | 0.5 | 59 | 36 | 43 | 43 | |
| NAP-IG-InputsMethod Category=NAP-IG-Inputs, Transfer Setting=DFA (Far/Zero-Shot), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 27 | 57 | 0.46 | 46 | 27 | 25 | 38 | |
| NAPMethod Category=NAP, Transfer Setting=DFA (Far/Zero-Shot), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 27 | 36 | 0.32 | 26 | 29 | 27 | 30 | |
| NAP-IG-ActivationsMethod Category=NAP-IG-Activations, Transfer Setting=DFA (Near-Distribution), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 27 | — | — | 59 | 56 | 56 | 49 | |
| BaselineMethod Category=Baseline, Transfer Setting=Random Alignment, Transfer Direction=Llama-3 (3B → 8B)2026.04 | 25 | 25 | 0.25 | 25 | 25 | 25 | 25 | |
| NAPMethod Category=NAP, Transfer Setting=Gold (Upper Bound), Transfer Direction=Llama-3 (3B → 8B)2026.04 | 25 | 31 | 0.38 | 29 | 57 | 59 | 40 |