Qwen Circuit Recovery Suite 0.5B -> 1.5B 2.5
40Arithmetic (-) ScoreDFA (In-Distribution)
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DFA (In-Distribution)Method Category=NAP, Transfer Setting=DFA (In-Distribution)2026.04 | 40 | 28 | 0.28 | — | 35 | 32 | 33 | |
| DFA (In-Distribution)Method Category=NAP-IG-Activations, Transfer Setting=DFA (In-Distribution)2026.04 | 40 | 29 | 0.34 | — | 32 | 31 | 33 | |
| DFA (Far/Zero-Shot)Method Category=NAP-IG-Activations, Transfer Setting=DFA (Far/Zero-Shot)2026.04 | 40 | 25 | 0.28 | — | 42 | 44 | 36 | |
| DFA (Far/Zero-Shot)Method Category=NAP-IG-Inputs, Transfer Setting=DFA (Far/Zero-Shot)2026.04 | 39 | 26 | 0.25 | — | 27 | 26 | 29 | |
| DFA (In-Distribution)Method Category=NAP-IG-Inputs, Transfer Setting=DFA (In-Distribution)2026.04 | 27 | 30 | 0.3 | — | 29 | 29 | 29 | |
| DFA (Near-Distribution)Method Category=NAP-IG-Inputs, Transfer Setting=DFA (Near-Distribution)2026.04 | 27 | — | — | — | 29 | 28 | 28 | |
| Random AlignmentMethod Category=Baseline, Transfer Setting=Random Alignment2026.04 | 25 | 25 | 0.25 | — | 25 | 25 | 25 | |
| Gold (Upper Bound)Method Category=NAP-IG-Inputs, Transfer Setting=Gold (Upper Bound)2026.04 | 25 | 91 | 1.07 | — | 91 | 95 | 82 | |
| DFA (Near-Distribution)Method Category=NAP, Transfer Setting=DFA (Near-Distribution)2026.04 | 25 | — | — | — | 30 | 35 | 30 | |
| DFA (Far/Zero-Shot)Method Category=NAP, Transfer Setting=DFA (Far/Zero-Shot)2026.04 | 25 | 25 | 0.27 | — | 38 | 36 | 31 | |
| DFA (Near-Distribution)Method Category=NAP-IG-Activations, Transfer Setting=DFA (Near-Distribution)2026.04 | 25 | — | — | — | 30 | 32 | 29 | |
| Gold (Upper Bound)Method Category=NAP, Transfer Setting=Gold (Upper Bound)2026.04 | 24 | 25 | 0.56 | — | 70 | 67 | 49 | |
| Gold (Upper Bound)Method Category=NAP-IG-Activations, Transfer Setting=Gold (Upper Bound)2026.04 | 24 | 25 | 0.6 | — | 76 | 72 | 51 |