Mathematical Reasoning on GSM8K (test) (Accuracy, Best Baseline, Correct Count)
92AccuracyDiffMean
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DiffMeanIntervention Level=Node-level, Intervention Target=Critic2026.05 | 92 | — | — | |
| DiffMeanIntervention Level=Node-level, Intervention Target=Refiner2026.05 | 91.2 | — | — | |
| DiffMeanIntervention Level=Node-level, Intervention Target=Planner2026.05 | 90.3 | — | — | |
| DiffMeanIntervention Level=Edge-level, Intervention Target=C→R2026.05 | 88.5 | — | — | |
| PCAIntervention Level=Node-level, Intervention Target=Refiner2026.05 | 87.3 | — | — | |
| CleanIntervention Level=Baseline2026.05 | 87 | — | — | |
| PCAIntervention Level=Node-level, Intervention Target=Critic2026.05 | 86.7 | — | — | |
| SMMDModel=SmolLM3, Params=3B2026.06 | 70.74 | — | — | |
| NTILModel=SmolLM3, Params=3B2026.06 | 70.13 | — | — | |
| PCAIntervention Level=Node-level, Intervention Target=Planner2026.05 | 69.3 | — | — | |
| CEModel=SmolLM3, Params=3B2026.06 | 67.78 | — | — | |
| Dynamic Persona RoutingTotal=1319, Sampled=1312026.04 | 67.17 | — | 88 | |
| GCEModel=SmolLM3, Params=3B2026.06 | 66.56 | — | — | |
| NTLModel=SmolLM3, Params=3B2026.06 | 64.13 | — | — | |
| DiffMeanIntervention Level=Edge-level, Intervention Target=P→C2026.05 | 61.1 | — | — | |
| GCEModel=Llama3, Params=8B2026.06 | 58.15 | — | — | |
| SMMDModel=Qwen2.5, Params=1.5B2026.06 | 57.77 | — | — | |
| SMMDModel=Llama3, Params=8B2026.06 | 57.7 | — | — | |
| NTILModel=Llama3, Params=8B2026.06 | 56.63 | — | — | |
| NTLModel=Qwen2.5, Params=1.5B2026.06 | 56.17 | — | — | |
| CEModel=Llama3, Params=8B2026.06 | 55.72 | — | — | |
| NTILModel=Qwen2.5, Params=1.5B2026.06 | 55.19 | — | — | |
| CEModel=Qwen2.5, Params=1.5B2026.06 | 54.99 | — | — | |
| GCEModel=Qwen2.5, Params=1.5B2026.06 | 52.69 | — | — | |
| PCAIntervention Level=Edge-level, Intervention Target=R→J2026.05 | 49.6 | — | — | |
| PCAIntervention Level=Edge-level, Intervention Target=C→R2026.05 | 48.7 | — | — | |
| NTLModel=Llama3, Params=8B2026.06 | 48.12 | — | — | |
| PCAIntervention Level=Edge-level, Intervention Target=P→C2026.05 | 43.4 | — | — | |
| DiffMeanIntervention Level=Edge-level, Intervention Target=R→J2026.05 | 37.2 | — | — | |
| Direct attackIntervention Level=Text-level, Intervention Target=Critic2026.05 | 35 | — | — | |
| SMMDModel=Qwen2.5, Params=0.5B2026.06 | 31.31 | — | — | |
| NTILModel=Qwen2.5, Params=0.5B2026.06 | 30.78 | — | — | |
| NTLModel=Qwen2.5, Params=0.5B2026.06 | 30.25 | — | — | |
| CEModel=Qwen2.5, Params=0.5B2026.06 | 29.34 | — | — | |
| RePSIntervention Level=Node-level, Intervention Target=Planner2026.05 | 29.2 | — | — | |
| GCEModel=Qwen2.5, Params=0.5B2026.06 | 28.2 | — | — | |
| Direct attackIntervention Level=Text-level, Intervention Target=Refiner2026.05 | 26.7 | — | — | |
| RePSIntervention Level=Node-level, Intervention Target=Critic2026.05 | 25.7 | — | — | |
| Direct attackIntervention Level=Text-level, Intervention Target=Planner2026.05 | 21.3 | — | — | |
| RePSIntervention Level=Node-level, Intervention Target=Refiner2026.05 | 19.5 | — | — | |
| RePSIntervention Level=Edge-level, Intervention Target=R→J2026.05 | 19.5 | — | — | |
| RePSIntervention Level=Edge-level, Intervention Target=P→C2026.05 | 13.3 | — | — | |
| RePSIntervention Level=Edge-level, Intervention Target=C→R2026.05 | 2.7 | — | — | |
| Best Static BaselineTotal=1319, Sampled=1312026.04 | — | 72.18 | — |