Mathematical Reasoning on CNK12 (test)
0Cost ($)SLM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SLMStrategy Type=Baseline2026.01 | 0 | 53.8 | — | — | |
| Oracle ShepherdingStrategy Type=Cascading2026.01 | 0.306 | 84.4 | 45.2 | 1.83 | |
| Reactive ShepherdingStrategy Type=Cascading2026.01 | 0.324 | 76 | 42.1 | 1.25 | |
| FrugalGPTStrategy Type=Cascading2026.01 | 0.391 | 76.1 | 30.1 | 1.04 | |
| Proactive ShepherdingStrategy Type=Routing2026.01 | 0.455 | 77.9 | 18.5 | 0.97 | |
| ABCStrategy Type=Cascading2026.01 | 0.47 | 81.3 | 15.8 | 1.07 | |
| GraphRouterStrategy Type=Routing2026.01 | 0.513 | 81.7 | 8.2 | 0.99 | |
| RouteLLMStrategy Type=Routing2026.01 | 0.533 | 82.6 | 4.65 | 0.99 | |
| LLMStrategy Type=Baseline2026.01 | 0.559 | 84.4 | — | — |