Routing and Question Answering on LaRA (in-distribution)
24.5QA ScorePre-Route
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Pre-RouteAnswer Model=Qwen-Max, Answer Mode=no-thinking, Router Variant=D-Q1.7B, Router Mode=thinking2026.05 | 24.5 | 0.69 | — | |
| Always-LCAnswer Model=Qwen3-30B, Answer Mode=no-thinking2026.05 | 3.37 | 100 | 40 | |
| Pre-RouteAnswer Model=Qwen3-30B, Answer Mode=no-thinking, Router Variant=R1, Router Mode=thinking2026.05 | 3.26 | 14.9 | 69 | |
| Self-RouteAnswer Model=Qwen3-30B, Answer Mode=no-thinking2026.05 | 3.2 | 33.9 | 53 | |
| Always-RAGAnswer Model=Qwen3-30B, Answer Mode=no-thinking2026.05 | 3.18 | 0 | 60 | |
| Pre-RouteAnswer Model=Qwen3-1.7B, Answer Mode=no-thinking, Router Variant=Q235B, Router Mode=no-thinking2026.05 | 2.71 | 4.7 | 83 | |
| Pre-RouteAnswer Model=Qwen3-1.7B, Answer Mode=no-thinking, Router Variant=Q235B, Router Mode=thinking2026.05 | 2.71 | 2.3 | 84 | |
| Pre-RouteAnswer Model=Qwen3-1.7B, Answer Mode=no-thinking, Router Variant=D-Q1.7B, Router Mode=thinking2026.05 | 2.71 | 3.2 | 83 | |
| Always-RAGAnswer Model=Qwen3-1.7B, Answer Mode=no-thinking2026.05 | 2.7 | 0 | 82 | |
| Pre-RouteAnswer Model=Qwen3-1.7B, Answer Mode=no-thinking, Router Variant=R1, Router Mode=thinking2026.05 | 2.7 | 2.7 | 83 | |
| Pre-RouteAnswer Model=Qwen3-1.7B, Answer Mode=no-thinking, Router Variant=Q1.7B, Router Mode=no-thinking2026.05 | 2.7 | 7.9 | 79 | |
| Pre-RouteAnswer Model=Qwen3-1.7B, Answer Mode=no-thinking, Router Variant=D-Q1.7B, Router Mode=no-thinking2026.05 | 2.7 | 3.6 | 82 | |
| Pre-RouteAnswer Model=Qwen3-1.7B, Answer Mode=no-thinking, Router Variant=Q1.7B, Router Mode=thinking2026.05 | 2.68 | 10.8 | 77 | |
| Self-RouteAnswer Model=Qwen3-1.7B, Answer Mode=no-thinking2026.05 | 2.22 | 33.6 | 49 | |
| Always-LCAnswer Model=Qwen3-1.7B, Answer Mode=no-thinking2026.05 | 2.13 | 100 | 18 |