Customer Service on TauBench
91.8AccuracyLLM-guided spec search
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LLM-guided spec searchStudent Model=Qwen3.5-9B, Optimization Status=Optimized, Teacher Selection=Best teacher per benchmark2026.05 | 91.8 | 14.7 | |
| Qwen3.5-9BStudent Model=Qwen3.5-9B, Optimization Status=Base2026.05 | 77.1 | — | |
| LLM-guided spec searchStudent Model=Gemma4-E4B, Optimization Status=Optimized, Teacher Selection=Best teacher per benchmark2026.05 | 72.4 | 16.3 | |
| LLM-guided spec searchStudent Model=Qwen3.5-4B, Optimization Status=Optimized, Teacher Selection=Best teacher per benchmark2026.05 | 56.7 | 12.3 | |
| Gemma4-E4BStudent Model=Gemma4-E4B, Optimization Status=Base2026.05 | 56.1 | — | |
| Qwen3.5-4BStudent Model=Qwen3.5-4B, Optimization Status=Base2026.05 | 44.4 | — | |
| LLM-guided spec searchStudent Model=Nemotron-Nano-4B, Optimization Status=Optimized, Teacher Selection=Best teacher per benchmark2026.05 | 25.6 | 14.5 | |
| Nemotron-Nano-4BStudent Model=Nemotron-Nano-4B, Optimization Status=Base2026.05 | 11.1 | — |