Symbolic and Logical Reasoning on CodaSet BBH ID (test)
94.29AccuracyQwen3-235B-A22B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen3-235B-A22B2026.05 | 94.29 | 5.4 | |
| DecoRfallback_model=DeepSeek-V3.12026.05 | 93.89 | 1.9 | |
| DecoRfallback_model=gpt-oss-120b2026.05 | 93.89 | 1.9 | |
| gpt-oss-120b2026.05 | 92.85 | 2.7 | |
| EmbedLLM2026.05 | 92.79 | 4.7 | |
| DeepSeek-V3.12026.05 | 92.27 | 5.8 | |
| KNN Router2026.05 | 92.16 | 1.6 | |
| MODEL-SAT2026.05 | 92.16 | 5.8 | |
| RouterDC2026.05 | 91.58 | 4.4 | |
| DeepSeek-V3.2-Exp2026.05 | 91.46 | 4.2 | |
| Kimi-K2-Instruct2026.05 | 90.54 | 13.7 | |
| Random Router2026.05 | 88.06 | 4.7 | |
| gemma-3-27b-it2026.05 | 86.1 | 1.5 | |
| Mistral-Small-3.2-24B2026.05 | 85.64 | 1.7 | |
| gemma-3-12b-it2026.05 | 85.35 | 1 | |
| LLM Router2026.05 | 84.9 | 1.1 |