Refusal on MuSiQue Un
91R-AccQwen3-14B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-14Bthinking mode=true2026.05 | 91 | |
| Qwen3-8Bthinking mode=false2026.05 | 90.7 | |
| Qwen3-8Bthinking mode=true2026.05 | 90.3 | |
| OCC-RAG-1.7Bthinking mode=false2026.05 | 87.2 | |
| Qwen3-32Bthinking mode=true2026.05 | 87 | |
| OCC-RAG-0.6Bthinking mode=false2026.05 | 86.9 | |
| Qwen3-4Bthinking mode=true2026.05 | 84 | |
| Qwen3-1.7Bthinking mode=true2026.05 | 82.8 | |
| Qwen3-32Bthinking mode=false2026.05 | 80.7 | |
| SmolLM3-3Bthinking mode=true2026.05 | 77.1 | |
| gemma-3-27b-itthinking mode=false2026.05 | 71.1 | |
| Qwen3-0.6Bthinking mode=true2026.05 | 70 | |
| Qwen3-14Bthinking mode=false2026.05 | 67.6 | |
| gemma-3-12b-itthinking mode=false2026.05 | 65.3 | |
| Qwen3-4Bthinking mode=false2026.05 | 64.1 | |
| gemma-3-4b-itthinking mode=false2026.05 | 55.8 | |
| Qwen3-1.7Bthinking mode=false2026.05 | 54.7 | |
| SmolLM3-3Bthinking mode=false2026.05 | 32.1 | |
| Pleias-RAG-1.2Bthinking mode=false2026.05 | 21.9 | |
| Qwen3-0.6Bthinking mode=false2026.05 | 6.3 | |
| gemma-3-1b-itthinking mode=false2026.05 | 2.2 |