Multi-turn Code-Switched Question Answering on PingPong answerable QA (id-en) (test)
59.6AccuracyQwen3.5-27B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3.5-27BSetting=BASE2026.06 | 59.6 | |
| Qwen3.5-27BSetting=CANVAS2026.06 | 58.38 | |
| Llama-3.1-8BSetting=CANVAS2026.06 | 43.64 | |
| Llama-3.1-8BSetting=BASE2026.06 | 37.37 | |
| Aya-Expanse-8BSetting=CANVAS2026.06 | 30.91 | |
| Mistral-7BSetting=BASE2026.06 | 29.09 | |
| Qwen3.5-27BSetting=CANVAS2026.06 | 28.28 | |
| Mistral-7BSetting=CANVAS2026.06 | 28.28 | |
| Aya-Expanse-8BSetting=BASE2026.06 | 28.28 | |
| Mistral-7BSetting=CANVAS2026.06 | 26.67 | |
| Mistral-7BSetting=BASE2026.06 | 25.45 | |
| Qwen3.5-27BSetting=BASE2026.06 | 25.25 | |
| Llama-3.1-8BSetting=CANVAS2026.06 | 23.64 | |
| Llama-3.1-8BSetting=BASE2026.06 | 20.81 | |
| Aya-Expanse-8BSetting=CANVAS2026.06 | 18.59 | |
| Aya-Expanse-8BSetting=BASE2026.06 | 16.16 |