Question Answering on MusiQue 39 (test)
33.33F1OrchMAS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OrchMASCategory=Ours2026.03 | 33.33 | 21.88 | |
| GPT-4o-miniCategory=CoT Reasoning2026.03 | 26.33 | 17.71 | |
| OPROCategory=MAS, Base Model=GPT-4o-mini2026.03 | 25.11 | 14.58 | |
| GPT-4o-miniCategory=Baseline2026.03 | 23.59 | 14.58 | |
| GEPACategory=MAS, Base Model=GPT-4o-mini2026.03 | 23.21 | 15.63 | |
| TextGradCategory=MAS, Base Model=GPT-4o-mini2026.03 | 22.06 | 15.63 | |
| Qwen3-4BCategory=SFT2026.03 | 18.61 | 8.33 | |
| Qwen3-4BCategory=GRPO2026.03 | 12.98 | 9.38 | |
| Qwen3-4BCategory=CoT Reasoning2026.03 | 8.72 | 4.17 | |
| Qwen3-4BCategory=Baseline2026.03 | 6.71 | 3.13 |