Standard QA on MusiQue
18.75EMPrompt-R1
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Prompt-R1Backbone=GPT-4o-mini2025.11 | 18.75 | 26.31 | |
| CoT ReasoningBackbone=GPT-4o-mini2025.11 | 17.97 | 25.39 | |
| GEPAOptimization Framework=APO, Backbone=GPT-4o-mini2025.11 | 15.63 | 24.91 | |
| TextGradOptimization Framework=APO, Backbone=GPT-4o-mini2025.11 | 14.84 | 24.06 | |
| BaselineBackbone=GPT-4o-mini2025.11 | 14.06 | 22.06 | |
| OPROOptimization Framework=APO, Backbone=GPT-4o-mini2025.11 | 14.06 | 26.18 | |
| GRPOBackbone=Qwen3-4B2025.11 | 8.59 | 13.9 | |
| SFTBackbone=Qwen3-4B2025.11 | 7.81 | 16.78 | |
| CoT ReasoningBackbone=Qwen3-4B2025.11 | 3.13 | 6.95 | |
| BaselineBackbone=Qwen3-4B2025.11 | 1.56 | 5.44 |