Compositional Reasoning on CompA Order sub-task
0.67Text ScoreAQAScore
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| AQAScoreModel=Qwen2.5-Omni-7B2026.01 | 0.67 | 0.52 | 0.4575 | |
| AQAScoreModel=AF32026.01 | 0.51 | 0.425 | 0.3225 | |
| AQAScoreModel=Qwen2.5-Omni-3B2026.01 | 0.5 | 0.35 | 0.2525 | |
| AQAScoreModel=AF3-Think2026.01 | 0.4225 | 0.2775 | 0.17 | |
| CLAPScoreModel=CompA-CLAP2026.01 | 0.407 | 0.356 | 0.3385 | |
| AQAScoreModel=AF3-Chat2026.01 | 0.24 | 0.28 | 0.14 | |
| CLAPScoreModel=630k-best2026.01 | 0.215 | 0.0925 | 0.045 | |
| CLAPScoreModel=630k-AS2026.01 | 0.195 | 0.065 | 0.03 | |
| CLAPScoreModel=Music+Speech2026.01 | 0.175 | 0.0525 | 0.025 | |
| CLAPScoreModel=Music+Speech+AS2026.01 | 0.1525 | 0.045 | 0.0175 | |
| CLAPScoreModel=Music+AS2026.01 | 0.1475 | 0.075 | 0.0225 |