Audio-dependent question answering on ADQA (dev)
65.65Strict AccuracySimPO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SimPOmode=continuation, steps=5002026.06 | 65.65 | 66.96 | |
| Strong+10% cat-balanced mix2026.06 | 65.21 | — | |
| Empty5 repeatseed=seed3 best2026.06 | 65.21 | — | |
| SFT-init DAPO-litesteps=1002026.06 | 65.21 | 66.4 | |
| DPOmode=continuation, steps=5002026.06 | 65.15 | 66.46 | |
| SFT-init GRPOsteps=1002026.06 | 65.09 | 66.21 | |
| Empty-aware GRPOsteps=1002026.06 | 65.09 | 66.46 | |
| Empty-aware DAPO-litesteps=1002026.06 | 64.72 | 65.9 | |
| Empty5 repeatseed=seed2 best2026.06 | 64.16 | — | |
| Category-balanced2026.06 | 64.09 | — | |
| Answer-only Qwen SFTsteps=9k2026.06 | 62.85 | — | |
| Silent CoT SFTsteps=3k2026.06 | 61.05 | — | |
| Explicit CoT SFTsteps=3k2026.06 | 58.49 | — | |
| AudioFlamingo3mode=rerun2026.06 | 54.32 | — | |
| FunAudioChatvariant=base2026.06 | 54.26 | — |