Reasoning on BIG Bench Audio (Speech Modality)
0.9341AccuracyX-OPD
Evaluation results
| Method | Links | |
|---|---|---|
| X-OPDModel Series=Omni-A3B-Instruct, Training Paradigm=X-OPD2026.03 | 0.9341 | |
| GPT-4o-AudioModel Series=GPT-4o-Audio2026.03 | 0.885 | |
| Omni-A3B-Instruct + SFTModel Series=Omni-A3B-Instruct, Training Paradigm=SFT2026.03 | 0.8752 | |
| Omni-A3B-Instruct + Offline KDModel Series=Omni-A3B-Instruct, Training Paradigm=Offline KD2026.03 | 0.8708 | |
| Omni-A3B-InstructModel Series=Omni-A3B-Instruct, Training Paradigm=Base2026.03 | 0.8567 | |
| Omni-A3B-Instruct + GKD (Forward KL)Model Series=Omni-A3B-Instruct, Training Paradigm=GKD (Forward KL)2026.03 | 0.8426 | |
| Gemini-2.5-FlashModel Series=Gemini-2.5-Flash2026.03 | 0.8142 | |
| Gemini-3-Flash-PreviewModel Series=Gemini-3-Flash-Preview2026.03 | 0.8077 | |
| Omni-7B-InstructModel Series=Omni-7B-Instruct2026.03 | 0.6222 | |
| Voxtral-Mini-3BModel Series=Voxtral-Mini-3B2026.03 | 0.4773 |