MMAU-Pro Audio Instruction Following
88.5AIF ScoreOScaR
Evaluation results
| Method | Links | |
|---|---|---|
| OScaRBackbone=Qwen3-Omni-30B-A3B, Quantization Method=INT2, Group Size=128, Bit-width=INT22026.05 | 88.5 | |
| 16bit baselineBackbone=Qwen3-Omni-30B-A3B, Bit-width=16-bit2026.05 | 87.4 | |
| OTTBackbone=Qwen3-Omni-30B-A3B, Quantization Method=INT2, Group Size=128, Bit-width=INT22026.05 | 83.9 | |
| TurboQuant+Backbone=Qwen3-Omni-30B-A3B, Bit-width=2.5-bit2026.05 | 79.3 | |
| KIVIBackbone=Qwen3-Omni-30B-A3B, Quantization Method=INT2, Group Size=128, Bit-width=INT22026.05 | 78.2 |