Open-ended Question Answering on MMAU-Pro Open-ended
67.4Open-ended Success RateOScaR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| OScaRBackbone=Qwen3-Omni-30B-A3B, Quantization Method=INT2, Group Size=128, Bit-width=INT22026.05 | 67.4 | 29.8 | |
| TurboQuant+Backbone=Qwen3-Omni-30B-A3B, Bit-width=2.5-bit2026.05 | 66.6 | 27 | |
| 16bit baselineBackbone=Qwen3-Omni-30B-A3B, Bit-width=16-bit2026.05 | 66.2 | 27.8 | |
| KIVIBackbone=Qwen3-Omni-30B-A3B, Quantization Method=INT2, Group Size=128, Bit-width=INT22026.05 | 65.8 | 27 | |
| OTTBackbone=Qwen3-Omni-30B-A3B, Quantization Method=INT2, Group Size=128, Bit-width=INT22026.05 | 65.8 | 26.9 |