Vision-Audio-Text on Omnibench
47.6AccuracySQ
Evaluation results
| Method | Links | |
|---|---|---|
| SQModel=Qwen2.5-Omni-7B, Bits=W8A82026.03 | 47.6 | |
| MASQuantModel=Qwen2.5-Omni-3B, Bits=W4A162026.03 | 46.9 | |
| MBQModel=Qwen2.5-Omni-3B, Bits=W4A62026.03 | 46.9 | |
| MASQuantModel=Qwen2.5-Omni-7B, Bits=W8A82026.03 | 46.9 | |
| MBQModel=Qwen2.5-Omni-7B, Bits=W8A82026.03 | 46.4 | |
| MBQModel=Qwen2.5-Omni-3B, Bits=W8A82026.03 | 46.1 | |
| MASQuantModel=Qwen2.5-Omni-3B, Bits=W8A82026.03 | 46.1 | |
| DenseModel=Qwen2.5-Omni-7B, Bits=FP162026.03 | 45.3 | |
| AWQModel=Qwen2.5-Omni-7B, Bits=W4A162026.03 | 45.3 | |
| MASQuantModel=Qwen2.5-Omni-7B, Bits=W4A162026.03 | 45.3 | |
| SQModel=Qwen2.5-Omni-3B, Bits=W8A82026.03 | 44.5 | |
| MBQModel=Qwen2.5-Omni-7B, Bits=W4A162026.03 | 44.4 | |
| DenseModel=Qwen2.5-Omni-3B, Bits=FP162026.03 | 43.8 | |
| AWQModel=Qwen2.5-Omni-3B, Bits=W4A162026.03 | 43.8 | |
| RTNModel=Qwen2.5-Omni-7B, Bits=W4A162026.03 | 43.8 | |
| MASQuantModel=Qwen2.5-Omni-7B, Bits=W4A82026.03 | 43.8 | |
| MBQModel=Qwen2.5-Omni-3B, Bits=W4A162026.03 | 42.6 | |
| MASQuantModel=Qwen2.5-Omni-3B, Bits=W4A62026.03 | 42.2 | |
| MASQuantModel=Qwen2.5-Omni-7B, Bits=W4A62026.03 | 42.2 | |
| MBQModel=Qwen2.5-Omni-7B, Bits=W4A62026.03 | 42.1 | |
| MASQuantModel=Qwen2.5-Omni-3B, Bits=W4A82026.03 | 41.4 | |
| MBQModel=Qwen2.5-Omni-7B, Bits=W4A82026.03 | 40.6 | |
| RTNModel=Qwen2.5-Omni-7B, Bits=W4A62026.03 | 40.6 | |
| RTNModel=Qwen2.5-Omni-3B, Bits=W4A162026.03 | 39.6 | |
| RTNModel=Qwen2.5-Omni-7B, Bits=W8A82026.03 | 38.4 | |
| RTNModel=Qwen2.5-Omni-3B, Bits=W8A82026.03 | 37.7 | |
| MBQModel=Qwen2.5-Omni-3B, Bits=W4A82026.03 | 36.7 | |
| SQModel=Qwen2.5-Omni-7B, Bits=W4A82026.03 | 36.7 | |
| SQModel=Qwen2.5-Omni-7B, Bits=W4A62026.03 | 35.9 | |
| RTNModel=Qwen2.5-Omni-7B, Bits=W4A82026.03 | 35.2 | |
| RTNModel=Qwen2.5-Omni-3B, Bits=W4A82026.03 | 29.7 | |
| SQModel=Qwen2.5-Omni-3B, Bits=W4A82026.03 | 27.3 | |
| RTNModel=Qwen2.5-Omni-3B, Bits=W4A62026.03 | 23.4 | |
| SQModel=Qwen2.5-Omni-3B, Bits=W4A62026.03 | 18.8 |