Multi-modal Reasoning on Science QA v1.3-13B (test)
8.9TimeAWQ
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AWQBitwidth=W4A4, Backbone=LLaVA-v1.3-13B2024.10 | 8.9 | 77.91 | 11.2 | |
| Q-VLMBitwidth=W4A4, Backbone=LLaVA-v1.3-13B2024.10 | 8.9 | 80.78 | 9.6 | |
| AWQBitwidth=W8A8, Backbone=LLaVA-v1.3-13B2024.10 | 11.2 | 88.94 | 17.2 | |
| Q-VLMBitwidth=W8A8, Backbone=LLaVA-v1.3-13B2024.10 | 11.2 | 89.82 | 15.7 | |
| AWQBitwidth=FP, Backbone=LLaVA-v1.3-13B2024.10 | 12.9 | 90 | 24 | |
| QLORABitwidth=W8A8, Backbone=LLaVA-v1.3-13B2024.10 | 16.7 | 89.32 | 16.5 | |
| QLORABitwidth=W4A4, Backbone=LLaVA-v1.3-13B2024.10 | 17 | 78.64 | 10.7 |