Multimodal Understanding on SEED-I, VizWiz, ScienceQA
68.3SEED-I ScoreFP16
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FP16Model=LLaVA-v1.5 13B, Bits=FP162026.05 | 68.3 | 57.3 | 74.7 | 66.8 | |
| SplitQModel=LLaVA-v1.5 13B, Bits=W4A82026.05 | 68.3 | 57.7 | 74.7 | 66.9 | |
| SplitQModel=LLaVA-v1.5 13B, Bits=W4A42026.05 | 67.9 | 57.2 | 74 | 66.4 | |
| QSVDModel=LLaVA-v1.5 13B, Bits=W4A42026.05 | 67 | 56.8 | 67.8 | 63.9 | |
| QSVDModel=LLaVA-v1.5 13B, Bits=W4A82026.05 | 66.8 | 56.9 | 75 | 66.2 | |
| FP16Model=LLaVA-v1.5 7B, Bits=FP162026.05 | 66.2 | 54.3 | 70 | 63.5 | |
| DuquantModel=LLaVA-v1.5 13B, Bits=W4A82026.05 | 66.1 | 56.5 | 72.3 | 65 | |
| SplitQModel=LLaVA-v1.5 7B, Bits=W4A82026.05 | 65.3 | 56.6 | 70.3 | 64.1 | |
| SplitQModel=LLaVA-v1.5 7B, Bits=W4A42026.05 | 64.8 | 54.6 | 69.4 | 62.9 | |
| DuquantModel=LLaVA-v1.5 13B, Bits=W4A42026.05 | 64.6 | 55.3 | 67.2 | 62.4 | |
| SplitQModel=LLaVA-v1.5 13B, Bits=W3A32026.05 | 64.6 | 56.6 | 69.5 | 63.6 | |
| QVLMModel=LLaVA-v1.5 13B, Bits=W4A82026.05 | 64.2 | 55.7 | 68.4 | 62.8 | |
| SplitQModel=LLaVA-v1.5 7B, Bits=W3A32026.05 | 61.5 | 57.2 | 64.9 | 61.2 | |
| SplitQModel=LLaVA-v1.5 13B, Bits=W3A22026.05 | 59.2 | 57 | 61.8 | 59.3 | |
| QSVDModel=LLaVA-v1.5 7B, Bits=W4A82026.05 | 57.8 | 53.5 | 63.6 | 58.3 | |
| QSVDModel=LLaVA-v1.5 7B, Bits=W4A42026.05 | 55.1 | 53.6 | 57.7 | 55.5 | |
| DuquantModel=LLaVA-v1.5 7B, Bits=W4A82026.05 | 54.4 | 50.6 | 55.3 | 53.4 | |
| SplitQModel=LLaVA-v1.5 7B, Bits=W3A22026.05 | 54.4 | 55.7 | 52.3 | 54.1 | |
| DuquantModel=LLaVA-v1.5 7B, Bits=W4A42026.05 | 51.5 | 49.8 | 54.8 | 52 | |
| QVLMModel=LLaVA-v1.5 13B, Bits=W4A42026.05 | 48.3 | 50.9 | 65 | 54.7 | |
| QVLMModel=LLaVA-v1.5 7B, Bits=W4A82026.05 | 46.1 | 48.7 | 53.2 | 49.3 | |
| QVLMModel=LLaVA-v1.5 7B, Bits=W4A42026.05 | 37.2 | 48.9 | 53.1 | 46.4 |