Image-Language Understanding on SQA (EM)
71.6EMOriginal
Evaluation Results
| Method | Links | |
|---|---|---|
| OriginalModel=LLaVA1.5-13B, Bit=162025.03 | 71.6 | |
| CASPQuIP#Model=LLaVA1.5-13B, Bit=22025.03 | 71.2 | |
| OriginalModel=LLaVA-Next-7B, Bit=162025.03 | 70.1 | |
| QuIP#Model=LLaVA1.5-13B, Bit=22025.03 | 68.3 | |
| OriginalModel=LLaVA1.5-7B, Bit=162025.03 | 67.9 | |
| CASPAQLMModel=LLaVA1.5-13B, Bit=22025.03 | 67.9 | |
| CASPQuIP#Model=LLaVA1.5-7B, Bit=22025.03 | 61.6 | |
| CASPQuIP#Model=LLaVA-Next-7B, Bit=22025.03 | 61.1 | |
| QuIP#Model=LLaVA-Next-7B, Bit=22025.03 | 60.6 | |
| QuIP#Model=LLaVA1.5-7B, Bit=22025.03 | 60.3 | |
| CASPGPTQModel=LLaVA1.5-13B, Bit=2.22025.03 | 59.7 | |
| AQLMModel=LLaVA1.5-13B, Bit=22025.03 | 57.7 | |
| CASPAQLMModel=LLaVA-Next-7B, Bit=22025.03 | 53.5 | |
| CASPAQLMModel=LLaVA1.5-7B, Bit=22025.03 | 50.8 | |
| CASPGPTQModel=LLaVA1.5-7B, Bit=2.22025.03 | 43.9 | |
| CASPGPTQModel=LLaVA-Next-7B, Bit=2.22025.03 | 37.5 | |
| AQLMModel=LLaVA1.5-7B, Bit=22025.03 | 36.7 | |
| AQLMModel=LLaVA-Next-7B, Bit=22025.03 | 32.7 | |
| GPTQModel=LLaVA1.5-13B, Bit=2.22025.03 | 24.6 | |
| GPTQModel=LLaVA-Next-7B, Bit=2.22025.03 | 9.42 | |
| GPTQModel=LLaVA1.5-7B, Bit=2.22025.03 | 9.17 |