Image-Language Understanding on SEEDB
69.9AccuracyOriginal
Evaluation Results
| Method | Links | |
|---|---|---|
| OriginalModel=LLaVA-Next-7B, Bit=162025.03 | 69.9 | |
| OriginalModel=LLaVA1.5-13B, Bit=162025.03 | 67.7 | |
| QuIP#Model=LLaVA1.5-13B, Bit=22025.03 | 66.7 | |
| CASPQuIP#Model=LLaVA1.5-13B, Bit=22025.03 | 66.7 | |
| CASPQuIP#Model=LLaVA-Next-7B, Bit=22025.03 | 66.4 | |
| QuIP#Model=LLaVA-Next-7B, Bit=22025.03 | 65.6 | |
| OriginalModel=LLaVA1.5-7B, Bit=162025.03 | 65.4 | |
| CASPAQLMModel=LLaVA1.5-13B, Bit=22025.03 | 64.4 | |
| CASPQuIP#Model=LLaVA1.5-7B, Bit=22025.03 | 63.1 | |
| QuIP#Model=LLaVA1.5-7B, Bit=22025.03 | 61.4 | |
| CASPAQLMModel=LLaVA-Next-7B, Bit=22025.03 | 60.7 | |
| CASPGPTQModel=LLaVA1.5-13B, Bit=2.22025.03 | 59.7 | |
| AQLMModel=LLaVA1.5-13B, Bit=22025.03 | 56.4 | |
| GPTQModel=LLaVA1.5-13B, Bit=2.22025.03 | 52.9 | |
| CASPAQLMModel=LLaVA1.5-7B, Bit=22025.03 | 52.2 | |
| AQLMModel=LLaVA1.5-7B, Bit=22025.03 | 41.7 | |
| CASPGPTQModel=LLaVA-Next-7B, Bit=2.22025.03 | 37.4 | |
| AQLMModel=LLaVA-Next-7B, Bit=22025.03 | 30.3 | |
| CASPGPTQModel=LLaVA1.5-7B, Bit=2.22025.03 | 24.2 | |
| GPTQModel=LLaVA-Next-7B, Bit=2.22025.03 | 5.9 | |
| GPTQModel=LLaVA1.5-7B, Bit=2.22025.03 | 3 |