Vision-Language Modeling on LiveB
5.1PPLOriginal
Evaluation Results
| Method | Links | |
|---|---|---|
| OriginalModel=LLaVA1.5-13B, Bit=162025.03 | 5.1 | |
| OriginalBit=16, Base Model=LLaVA1.5-7B2025.03 | 5.45 | |
| OriginalModel=LLaVA1.5-7B, Bit=162025.03 | 5.5 | |
| QuIP#Bit=3, Base Model=LLaVA1.5-7B2025.03 | 5.68 | |
| CASP_QuIP#Bit=3, Base Model=LLaVA1.5-7B2025.03 | 5.69 | |
| QuIP#Model=LLaVA1.5-13B, Bit=22025.03 | 6 | |
| CASPQuIP#Model=LLaVA1.5-13B, Bit=22025.03 | 6 | |
| OriginalModel=LLaVA-Next-7B, Bit=162025.03 | 6 | |
| CASP_AQLMBit=3, Base Model=LLaVA1.5-7B2025.03 | 6.06 | |
| CASP_GPTQBit=3, Base Model=LLaVA1.5-7B2025.03 | 6.07 | |
| CASPAQLMModel=LLaVA1.5-13B, Bit=22025.03 | 6.2 | |
| CASPQuIP#Model=LLaVA1.5-7B, Bit=22025.03 | 7.1 | |
| CASPQuIP#Model=LLaVA-Next-7B, Bit=22025.03 | 7.3 | |
| AQLMBit=3, Base Model=LLaVA1.5-7B2025.03 | 7.64 | |
| QuIP#Model=LLaVA-Next-7B, Bit=22025.03 | 7.7 | |
| CASPAQLMModel=LLaVA1.5-7B, Bit=22025.03 | 7.9 | |
| CASPGPTQModel=LLaVA1.5-7B, Bit=2.22025.03 | 8.2 | |
| CASPGPTQModel=LLaVA1.5-13B, Bit=2.22025.03 | 8.6 | |
| GPTQBit=3, Base Model=LLaVA1.5-7B2025.03 | 9.07 | |
| QuIP#Model=LLaVA1.5-7B, Bit=22025.03 | 9.2 | |
| CASPAQLMModel=LLaVA-Next-7B, Bit=22025.03 | 9.3 | |
| AQLMModel=LLaVA1.5-13B, Bit=22025.03 | 10.2 | |
| CASPGPTQModel=LLaVA-Next-7B, Bit=2.22025.03 | 10.6 | |
| GPTQModel=LLaVA1.5-13B, Bit=2.22025.03 | 13.7 | |
| AQLMModel=LLaVA1.5-7B, Bit=22025.03 | 14.9 | |
| AQLMModel=LLaVA-Next-7B, Bit=22025.03 | 19.3 | |
| GPTQModel=LLaVA-Next-7B, Bit=2.22025.03 | 29.9 | |
| GPTQModel=LLaVA1.5-7B, Bit=2.22025.03 | 38.1 |