Document Visual Question Answering on DocVQA (DocVQA Metric)
94.01DocVQA ScoreGPTQ
Evaluation Results
| Method | Links | |
|---|---|---|
| GPTQModel=InternVL3.5-14B-Instruct, Weight bits=3 bit, Memory=5.38 GB2026.07 | 94.01 | |
| Full PrecisionModel=InternVL3.5-38B-Instruct, Weight bits=16 bit, Memory=71.51 GB2026.07 | 94 | |
| Full PrecisionModel=InternVL3.5-14B-Instruct, Weight bits=16 bit, Memory=28.16 GB2026.07 | 93.4 | |
| Full PrecisionModel=InternVL3.5-8B-Instruct, Weight bits=16 bit, Memory=15.89 GB2026.07 | 92.47 | |
| GPTQModel=InternVL3.5-38B-Instruct, Weight bits=3 bit, Memory=12.71 GB2026.07 | 90.25 | |
| GPTQModel=InternVL3.5-8B-Instruct, Weight bits=3 bit, Memory=2.83 GB2026.07 | 89.82 | |
| SAB-LVLMModel=InternVL3.5-38B-Instruct, Weight bits=1.06 bit, Memory=10.27 GB2026.07 | 87.19 | |
| ARB-LLMModel=InternVL3.5-38B-Instruct, Weight bits=1.08 bit, Memory=10.27 GB2026.07 | 86.85 | |
| ARB-LLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.33 GB2026.07 | 85.15 | |
| SAB-LVLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.33 GB2026.07 | 84.34 | |
| PB-LLMModel=InternVL3.5-38B-Instruct, Weight bits=1.70 bit, Memory=10.24 GB2026.07 | 54.02 | |
| SAB-LVLMModel=InternVL3.5-8B-Instruct, Weight bits=1.07 bit, Memory=2.28 GB2026.07 | 48.03 | |
| BiLLMModel=InternVL3.5-14B-Instruct, Weight bits=1.07 bit, Memory=4.53 GB2026.07 | 47.09 | |
| BiLLMModel=InternVL3.5-38B-Instruct, Weight bits=1.07 bit, Memory=10.72 GB2026.07 | 42.9 | |
| ARB-LLMModel=InternVL3.5-8B-Instruct, Weight bits=1.07 bit, Memory=2.28 GB2026.07 | 40.67 | |
| BiLLMModel=InternVL3.5-8B-Instruct, Weight bits=1.08 bit, Memory=2.39 GB2026.07 | 0.93 | |
| PB-LLMModel=InternVL3.5-8B-Instruct, Weight bits=1.70 bit, Memory=2.28 GB2026.07 | 0.03 | |
| PB-LLMModel=InternVL3.5-14B-Instruct, Weight bits=1.70 bit, Memory=4.34 GB2026.07 | 0 |