Document Question Answering on DUDE
0.5809ANLSArctic-TILT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Arctic-TILTFine-tuned on DUDE=true2026.01 | 0.5809 | 0.6271 | 0.5645 | 0.4669 | 0.6261 | |
| GPT-4&Azure OCRFine-tuned on DUDE=true2026.01 | 0.5392 | 0.5973 | 0.5248 | 0.5785 | 0.5131 | |
| GRAMFine-tuned on DUDE=true2026.01 | 0.5336 | 0.5683 | 0.5232 | 0.1996 | 0.6543 | |
| GRAM C-FormerFine-tuned on DUDE=true2026.01 | 0.5097 | 0.5515 | 0.5046 | 0.1726 | 0.6104 | |
| DocGptVQAFine-tuned on DUDE=true2026.01 | 0.5002 | 0.5186 | 0.4832 | 0.2822 | 0.6204 | |
| AVIRFine-tuned on DUDE=false2026.01 | 0.4905 | 0.6754 | 0.6404 | 0.1029 | 0 | |
| DocBlipVQAFine-tuned on DUDE=true2026.01 | 0.4762 | 0.5069 | 0.4631 | 0.3073 | 0.5522 | |
| Qwen2.5-3B-AWQFine-tuned on DUDE=false2026.01 | 0.4575 | 0.6319 | 0.594 | 0.1199 | 0 | |
| T5-concatFine-tuned on DUDE=true2026.01 | 0.3867 | 0.3727 | 0.375 | 0.1681 | 0.5289 | |
| Multi-Modal T5 VQAFine-tuned on DUDE=true2026.01 | 0.379 | 0.4155 | 0.4024 | 0.2021 | 0.3467 | |
| HI-VT5Fine-tuned on DUDE=true2026.01 | 0.3574 | 0.2831 | 0.3298 | 0.106 | 0.629 | |
| QAPFine-tuned on DUDE=true2026.01 | 0.1159 | 0.0009 | 0.0007 | 0 | 0.6199 |