Visual Question Answering on E-VQA M2KR setup (test)
70.3BEMBEFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| BEFTAnswer Generator=Qwen2-VL-7B-Instruct, Retriever=PreFLMR-L2026.04 | 70.3 | 60.6 | |
| DPOAnswer Generator=Qwen2-VL-7B-Instruct, Retriever=PreFLMR-L2026.04 | 64.1 | 60.6 | |
| GPT-4o-miniAnswer Generator=GPT-4o-mini2026.04 | 63.8 | 60.6 | |
| MuKA+Answer Generator=VILA-13B2026.04 | 63.1 | 64.9 | |
| SFTAnswer Generator=Qwen2-VL-7B-Instruct, Retriever=PreFLMR-L2026.04 | 61.5 | 60.6 | |
| RAVQA-v2Answer Generator=T5-Large2026.04 | 54.5 | 60.6 | |
| ReTAnswer Generator=LLaMA-3.1-8B2026.04 | 43.7 | 46.3 | |
| UniIRAnswer Generator=T5-Large2026.04 | 25.7 | 22 |