Visual Question Answering on ViTextVQA (100-sample subset test)
96.42F1 ScoreHuman
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Human2024.04 | 96.42 | 88 | |
| GPT-4oshots=3-shot2024.04 | 76.67 | 56 | |
| GPT-4oshots=5-shot2024.04 | 75.62 | 55 | |
| GPT-4oshots=1-shot2024.04 | 69.55 | 45 | |
| Gemini-1.5-flashshots=5-shot2024.04 | 64.4 | 39 | |
| Gemini-1.5-flashshots=3-shot2024.04 | 62.37 | 35 | |
| Gemini-1.5-flashshots=1-shot2024.04 | 59.09 | 29 | |
| Gemini-1.5-flashshots=0-shot2024.04 | 57.75 | 26 | |
| ViTextBLIP-22024.04 | 56.43 | 26 | |
| GPT-4oshots=0-shot2024.04 | 55.51 | 25 | |
| QwenVL-7bshots=3-shot2024.04 | 54.85 | 36 | |
| QwenVL-7bshots=5-shot2024.04 | 54.74 | 35 | |
| QwenVL-7bshots=1-shot2024.04 | 54.1 | 36 | |
| QwenVL-7bshots=0-shot2024.04 | 53.8 | 28 |