Visual Question Answering on FSVQA (subject 1)
51.12VQA AccuracyBRAIN-IT VQA
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| BRAIN-IT VQAsubject=12026.05 | 51.12 | 48.33 | 88.26 | 85.02 | 81.89 | 78.63 | 50.9 | 0.702 | |
| MindLLMsubject=12026.05 | 48.03 | 43 | 87.1 | 83.03 | 79.27 | 75.5 | 49.05 | 0.666 | |
| MindBridgesubject=12026.05 | 45.95 | 40.97 | 86.52 | 82.28 | 78.34 | 74.35 | 48.63 | 0.657 | |
| UniBrainsubject=12026.05 | 44.58 | 37.87 | 85.1 | 80.01 | 75.49 | 70.73 | 46.89 | 0.629 | |
| UMBRAEsubject=12026.05 | 40.67 | 0 | 23.11 | 5.86 | 2.1 | 1.04 | 8.93 | 0.004 | |
| BrainChatsubject=12026.05 | 36.3 | 30.22 | 83.99 | 78.5 | 73 | 69.73 | 44.76 | 0.6 | |
| OneLLMsubject=12026.05 | 31.44 | 21.02 | 37.42 | 31.72 | 26.95 | 22.48 | 26.35 | 0.313 |