Brain MRI localisation on NOVA (test)
43.5mAP@30WALDO
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| WALDOModel=Qwen2.5-VL-72B2026.05 | 43.5 | 40.4 | 26.3 | 23.5 | 29.6 | |
| WALDOModel=Gemini-2.0-Flash2026.05 | 38 | 24 | 10 | 2 | 24.5 | |
| Zero-shotModel=Qwen2.5-VL-72B2026.05 | 37.7 | — | 24.5 | — | — | |
| Zero-shot (rep.)Model=Qwen2.5-VL-72B, s/img=∼22026.05 | 36.4 | 33.3 | 23.4 | 20.6 | 23.6 | |
| Zero-shotModel=Qwen3-VL-235B (MoE), s/img=∼52026.05 | 36.3 | 33.3 | 20.1 | 17.5 | 25.1 | |
| WALDOModel=GPT-4o2026.05 | 32 | 20 | 14 | 4 | 21.7 | |
| WALDOModel=Qwen3-VL-32B2026.05 | 32 | 20 | 18 | 8 | 22.7 | |
| WALDOModel=Qwen3-VL-235B (MoE)2026.05 | 31.8 | 28.7 | 15.2 | 12.8 | 21.7 | |
| Zero-shotModel=Qwen3-VL-32B, s/img=∼32026.05 | 20.4 | 17.7 | 13.8 | 11.5 | 13.8 | |
| Zero-shotModel=Gemini-2.0-Flash2026.05 | 20.16 | — | 7.37 | — | — | |
| Zero-shotModel=GPT-4o, s/img=∼32026.05 | 19 | 8 | 3 | 0 | 14.2 | |
| Zero-shot (rep.)Model=Gemini-2.0-Flash, s/img=∼42026.05 | 18.1 | 15.6 | 6.4 | 4.8 | 15.2 |