Open-Ended Visual Question Answering on Delta-SECOND
32.74H-CQS METEORDelta-LLaVA
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Delta-LLaVAFine-tuned=true2026.04 | 32.74 | 41.45 | 27.77 | 45 | 30.31 | 42.8 | 31.93 | 54.01 | 29.49 | 40.25 | 29.91 | 37.16 | |
| LISAFine-tuned=true2026.04 | 28.64 | 32.13 | 23.77 | 35.92 | 26.58 | 41.88 | 29.96 | 43.43 | 25.29 | 33.84 | 25.53 | 33.58 | |
| LISATFine-tuned=true2026.04 | 27.71 | 37.07 | 23.88 | 40.21 | 26.35 | 40.71 | 29.59 | 45.99 | 25.27 | 33.73 | 25.15 | 31.67 | |
| OMG-LLaVAFine-tuned=true2026.04 | 26.8 | 37.06 | 22.86 | 34.73 | 23.87 | 41.26 | 28.45 | 44.73 | 26.55 | 32.98 | 23.89 | 30.97 | |
| PSALMFine-tuned=true2026.04 | 24.32 | 28.45 | 21.43 | 32.59 | 22.73 | 38.63 | 26.18 | 42.85 | 23.6 | 31.52 | 21.36 | 29.41 | |
| GPT-4.1Fine-tuned=false2026.04 | 16.4 | 28.02 | 15.77 | 30.26 | 14.21 | 28.77 | 17.22 | 32.3 | 16.8 | 27.61 | 15.13 | 25.38 | |
| Gemini 2.5 FlashFine-tuned=false2026.04 | 16.18 | 27.21 | 13.89 | 29.64 | 14.6 | 27.51 | 17.15 | 30.45 | 15.35 | 30.74 | 15.67 | 26.19 | |
| GPT-4oFine-tuned=false2026.04 | 15.79 | 26.98 | 18.25 | 28.03 | 14.89 | 26.08 | 15.83 | 31.15 | 18.57 | 29.11 | 15.14 | 24.23 | |
| Qwen3-VL 8BFine-tuned=false2026.04 | 15.47 | 24.11 | 15.7 | 24.38 | 14.76 | 23.1 | 15.6 | 22.92 | 16.57 | 21.17 | 15.24 | 21.78 | |
| EVOL-SAM3Fine-tuned=false2026.04 | 14.51 | 20.63 | 13.44 | 20.42 | 15.59 | 20.22 | 14.56 | 20.59 | 14.88 | 20.18 | 14.55 | 20.17 | |
| Qwen2.5-VL 7BFine-tuned=false2026.04 | 13.26 | 22.4 | 16.58 | 20.03 | 11.81 | 22.85 | 13.52 | 20.36 | 16.61 | 20.04 | 11.87 | 20.07 | |
| InternVL3 8BFine-tuned=false2026.04 | 11.21 | 24.35 | 12.83 | 24.82 | 14.69 | 22.51 | 15.42 | 24.65 | 14.5 | 23.19 | 14.75 | 21.97 | |
| InternVL2.5 8BFine-tuned=false2026.04 | 10.44 | 22.06 | 10.57 | 23.19 | 13.26 | 21.74 | 12.21 | 24.21 | 15.49 | 22.01 | 13.28 | 20.89 |