Visual Question Answering on RSVQA-LR (test)
97R/U ScoreRS-Agent
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| RS-AgentModel Category=models tailored for remote sensing2024.06 | 97 | — | 91.07 | 90.58 | 90.88 | |
| GeoChatModel Category=models tailored for remote sensing2024.06 | 94 | — | 91.09 | 90.33 | 90.7 | |
| RSVQAModel Category=models tailored for remote sensing2024.06 | 90 | — | 87.47 | 81.5 | 86.32 | |
| LHRS-BotModel Category=models tailored for remote sensing2024.06 | 89.07 | — | 88.51 | 90 | 89.19 | |
| SkyEyeGPTModel Category=models tailored for remote sensing2024.06 | 88.93 | — | 88.63 | 75 | 84.16 | |
| GRASPParams (M)=4.252026.01 | 85.7 | 32.8 | 77.5 | 78.8 | 68.7 | |
| DoRAParams (M)=50.22026.01 | 84.3 | 30.1 | 77.4 | 78.7 | 67.6 | |
| LoRAParams (M)=50.12026.01 | 84 | 29.5 | 77.3 | 79 | 67.5 | |
| AdapterParams (M)=16.72026.01 | 81.9 | 28 | 74.6 | 77.1 | 65.4 | |
| VPTParams (M)=6.72026.01 | 80.4 | 31.9 | 75.5 | 76.9 | 66.2 | |
| APromptParams (M)=16.12026.01 | 79.8 | 26.8 | 69 | 72.2 | 62 | |
| Prompt TuningParams (M)=0.412026.01 | 78.3 | 24.1 | 68.5 | 70.3 | 60.3 | |
| LLaVA-Next (Base)2026.01 | 71 | 23.8 | 55.4 | 66.5 | 54.2 | |
| InstructBLIPModel Category=general-purpose MLLMs2024.06 | 62.62 | — | 48.83 | 63.92 | 59.12 | |
| QWen-VL-ChatModel Category=general-purpose MLLMs2024.06 | 62 | — | 47.65 | 54.64 | 58.73 | |
| MiniGPTv2Model Category=general-purpose MLLMs2024.06 | 60.02 | — | 51.64 | 67.64 | 59.77 | |
| LLaVA-1.5Model Category=general-purpose MLLMs2024.06 | 59.22 | — | 73.16 | 65.19 | 65.86 | |
| mPLUG-Owl2Model Category=general-purpose MLLMs2024.06 | 57.99 | — | 74.04 | 65.04 | 65.69 |