Visual Question Answering on SEA-AYA and SEA-VL VQA
2.09Average Rank (SEA)Google Gemma-3
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Google Gemma-32026.04 | 2.09 | 2.29 | 2.54 | 1.69 | 2.15 | 2.17 | 2.37 | 2.07 | — | |
| SEA-Gemma-3 10%Merging weight (β)=10%2026.04 | 2.22 | 2.31 | 2.42 | 1.88 | 2.07 | 2.29 | 2.61 | 2.25 | — | |
| SEA-Gemma-3 (w/o merge)Merging=w/o merge2026.04 | 2.23 | 1.74 | 1.18 | 2.75 | 2.29 | 2.33 | 1.76 | 2 | — | |
| Google SigLIP2Evaluation protocol=Zero-Shot2026.04 | 25.81 | — | — | — | 25 | — | 25.56 | — | 28.95 | |
| SEA-SigLIP2Merge weight (beta)=25%, Merge strategy=linear merge, Evaluation protocol=Zero-Shot2026.04 | 26.36 | — | — | — | 25.4 | — | 23.96 | — | 27.63 | |
| SEA-SigLIP2Merge weight (beta)=50%, Merge strategy=linear merge, Evaluation protocol=Zero-Shot2026.04 | 28.06 | — | — | — | 26.99 | — | 27.16 | — | 31.25 | |
| SEA-SigLIP2 (w/o merge)Merge strategy=w/o merge, Evaluation protocol=Zero-Shot2026.04 | 28.96 | — | — | — | 28.59 | — | 29.07 | — | 28.29 | |
| SEA-SigLIP2Merge weight (beta)=75%, Merge strategy=linear merge, Evaluation protocol=Zero-Shot2026.04 | 29.66 | — | — | — | 30.05 | — | 28.75 | — | 28.62 |