Visual Question Answering on iNaturalist (test)
46.6AccuracyGemma
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GemmaMitigation Protocol=After (Probe-guided)2026.07 | 46.6 | 36.5 | |
| Qwen3Mitigation Protocol=After (Probe-guided)2026.07 | 45.6 | 39.3 | |
| LlamaMitigation Protocol=After (Probe-guided)2026.07 | 45.5 | 33.4 | |
| Qwen2.5Mitigation Protocol=After (Probe-guided)2026.07 | 39.6 | 34.8 | |
| LlamaMitigation Protocol=Before2026.07 | 12.1 | — | |
| GemmaMitigation Protocol=Before2026.07 | 10.1 | — | |
| Qwen3Mitigation Protocol=Before2026.07 | 6.3 | — | |
| Qwen2.5Mitigation Protocol=Before2026.07 | 4.8 | — |