Multimodal In-Context Learning on TrueMICL
79.54OutlierMGI
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MGIModel Family=Gemma3, Size=27B, Shots=42026.04 | 79.54 | 76.9 | 70.34 | |
| VanillaModel Family=Gemma3, Size=27B, Shots=42026.04 | 78.62 | 76.55 | 70 | |
| VanillaModel Family=Qwen2.5-VL, Size=32B, Shots=42026.04 | 78.45 | 74.14 | 97.93 | |
| MGIModel Family=Qwen2.5-VL, Size=32B, Shots=42026.04 | 78.45 | 74.48 | 98.28 | |
| MGIModel Family=Gemma3, Size=12B, Shots=42026.04 | 73.85 | 66.9 | 48.28 | |
| VanillaModel Family=Gemma3, Size=12B, Shots=42026.04 | 72.93 | 66.9 | 47.93 | |
| MGIModel Family=Qwen2.5-VL, Size=7B, Shots=42026.04 | 70.17 | 64.49 | 77.93 | |
| VanillaModel Family=Qwen2.5-VL, Size=7B, Shots=42026.04 | 69.09 | 63.45 | 77.59 |