Idiom-based vision-language matching (Subtask A) on AdMIRe multilingual (15 languages) 2.0 (test)
35Top-1 AccBest submission
Evaluation Results
| Method | Links | |
|---|---|---|
| Best submissionSystem architecture=SigLIP2, Idiom replacement=true, Zero-shot classification=true2026.02 | 35 | |
| Ensemble (Qwen3+GPT-4o)System architecture=Qwen3 + GPT-4o ensemble2026.02 | 33.5 | |
| GPT-4o2026.02 | 32.5 | |
| Qwen3-32B2026.02 | 31 | |
| Mistral-large2026.02 | 30 | |
| Llama3.1-70B2026.02 | 29.5 | |
| DeepSeek-v32026.02 | 28 | |
| CLIP baselineSystem architecture=XLM-RoBERTa-ViT-H-142026.02 | 26.7 |