Retrieval on 325 queries 150 vision, 150 NLP, 75 multi-modal
3,238WinsBLUEPRINT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| BLUEPRINTParameters=17B, Scope=overall2026.02 | 3,238 | 1,205 | 625 | 72.88 | |
| Llama 4 ScoutParameters=17B2026.02 | 331 | 532 | 152 | 38.35 | |
| PixtralParameters=12B2026.02 | 328 | 538 | 138 | 37.88 | |
| LLaMA 3.2 Vision2026.02 | 263 | 645 | 104 | 28.96 | |
| LLaVA 1.6 MistralParameters=7B2026.02 | 166 | 723 | 123 | 18.67 | |
| PaliGemma 22026.02 | 117 | 800 | 108 | 12.76 |