Predicate Grounding on ProDG Blocks
100F1 ScoreSymbolizer
Evaluation Results
| Method | Links | |
|---|---|---|
| SymbolizerModel=Gem.3.1-Pro2026.04 | 100 | |
| SYMBOLIZERBackbone=Gemini 3.1 Flash Lite2026.04 | 98.3 | |
| SYMBOLIZERBackbone=Mistral Small2026.04 | 98.3 | |
| SymbolizerModel=Gem.3.1-FL2026.04 | 98.1 | |
| ViLaInBackbone=GPT-4, Retry Strategy=two retries2026.04 | 98 | |
| SymbolizerModel=Gem.3.1-FL2026.04 | 97.7 | |
| ViLaInBackbone=GPT-4, Retry Strategy=no retry2026.04 | 97 | |
| SymbolizerModel=Mistral Small2026.04 | 96.9 | |
| SymbolizerModel=Gem.3.1-Pro2026.04 | 96.5 | |
| SYMBOLIZERBackbone=Gemini 3.1 Pro2026.04 | 96.5 | |
| ViLaInBackbone=Gem. 3.1-FL, Retry Setting=no retry2026.04 | 95.8 | |
| ViLaInBackbone=Gemini 3.1 Flash Lite, Retry Strategy=two retries2026.04 | 94.8 | |
| SYMBOLIZERBackbone=Gem.3.1-Pro2026.04 | 94.4 | |
| SYMBOLIZERBackbone=Gem.3.1-FL2026.04 | 94.4 | |
| ViLaInBackbone=Gem. 3.1-FL, Retry Setting=two retries2026.04 | 94.3 | |
| SYMBOLIZERBackbone=Mistral Small2026.04 | 93.4 | |
| ViLaInBackbone=GPT-4, Retry Setting=no retry2026.04 | 93 | |
| ViLaInBackbone=Gemini 3.1 Flash Lite, Retry Strategy=no retry2026.04 | 92.9 | |
| SymbolizerModel=Mistral Small2026.04 | 92.5 | |
| ViLaInBackbone=GPT-4, Retry Setting=two retries2026.04 | 90 | |
| ViLaInModel=GPT-4, Retries=no retry2026.04 | 79 | |
| ViLaInModel=GPT-4, Retries=two retries2026.04 | 74 | |
| ViLaInModel=Gem. 3.1-FL, Retries=two retries2026.04 | 61.6 | |
| ViLaInModel=Gem. 3.1-FL, Retries=no retry2026.04 | 57.9 | |
| ViLaInModel=Gem. 3.1-FL, Retries=two retries2026.04 | 37.6 | |
| ViLaInModel=Gem. 3.1-FL, Retries=no retry2026.04 | 35.7 |