List your company
ResearchFormerly WizWand

Predicate Grounding on ProDG Blocks

100F1 ScoreSymbolizer
33.12850.48967.8585.211Apr 20, 2026
Updated 6mo ago

Evaluation results

MethodLinks
SymbolizerModel=Gem.3.1-Pro2026.04100
SYMBOLIZERBackbone=Gemini 3.1 Flash Lite2026.0498.3
SYMBOLIZERBackbone=Mistral Small2026.0498.3
SymbolizerModel=Gem.3.1-FL2026.0498.1
ViLaInBackbone=GPT-4, Retry Strategy=two retries2026.0498
SymbolizerModel=Gem.3.1-FL2026.0497.7
ViLaInBackbone=GPT-4, Retry Strategy=no retry2026.0497
SymbolizerModel=Mistral Small2026.0496.9
SymbolizerModel=Gem.3.1-Pro2026.0496.5
SYMBOLIZERBackbone=Gemini 3.1 Pro2026.0496.5
ViLaInBackbone=Gem. 3.1-FL, Retry Setting=no retry2026.0495.8
ViLaInBackbone=Gemini 3.1 Flash Lite, Retry Strategy=two retries2026.0494.8
SYMBOLIZERBackbone=Gem.3.1-Pro2026.0494.4
SYMBOLIZERBackbone=Gem.3.1-FL2026.0494.4
ViLaInBackbone=Gem. 3.1-FL, Retry Setting=two retries2026.0494.3
SYMBOLIZERBackbone=Mistral Small2026.0493.4
ViLaInBackbone=GPT-4, Retry Setting=no retry2026.0493
ViLaInBackbone=Gemini 3.1 Flash Lite, Retry Strategy=no retry2026.0492.9
SymbolizerModel=Mistral Small2026.0492.5
ViLaInBackbone=GPT-4, Retry Setting=two retries2026.0490
ViLaInModel=GPT-4, Retries=no retry2026.0479
ViLaInModel=GPT-4, Retries=two retries2026.0474
ViLaInModel=Gem. 3.1-FL, Retries=two retries2026.0461.6
ViLaInModel=Gem. 3.1-FL, Retries=no retry2026.0457.9
ViLaInModel=Gem. 3.1-FL, Retries=two retries2026.0437.6
ViLaInModel=Gem. 3.1-FL, Retries=no retry2026.0435.7