Logical Reasoning on MNLogic 5dgt
72.78AccuracyVLC
Evaluation results
| Method | Links | |
|---|---|---|
| VLCBackbone Scale=7B, Random Seeds=52026.03 | 72.78 | |
| PrismBackbone Scale=7B, Random Seeds=52026.03 | 50.19 | |
| End2end RSBackbone Scale=7B, Random Seeds=52026.03 | 49.51 | |
| End2end FTBackbone Scale=7B, Random Seeds=52026.03 | 46.55 | |
| ViperGPTBackbone Scale=7B, Random Seeds=52026.03 | 45.36 |