Logical Reasoning on KandLogic 5obj
91.18AccuracyViperGPT
Evaluation results
| Method | Links | |
|---|---|---|
| ViperGPTBackbone Scale=7B, Random Seeds=52026.03 | 91.18 | |
| VLCBackbone Scale=7B, Random Seeds=52026.03 | 89.97 | |
| End2end FTBackbone Scale=7B, Random Seeds=52026.03 | 64.28 | |
| End2end RSBackbone Scale=7B, Random Seeds=52026.03 | 62.11 | |
| PrismBackbone Scale=7B, Random Seeds=52026.03 | 55.06 |