Logical Reasoning on MNLogic 3dgt
99.83AccuracyEnd2end FT
Evaluation results
| Method | Links | |
|---|---|---|
| End2end FTBackbone Scale=7B, Random Seeds=52026.03 | 99.83 | |
| VLCBackbone Scale=7B, Random Seeds=52026.03 | 97.37 | |
| ViperGPTBackbone Scale=7B, Random Seeds=52026.03 | 85.66 | |
| End2end RSBackbone Scale=7B, Random Seeds=52026.03 | 71.73 | |
| PrismBackbone Scale=7B, Random Seeds=52026.03 | 51.06 |