Reasoning on BABI 2-Choice
28.9Delta AccuracyRBCorr
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RBCorrModel=Llama3.1-8B2026.02 | 28.9 | — | — | -0.401 | |
| Batch Calibration (BC)Model=Llama3.1-8B2026.02 | 26.5 | — | — | -0.307 | |
| Contextual Calibration (CC)Model=Llama3.1-8B2026.02 | 11.8 | — | — | -0.123 | |
| Contextual Calibration (CC)Model=Llama3.1-8B-Instruct2026.02 | 2.8 | — | — | -0.04 | |
| Batch Calibration (BC)Model=Llama3.1-8B-Instruct2026.02 | 2.1 | — | — | -0.114 | |
| RBCorrModel=Llama3.1-8B-Instruct2026.02 | 2.1 | — | — | -0.12 | |
| BaselineModel=Llama3.1-8B2026.02 | — | 59 | 0.41 | — | |
| BaselineModel=Llama3.1-8B-Instruct2026.02 | — | 86.6 | 0.131 | — |