Natural Language Inference on MNLI 3-Choice
9.9Delta AccuracyRBCorr
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RBCorrModel=Llama3.1-8B2026.02 | 9.9 | — | — | -0.214 | |
| Batch Calibration (BC)Model=Llama3.1-8B2026.02 | 8.8 | — | — | -0.14 | |
| Contextual Calibration (CC)Model=Llama3.1-8B2026.02 | 8.7 | — | — | 0.001 | |
| RBCorrModel=Llama3.1-8B-Instruct2026.02 | 4.7 | — | — | -0.104 | |
| Contextual Calibration (CC)Model=Llama3.1-8B-Instruct2026.02 | 4.4 | — | — | -0.017 | |
| Batch Calibration (BC)Model=Llama3.1-8B-Instruct2026.02 | 3.6 | — | — | -0.076 | |
| BaselineModel=Llama3.1-8B2026.02 | — | 49.2 | 0.331 | — | |
| BaselineModel=Llama3.1-8B-Instruct2026.02 | — | 59.7 | 0.221 | — |