Question Answering on OpenBookQA (D_eval)
75.4AccuracyBelief-SR
Evaluation results
| Method | Links | |
|---|---|---|
| Belief-SRModel=OLMo2025.02 | 75.4 | |
| VanillaModel=OLMo2025.02 | 71.7 | |
| Knowledge-SRModel=OLMo2025.02 | 69.6 | |
| Belief-SRModel=RPJ2025.02 | 68.2 | |
| Belief-SRModel=Pythia2025.02 | 66 | |
| Answer-SRModel=OLMo2025.02 | 65.8 | |
| VanillaModel=RPJ2025.02 | 64.5 | |
| Knowledge-SRModel=RPJ2025.02 | 64 | |
| Knowledge-SRModel=Pythia2025.02 | 63.8 | |
| VanillaModel=Pythia2025.02 | 63.5 | |
| Answer-SRModel=RPJ2025.02 | 61.7 | |
| Answer-SRModel=Pythia2025.02 | 59.3 |