Question Answering on OpenBookQA D^v (train)
100AccuracyVanilla
Evaluation results
| Method | Links | |
|---|---|---|
| VanillaModel=OLMo2025.02 | 100 | |
| VanillaModel=Pythia2025.02 | 100 | |
| VanillaModel=RPJ2025.02 | 100 | |
| Belief-SRModel=OLMo2025.02 | 94.7 | |
| Belief-SRModel=RPJ2025.02 | 94.5 | |
| Knowledge-SRModel=Pythia2025.02 | 92 | |
| Belief-SRModel=Pythia2025.02 | 92 | |
| Knowledge-SRModel=OLMo2025.02 | 90.9 | |
| Answer-SRModel=OLMo2025.02 | 90.5 | |
| Knowledge-SRModel=RPJ2025.02 | 89 | |
| Answer-SRModel=Pythia2025.02 | 88.2 | |
| Answer-SRModel=RPJ2025.02 | 86.4 |