Question Answering on OpenBook QA (test)
28.8AccuracyMDLM
Evaluation results
| Method | Links | |
|---|---|---|
| MDLMdistillation=After Distillation (SDTT)2025.05 | 28.8 | |
| MDLMdistillation=Before2025.05 | 28.6 | |
| MDLM2026.02 | 28.6 | |
| Duo++k=22026.02 | 27.8 | |
| PGM 8 / 8distillation=Before2025.05 | 26.6 | |
| PGM 8 / 8distillation=After Distillation (SDTT)2025.05 | 25.8 | |
| PGM 6 / 6 (1024)distillation=Before2025.05 | 25.4 | |
| Duo++k=52026.02 | 25.4 | |
| PGM 6 / 6 (1024)distillation=After Distillation (SDTT)2025.05 | 25 | |
| Duo2026.02 | 23.4 | |
| Duo++k=32026.02 | 23 | |
| AR Transformer2026.02 | 19 |