List your company
ResearchFormerly WizWand

Multiple Choice Question Answering on OBQA (test)

71.6AccuracyOracle
25.673637.596849.5261.4432Apr 19, 2026
Updated 6mo ago

Evaluation results

MethodLinks
OracleModel Size=Large, Noise Type=None, Expertise Distribution=Dist. ①2026.0471.6
REALMModel Size=Large, Noise Type=Uniform, Expertise Distribution=Dist. ①2026.0469.68
REALMModel Size=Large, Noise Type=Systematic, Expertise Distribution=Dist. ①2026.0469.6
REALMModel Size=Large, Noise Type=Asymmetric, Expertise Distribution=Dist. ①2026.0469.04
NOISYModel Size=Large, Noise Type=Systematic, Expertise Distribution=Dist. ①2026.0461.88
NOISYModel Size=Large, Noise Type=Uniform, Expertise Distribution=Dist. ①2026.0461.36
OracleModel Size=Base, Noise Type=None, Expertise Distribution=Dist. ①2026.0459.6
REALMModel Size=Base, Noise Type=Uniform, Expertise Distribution=Dist. ①2026.0457.88
NOISYModel Size=Large, Noise Type=Asymmetric, Expertise Distribution=Dist. ①2026.0457.84
REALMModel Size=Base, Noise Type=Systematic, Expertise Distribution=Dist. ①2026.0457.52
REALMModel Size=Base, Noise Type=Asymmetric, Expertise Distribution=Dist. ①2026.0457.48
NOISYModel Size=Base, Noise Type=Asymmetric, Expertise Distribution=Dist. ①2026.0449.84
NOISYModel Size=Base, Noise Type=Uniform, Expertise Distribution=Dist. ①2026.0449.12
NOISYModel Size=Base, Noise Type=Systematic, Expertise Distribution=Dist. ①2026.0449
OracleModel Size=Small, Noise Type=None, Expertise Distribution=Dist. ①2026.0444.2
REALMModel Size=Small, Noise Type=Systematic, Expertise Distribution=Dist. ①2026.0440.8
REALMModel Size=Small, Noise Type=Uniform, Expertise Distribution=Dist. ①2026.0439.44
REALMModel Size=Small, Noise Type=Asymmetric, Expertise Distribution=Dist. ①2026.0437.84
NOISYModel Size=Small, Noise Type=Asymmetric, Expertise Distribution=Dist. ①2026.0431.64
NOISYModel Size=Small, Noise Type=Uniform, Expertise Distribution=Dist. ①2026.0430.28
NOISYModel Size=Small, Noise Type=Systematic, Expertise Distribution=Dist. ①2026.0427.44