List your company
ResearchFormerly WizWand

Multiple Choice Question Answering on MMLU High school US history (test)

93.84Top-1 AccuracyPSAO_LLM
24.794442.719760.64578.5703Apr 24, 2024Aug 27, 2024Dec 30, 2024May 4, 2025Sep 6, 2025Jan 9, 2026May 14, 2026
Updated 5mo ago

Evaluation results

MethodLinks
PSAO_LLMModel=GPT-4o2026.0593.84
MIPROModel=GPT-4o2026.0593.61
COPROModel=GPT-4o2026.0592.95
NEPENTHEModel=Llama 3.1-8B (16FP), Rem.=3/32, fine-tuning protocol=no ft2024.0436.76
NEPENTHEModel=Llama 3.1-8B (16FP), Rem.=7/32, fine-tuning protocol=no ft2024.0435.08
DenseModel=Llama 3.1-8B (16FP), Rem.=0/322024.0433.82
NEPENTHEModel=Llama 3.1-8B (16FP), Rem.=5/32, fine-tuning protocol=no ft2024.0429.9
NEPENTHEModel=Llama 3.1-8B (16FP), Rem.=9/32, fine-tuning protocol=no ft2024.0428.92
NEPENTHEModel=Llama 3.1-8B (16FP), Rem.=11/32, fine-tuning protocol=no ft2024.0427.45