List your company
ResearchFormerly WizWand

Reasoning and comprehension on MMLU

26.7MMLU Reasoning & Comprehension AccuracyOPT-1.3B FFF
24.82825.31425.826.286Mar 18, 2026
Updated 6mo ago

Evaluation results

MethodLinks
OPT-1.3B FFFFew-shot (5-shot)=true, Model Depth (d)=6, Training tokens=26B, Fine-tuning (FT)=true2026.0326.7
TinyLlama v1.1Few-shot (5-shot)=true, Training tokens=2T2026.0326.58
OPT-1.3B FFFFew-shot (5-shot)=true, Model Depth (d)=4, Training tokens=26B, Fine-tuning (FT)=true2026.0326.4
OPT-1.3B FFFew-shot (5-shot)=true, Training configuration=retrained2026.0325.87
OPT-1.3B FFFFew-shot (5-shot)=true, Model Depth (d)=6, Training tokens=26B, Fine-tuning (FT)=false2026.0325.8
Pythia-1.0BFew-shot (5-shot)=true, Training tokens=1T2026.0325.7
OPT-1.3B FFFFew-shot (5-shot)=true, Model Depth (d)=4, Training tokens=26B, Fine-tuning (FT)=false2026.0325.51
Pythia-1.4BFew-shot (5-shot)=true, Training tokens=1T2026.0325.41
TinyLlama v1.0Few-shot (5-shot)=true, Training tokens=2T2026.0325.34
OPT-1.3BFew-shot (5-shot)=true, Training tokens=300B2026.0324.9