Knowledge Evaluation on MMLU (Continual)
32.03AccuracySTOC
Evaluation results
| Method | Links | |
|---|---|---|
| STOCModel Scale=1.7B, Prompts=5-shot, Freezing Layers=Best reported2026.05 | 32.03 | |
| STOCModel Scale=0.6B, Prompts=5-shot, Freezing Layers=Best reported2026.05 | 30.92 | |
| LAMOLModel Scale=0.6B, Prompts=5-shot, Freezing Layers=Best reported2026.05 | 29.42 | |
| LAMOLModel Scale=1.7B, Prompts=5-shot, Freezing Layers=Best reported2026.05 | 28.91 | |
| NaiveModel Scale=0.6B, Prompts=5-shot, Freezing Layers=Best reported2026.05 | 24.4 | |
| NaiveModel Scale=1.7B, Prompts=5-shot, Freezing Layers=Best reported2026.05 | 24.01 |