Multiple Choice Question Answering on MMLU (General Accuracy)
22.95MMLU AccuracyFull-Rank
Evaluation results
| Method | Links | |
|---|---|---|
| Full-RankModel Scale=1B, Rank (r)=512, Evaluation Protocol=Zero-shot2026.06 | 22.95 | |
| Low-RankModel Scale=1B, Rank (r)=512, Evaluation Protocol=Zero-shot2026.06 | 22.95 | |
| DLR +Low-RankModel Scale=1B, Rank (r)=512, Evaluation Protocol=Zero-shot2026.06 | 22.95 | |
| DLR +CoLAModel Scale=1B, Rank (r)=512, Evaluation Protocol=Zero-shot2026.06 | 22.95 |