Multiple Choice Question Answering on MMLU continuation (test)
39.65AccuracyTOP
Evaluation Results
| Method | Links | |
|---|---|---|
| TOPSize=7B, Zero-shot=true2025.08 | 39.65 | |
| NTPSize=7B, Zero-shot=true2025.08 | 39.47 | |
| DS-MTPSize=7B, Zero-shot=true2025.08 | 38.16 | |
| MTPSize=7B, Zero-shot=true2025.08 | 38.14 | |
| TOPSize=1.8B, Zero-shot=true2025.08 | 36.21 | |
| NTPSize=1.8B, Zero-shot=true2025.08 | 35.34 | |
| DS-MTPSize=1.8B, Zero-shot=true2025.08 | 35.01 | |
| MTPSize=1.8B, Zero-shot=true2025.08 | 34.76 | |
| TOPSize=340M, Zero-shot=true2025.08 | 30.09 | |
| NTPSize=340M, Zero-shot=true2025.08 | 29.81 | |
| MTPSize=340M, Zero-shot=true2025.08 | 29.08 | |
| DS-MTPSize=340M, Zero-shot=true2025.08 | 28.47 |