Robust Reasoning on MMLU-Pro (Accuracy)
21AccuracyNITP
Evaluation results
| Method | Links | |
|---|---|---|
| NITPModel scale=9bA1b, Evaluation=few-shot, Context length=81922026.05 | 21 | |
| NTPModel scale=9bA1b, Evaluation=few-shot, Context length=81922026.05 | 15.29 | |
| NITPModel scale=3bA0.5b, Evaluation=few-shot, Context length=81922026.05 | 12.29 | |
| NTPModel scale=3bA0.5b, Evaluation=few-shot, Context length=81922026.05 | 11 | |
| NITPModel scale=1.9bA0.3b, Evaluation=few-shot, Context length=81922026.05 | 7.47 | |
| NTPModel scale=1.9bA0.3b, Evaluation=few-shot, Context length=81922026.05 | 7.14 |