General Language Model Evaluation on MMLU, BBH, TruthfulQA, TriviaQA, and AlpacaEval
68.93MMLUELUDe
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ELUDeFinetune=GA+GD2026.04 | 68.93 | 22.38 | 39.75 | 28.59 | 6.1453 | |
| RWKUFinetune=GA2026.04 | 68.79 | 31.33 | 38 | 40.77 | 6.0383 | |
| ELUDeFinetune=GA+KL2026.04 | 68.79 | 40.9 | 39.5 | 27.3 | 6.1676 | |
| RWKUFinetune=GA+GD2026.04 | 68.71 | 34.41 | 37.5 | 42.45 | 6.0307 | |
| Before2026.04 | 68.64 | 40.9 | 37.75 | 39.85 | 6.0196 | |
| MAGEFinetune=GA+KL2026.04 | 68.64 | 43.06 | 38.5 | 29.69 | 6.1099 | |
| ELUDeFinetune=GA2026.04 | 68.57 | 31.48 | 39.25 | 26.7 | 6.1704 | |
| MAGEFinetune=GA+GD2026.04 | 68.57 | 43.06 | 38.25 | 44.08 | 5.9923 | |
| DirectQAFinetune=GA+KL2026.04 | 68.57 | 34.26 | 38.5 | 37.52 | 6.0251 | |
| DirectQAFinetune=NPO2026.04 | 68.49 | 42.13 | 38.75 | 37.71 | 6.0951 | |
| RWKUFinetune=GA+KL2026.04 | 68.49 | 39.97 | 37.5 | 41.13 | 6.0506 | |
| MAGEFinetune=GA2026.04 | 68.42 | 43.83 | 39.75 | 24.6 | 6.1535 | |
| ELUDeFinetune=NPO2026.04 | 68.42 | 38.58 | 44.75 | 15.46 | 6.4073 | |
| MAGEFinetune=NPO2026.04 | 68.35 | 42.9 | 43.25 | 16.42 | 6.3429 | |
| RWKUFinetune=NPO2026.04 | 68.27 | 40.12 | 39 | 22.53 | 6.2853 | |
| DirectQAFinetune=GA+GD2026.04 | 68.2 | 34.41 | 38.25 | 45.15 | 5.8489 | |
| DirectQAFinetune=GA2026.04 | 67.84 | 43.36 | 37.75 | 35.06 | 6.0679 | |
| BeforeBackbone=Llama-2-7b-chat2026.04 | 42.4 | 26.54 | 28.75 | 40.56 | 6.2993 | |
| DirectQAFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 42.11 | 20.99 | 29 | 46.58 | 6.2765 | |
| DirectQAFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 42.03 | 19.75 | 29 | 46.4 | 6.2686 | |
| MAGEFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 41.96 | 23.58 | 30 | 32.91 | 6.3436 | |
| DirectQAFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 41.74 | 28.09 | 27.75 | 49.1 | 6.2556 | |
| ELUDeFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 41.67 | 24.38 | 31.75 | 32.32 | 6.3341 | |
| ELUDeFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 41.67 | 10.03 | 31.75 | 31.51 | 6.3354 | |
| MAGEFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 41.59 | 27.41 | 30.5 | 24.69 | 6.3499 | |
| ELUDeFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 41.52 | 14.66 | 33.5 | 28.2 | 6.3393 | |
| DirectQAFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 41.52 | 20.83 | 28.5 | 45.17 | 6.2774 | |
| RWKUFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 41.37 | 20.22 | 29.25 | 40.53 | 6.3267 | |
| MAGEFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 41.3 | 25.15 | 30.5 | 29.55 | 6.3446 | |
| MAGEFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 41.23 | 24.38 | 33 | 16.56 | 6.3849 | |
| RWKUFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 40.5 | 21.6 | 30.5 | 37.18 | 6.3051 | |
| RWKUFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 39.84 | 21.91 | 30.5 | 37.08 | 6.2991 | |
| ELUDeFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 39.77 | 18.67 | 35.25 | 15.26 | 6.393 | |
| RWKUFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 39.69 | 23.46 | 30.25 | 36.75 | 6.3109 |