LLM Instruction Tuning on MMLU
59.37MMLULESS
Evaluation results
| Method | Links | |
|---|---|---|
| LESSPool=Dolly, Backbone=Llama-3.2-3B2026.05 | 59.37 | |
| ToVPool=Oasst, Backbone=Llama-3.2-3B2026.05 | 59.37 | |
| ToVPool=Dolly, Backbone=Llama-3.2-3B2026.05 | 59.3 | |
| TACSPool=Dolly, Backbone=Llama-3.2-3B2026.05 | 59.26 | |
| LESSPool=Oasst, Backbone=Llama-3.2-3B2026.05 | 58.92 | |
| TACSPool=Oasst, Backbone=Llama-3.2-3B2026.05 | 58.52 | |
| TACSPool=Average, Backbone=Llama-3.2-3B2026.05 | 58.26 | |
| TACSPool=Flan, Backbone=Llama-3.2-3B2026.05 | 58.04 | |
| ToVPool=Average, Backbone=Llama-3.2-3B2026.05 | 57.96 | |
| LESSPool=Average, Backbone=Llama-3.2-3B2026.05 | 57.92 | |
| TACSPool=COT, Backbone=Llama-3.2-3B2026.05 | 57.22 | |
| ToVPool=COT, Backbone=Llama-3.2-3B2026.05 | 57.21 | |
| LESSPool=Flan, Backbone=Llama-3.2-3B2026.05 | 56.93 | |
| LESSPool=COT, Backbone=Llama-3.2-3B2026.05 | 56.48 | |
| RandomPool=Dolly, Backbone=Llama-3.2-3B2026.05 | 56.25 | |
| RandomPool=Oasst, Backbone=Llama-3.2-3B2026.05 | 56.19 | |
| ToVPool=Flan, Backbone=Llama-3.2-3B2026.05 | 55.98 | |
| RandomPool=Flan, Backbone=Llama-3.2-3B2026.05 | 55.75 | |
| RandomPool=Average, Backbone=Llama-3.2-3B2026.05 | 55.14 | |
| RandomPool=COT, Backbone=Llama-3.2-3B2026.05 | 52.36 | |
| OursBackbone=LLaMA-7B, Selection Ratio=50%2026.03 | 36.9 | |
| Full DatasetBackbone=LLaMA-7B, Selection Ratio=100%2026.03 | 34.9 |