List your company

Instruction Tuning on MMLU

74MMLU ScoreFull Data
55.17660.06364.9569.837May 14, 2026

Evaluation results

MethodLinks
Full DataModel=Qwen-2.5-7B-Instruct, Selection Ratio=100%, Cost (h)=32.82026.057470.1—
PODSModel=Qwen-2.5-7B-Instruct, Selection Ratio=50%, Cost (h)=16.9, Speedup=1.9×2026.057470.10
PODSModel=LLaMA-3.2-3B, Selection Ratio=50%, Cost (h)=9.0, Speedup=2.0×2026.055652.20
Full DataModel=LLaMA-3.2-3B, Selection Ratio=100%, Cost (h)=17.62026.0555.952.2—